-- Logs begin at Sun 2022-07-31 00:10:46 UTC, end at Sun 2022-07-31 02:24:32 UTC. -- Jul 31 01:01:29.585545 dv-neutron-master-2-hyperv systemd[1]: Starting Devstack devstack@keystone.service... Jul 31 01:01:29.596430 dv-neutron-master-2-hyperv devstack@keystone.service[80693]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 31 01:01:29.599564 dv-neutron-master-2-hyperv devstack@keystone.service[80693]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Jul 31 01:01:29 2022] *** Jul 31 01:01:29.599564 dv-neutron-master-2-hyperv devstack@keystone.service[80693]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 31 01:01:29.599564 dv-neutron-master-2-hyperv devstack@keystone.service[80693]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 31 01:01:29.599564 dv-neutron-master-2-hyperv devstack@keystone.service[80693]: nodename: dv-neutron-master-2-hyperv Jul 31 01:01:29.599564 dv-neutron-master-2-hyperv devstack@keystone.service[80693]: machine: x86_64 Jul 31 01:01:29.599564 dv-neutron-master-2-hyperv devstack@keystone.service[80693]: clock source: unix Jul 31 01:01:29.599962 dv-neutron-master-2-hyperv devstack@keystone.service[80693]: pcre jit disabled Jul 31 01:01:29.599962 dv-neutron-master-2-hyperv devstack@keystone.service[80693]: detected number of CPU cores: 4 Jul 31 01:01:29.599962 dv-neutron-master-2-hyperv devstack@keystone.service[80693]: current working directory: / Jul 31 01:01:29.599962 dv-neutron-master-2-hyperv devstack@keystone.service[80693]: detected binary path: /usr/bin/uwsgi-core Jul 31 01:01:29.599962 dv-neutron-master-2-hyperv devstack@keystone.service[80693]: your processes number limit is 47680 Jul 31 01:01:29.599962 dv-neutron-master-2-hyperv devstack@keystone.service[80693]: your memory page size is 4096 bytes Jul 31 01:01:29.599962 dv-neutron-master-2-hyperv devstack@keystone.service[80693]: detected max file descriptor number: 2048 Jul 31 01:01:29.599962 dv-neutron-master-2-hyperv devstack@keystone.service[80693]: lock engine: pthread robust mutexes Jul 31 01:01:29.599962 dv-neutron-master-2-hyperv devstack@keystone.service[80693]: thunder lock: enabled Jul 31 01:01:29.600491 dv-neutron-master-2-hyperv devstack@keystone.service[80693]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 31 01:01:29.600491 dv-neutron-master-2-hyperv devstack@keystone.service[80693]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 31 01:01:29.647388 dv-neutron-master-2-hyperv devstack@keystone.service[80693]: Python main interpreter initialized at 0x5560b78469c0 Jul 31 01:01:29.647388 dv-neutron-master-2-hyperv devstack@keystone.service[80693]: python threads support enabled Jul 31 01:01:29.647388 dv-neutron-master-2-hyperv devstack@keystone.service[80693]: your server socket listen backlog is limited to 100 connections Jul 31 01:01:29.647388 dv-neutron-master-2-hyperv devstack@keystone.service[80693]: your mercy for graceful operations on workers is 90 seconds Jul 31 01:01:29.647803 dv-neutron-master-2-hyperv devstack@keystone.service[80693]: mapped 403077 bytes (393 KB) for 2 cores Jul 31 01:01:29.647803 dv-neutron-master-2-hyperv devstack@keystone.service[80693]: *** Operational MODE: preforking *** Jul 31 01:01:29.648117 dv-neutron-master-2-hyperv devstack@keystone.service[80693]: *** uWSGI is running in multiple interpreter mode *** Jul 31 01:01:29.648117 dv-neutron-master-2-hyperv devstack@keystone.service[80693]: spawned uWSGI master process (pid: 80693) Jul 31 01:01:29.648333 dv-neutron-master-2-hyperv systemd[1]: Started Devstack devstack@keystone.service. Jul 31 01:01:29.649491 dv-neutron-master-2-hyperv devstack@keystone.service[80693]: spawned uWSGI worker 1 (pid: 80702, cores: 1) Jul 31 01:01:29.649491 dv-neutron-master-2-hyperv devstack@keystone.service[80693]: spawned uWSGI worker 2 (pid: 80703, cores: 1) Jul 31 01:01:29.649491 dv-neutron-master-2-hyperv devstack@keystone.service[80693]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 31 01:01:35.082949 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 31 01:01:35.082949 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: from cryptography.utils import int_from_bytes Jul 31 01:01:35.083886 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 31 01:01:35.083886 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: from cryptography.utils import int_from_bytes Jul 31 01:01:35.084325 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 31 01:01:35.084325 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: from cryptography.utils import int_from_bytes Jul 31 01:01:35.084430 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 31 01:01:35.084430 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: from cryptography.utils import int_from_bytes Jul 31 01:01:35.132736 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 31 01:01:35.132930 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 31 01:01:35.133100 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] command line args: [] {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 31 01:01:35.133204 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 31 01:01:35.133364 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 31 01:01:35.133452 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 31 01:01:35.133520 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ================================================================================ {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 31 01:01:35.133589 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] command line args: [] {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 31 01:01:35.133776 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] admin_token = **** {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.133869 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 31 01:01:35.133964 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ================================================================================ {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 31 01:01:35.134046 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] config_dir = [] {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.134186 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.134275 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] admin_token = **** {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.134372 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] config_source = [] {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.134452 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] config_dir = [] {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.134537 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] debug = True {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.134620 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.134731 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.134991 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] config_source = [] {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.134991 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] debug = True {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.135102 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.135164 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.135257 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.135401 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.135550 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.135669 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.135769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.135876 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.135976 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] list_limit = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.136069 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.136167 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] log_config_append = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.136265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] list_limit = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.136357 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.136456 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] log_config_append = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.136555 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] log_dir = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.136646 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.136737 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] log_file = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.136827 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] log_dir = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.136924 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.137025 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] log_file = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.137137 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.137219 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.137289 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.137406 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.137481 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.137608 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.137725 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.137806 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.137873 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.137988 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.138072 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.138194 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.138307 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.138423 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.138497 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.138555 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.138687 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.138798 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.138937 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.139017 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.139136 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.139217 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.139340 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.139414 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.139606 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.139691 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.139846 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.139960 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.140115 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.140358 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.140534 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] publish_errors = False {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.140652 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.140774 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.140911 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] publish_errors = False {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.141024 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.141139 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.141256 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.141365 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.141365 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.141569 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.141698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.141818 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.141927 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.142035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] standard_threads = False {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.142150 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] standard_threads = False {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.142267 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.142446 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.142566 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.142566 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.142777 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.142891 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] use_journal = False {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.143006 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.143168 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] use_json = False {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.143286 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] use_journal = False {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.143394 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] use_stderr = False {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.143526 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] use_json = False {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.143649 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] use_syslog = False {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.143761 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] use_stderr = False {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.143761 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] use_syslog = False {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.143982 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.144092 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:01:35.144200 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.144310 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.144425 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.144544 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.144654 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.144770 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.144884 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.144994 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.145103 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.145223 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.145336 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.145451 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.145561 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.145670 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.145778 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.145898 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.146014 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.146124 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.146233 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.146342 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.146452 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.146568 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.146678 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.146786 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.146901 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.147017 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.147127 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.147254 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.147371 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.147502 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.147615 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.147725 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.147834 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.148035 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.148149 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.148258 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.148374 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.148485 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.148594 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.148711 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.148821 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.148930 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.149047 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.149156 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.149272 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.149393 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.149505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.149623 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.149733 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.149733 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.149937 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.150054 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.150164 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.150273 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.150380 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.150380 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.150601 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.150712 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.150826 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.150939 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.151048 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.151048 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.151267 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.151377 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.151500 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.151500 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.151710 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.151821 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.151941 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.151941 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.152146 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.152146 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.152355 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.152464 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.152583 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.152700 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.152810 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.152918 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.153027 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.153135 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.153355 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.153470 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.153579 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.153689 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.153797 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.153906 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.154026 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.154141 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.154249 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.154369 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.154486 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.154591 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.154697 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.154793 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.154884 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.154976 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.155068 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.155159 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.155262 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.155357 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.155455 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.155610 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.155725 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.155837 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.155946 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.156055 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.156164 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.156280 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.156396 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.156591 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.156719 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.156831 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.156947 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.157050 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.157159 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.157269 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.157386 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.157503 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.157614 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.157723 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.157832 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.157951 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.158063 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.158183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.158301 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.158426 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.158555 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.158667 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.158777 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.158887 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.159006 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.159117 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.159233 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.159343 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.159444 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.159563 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.159686 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.159799 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.159909 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.160020 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.160129 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.160246 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.160362 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.160478 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.160588 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.160698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.160807 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.160924 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.161036 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.161146 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.161255 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.161365 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.161475 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.161593 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.161704 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.161814 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.161924 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.162033 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.162144 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.162261 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.162373 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.162483 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.162592 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.162702 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.162812 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.162931 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.163131 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.163259 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.163410 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.163545 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.163669 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.163788 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.163907 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.164019 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.164129 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.164247 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.164359 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.164555 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.164669 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.164780 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.164890 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.165000 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.165118 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.165239 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.165361 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.165485 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.165603 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.165720 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.165841 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.165953 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.166069 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.166188 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.166304 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.166414 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.166556 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.166675 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.166777 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.166879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.166990 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.167101 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.167211 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.167321 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.167440 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.167603 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.167715 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.167825 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.167936 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.168045 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.168168 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] auth.external = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.168281 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] auth.external = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.168393 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.168502 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.168612 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.168754 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.168878 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.168998 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.169119 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] auth.password = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.169273 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] auth.password = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.169405 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] auth.token = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.169520 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] auth.token = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.169640 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.169753 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.169872 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.169985 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.170097 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.170207 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.170319 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.170429 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.170554 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.170674 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.170778 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.170778 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.170986 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.170986 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.171202 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] credential.caching = True {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.171320 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] credential.caching = True {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.171432 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.171580 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.171693 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.171805 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.171929 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.172044 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.172177 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.172290 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.172401 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.172512 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.172633 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.172745 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.172856 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.172967 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.173084 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.173205 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.173325 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.173473 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.173585 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.173706 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.173819 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.173937 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.174058 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.174171 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.174282 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.174393 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.174505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.174616 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.174736 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.174849 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.174961 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] federation.caching = True {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.175071 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] federation.caching = True {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.175189 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.175302 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.175421 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.175561 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.175674 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.175786 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.175897 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.176020 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.176142 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.176256 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.176368 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.176479 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.176590 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.176701 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.176822 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.176934 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.177046 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.177157 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.177268 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.177386 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.177506 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.177619 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.177730 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] identity.caching = True {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.177842 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] identity.caching = True {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.177953 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.178137 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.178252 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.178364 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.178476 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.178593 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.178706 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.178826 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.178945 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.179057 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.179169 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.179280 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.179391 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.179529 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.179644 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.179756 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.179867 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.179867 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.180076 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.180195 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.180307 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.180419 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.180534 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.180534 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.180743 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.180862 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.180976 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.181087 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.181198 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.181309 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.181420 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.181539 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.181652 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.181763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.181880 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.181992 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.182103 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.182222 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.182335 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.182446 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.182557 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.182668 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.182786 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.182907 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.183020 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.183132 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.183242 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.183353 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.183551 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.183681 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.183782 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.183892 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.184003 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.184184 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.184298 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.184419 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.184533 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.184644 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.184755 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.184866 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.184977 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.185096 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.185209 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.185320 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.185431 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.185543 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.185654 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.185773 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.185886 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.185997 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.185997 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.186206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.186318 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.186437 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.186549 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.186659 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.186770 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.186881 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.186991 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.187110 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.187222 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.187334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.187445 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.187566 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.187678 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.187826 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.187971 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.188083 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.188195 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.188195 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.188408 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.188528 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.188641 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.188753 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.188863 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.188974 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.189098 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.189212 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.189212 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.user = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.189421 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.189532 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.189642 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.189761 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.189873 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.user = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.189984 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.190095 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.190206 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.190317 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.190441 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.190563 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.190676 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.190786 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.190897 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.191009 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.191127 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.191239 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.191350 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.191350 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.191629 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.191744 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.191864 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.191977 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.192088 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.192199 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.192310 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.192421 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.192540 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.192659 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.192771 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.192771 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.192980 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.193091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.193209 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.193209 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.193418 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.193565 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.193680 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.193791 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.193911 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.194024 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.194136 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.194248 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.194359 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.194470 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.194588 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.194702 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.194813 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.194927 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.195037 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.195148 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.195267 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.195379 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.195507 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.195621 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.195732 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.195843 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.195966 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.196079 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.196191 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.196302 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.196413 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.196524 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.196643 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.196756 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.196868 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.196979 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.197090 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.197202 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.197320 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.197432 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.197544 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.197654 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] resource.caching = True {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.197766 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.197877 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.197995 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.198108 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.198219 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.198330 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.198441 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] resource.caching = True {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.198552 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.198671 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.198784 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.198895 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.199005 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.199116 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.199226 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.199345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.199457 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.199586 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.199697 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.199809 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.199931 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] role.caching = True {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.200119 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.200234 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] role.driver = sql {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.200346 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.200460 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.200572 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.200683 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.200803 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] role.caching = True {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.200917 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.201029 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] role.driver = sql {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.201145 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.201258 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.201362 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.201480 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.201593 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.201705 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.201817 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.201931 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.202049 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.202162 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.202279 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.202391 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.202502 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.202613 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.202732 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.202845 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.202963 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.203077 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.203188 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.203299 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.203441 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.203618 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.203618 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.203834 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.203946 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.204060 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.204184 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.204298 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.204298 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.204508 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.204619 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.204730 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.204849 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.204961 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.205074 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.205185 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.205312 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.205423 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.205543 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.205656 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.205768 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.205879 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.205991 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.206102 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.206223 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.206336 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.206519 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.206635 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.207007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.207131 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.207247 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.207359 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.207470 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.207603 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.207716 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.207840 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.207954 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.208066 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.208178 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.208290 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.208401 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] token.caching = True {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.208521 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.208633 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.208745 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.208856 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.208975 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.209088 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.209208 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] token.caching = True {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.209322 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.209446 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.209558 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.209669 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.209780 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.209899 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.210012 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.210129 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.210242 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.210355 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.210469 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.210588 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.210701 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.210813 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.210924 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.211036 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.211147 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.211266 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.211416 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.211615 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.211732 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.211844 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.211957 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.212081 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.212195 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.212307 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.212418 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.212530 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.212641 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] database.connection = **** {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.212766 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.212887 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.213008 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.213121 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.213233 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.213344 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.213456 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] database.connection = **** {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.213584 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.213740 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.213864 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.213977 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.214089 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.214202 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.214313 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.214425 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.214545 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.214659 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.214770 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.214881 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.214993 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.215105 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.215224 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.215337 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.215449 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.215599 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.215711 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.215823 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.215947 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.216061 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.216173 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.216285 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.216396 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.216508 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.216628 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.216741 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.216853 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.216966 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.217076 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 31 01:01:35.217189 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.217189 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.217189 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:01:35.217189 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 31 01:01:35.243804 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.244028 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.244249 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.244459 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.244677 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.244896 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.253066 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.253523 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.282226 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.282399 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.282546 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.282804 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.333790 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.333960 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.386542 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.386788 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.388721 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.388932 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.450712 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.450972 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.451087 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.451240 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.451376 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.451552 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.451683 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.451762 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.451824 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.451895 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.451982 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.451982 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.474656 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.474863 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.475082 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.475273 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.475273 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.475419 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.475584 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.475665 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.475743 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.475820 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.475882 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.475953 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.476116 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.476340 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.486803 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.487140 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.499475 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.499736 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.499929 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.500046 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.500125 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.500187 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.500492 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.500623 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.500773 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.500857 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.500921 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.500994 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.500994 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.501238 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:01:35.518060 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.518236 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 31 01:01:35.518600 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.518726 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.518808 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 31 01:01:35.518904 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 31 01:01:35.519016 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.519228 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.519356 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.519436 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 31 01:01:35.519564 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.519680 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.519768 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.519963 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.520217 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.520470 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.529292 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.529557 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.529816 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.529942 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.530062 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.530175 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.530455 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.530729 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.536936 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:01:35.537567 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:01:35.541591 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:01:35.541862 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.542132 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.542257 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:01:35.542378 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.542471 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.542670 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.542797 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.542874 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.542990 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.543206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.543344 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.543423 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.543524 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.543683 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.543812 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.543923 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.544032 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.544198 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.544325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.544511 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.544767 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.566890 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.568374 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:01:35.568606 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.568734 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.570074 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:01:35.570344 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.573183 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:01:35.573455 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.573723 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.574892 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:01:35.575168 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.575437 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.580404 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:01:35.580682 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.582098 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:01:35.582372 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.584793 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:01:35.584997 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.585286 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.585557 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.585825 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.586100 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.586356 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.586480 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:01:35.586596 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.586689 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.586958 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.587219 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.587511 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.587771 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.588030 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.588302 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.602328 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.602594 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.604061 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.604331 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.606480 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:01:35.608223 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:01:35.609634 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.609951 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.611374 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.611685 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.614287 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:01:35.616023 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:01:35.617551 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:01:35.619201 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:01:35.620700 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.620987 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.621259 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.621544 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.621818 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.622103 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.622321 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.622612 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.622867 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.623151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.623434 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.623728 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.638265 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:01:35.638542 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.638803 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.639061 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.639880 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:01:35.640153 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.640412 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.640632 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.645998 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.647501 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.647763 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.647763 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.649006 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.649290 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.650551 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:01:35.650825 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.651105 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.651384 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.651689 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.652068 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:01:35.652343 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.652605 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.652883 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.653150 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.663041 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:01:35.663238 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.663520 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.663824 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.664097 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.664363 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.664502 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:01:35.664641 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.664724 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.665013 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.665283 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.665560 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.665823 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.666098 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.681199 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:01:35.683056 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:01:35.685022 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:01:35.699544 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:01:35.699711 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.699781 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.699842 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.699902 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.699986 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:01:35.699986 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.699986 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.700146 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:01:35.700146 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.700146 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.700307 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.700369 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.701231 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:01:35.701933 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:01:35.704666 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.704896 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.705207 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.705326 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.705464 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.705736 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.705879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.706023 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.713746 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:01:35.714028 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.714311 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.714435 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:01:35.714950 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.715443 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.721073 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:01:35.721347 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.721621 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.721886 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.722161 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.724563 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.724563 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.724563 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.724563 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.724563 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.725058 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:01:35.725140 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.725202 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.725321 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.725410 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.725487 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.725593 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.725682 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.725799 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.725799 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.725799 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.725799 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.726097 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.726293 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.726572 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.726839 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.727190 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.727405 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:01:35.757716 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5560b78469c0 pid: 80702 (default app) Jul 31 01:01:35.761142 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b4666-cf1b-47b7-be16-841836f02ace None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:35.761427 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b4666-cf1b-47b7-be16-841836f02ace None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:35.761695 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b4666-cf1b-47b7-be16-841836f02ace None None] PATH_INFO: `/v3` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:35.764733 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5560b78469c0 pid: 80703 (default app) Jul 31 01:01:35.766042 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 791 bytes} [Sun Jul 31 01:01:35 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:43.381727 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e6fd4-d937-4191-b09a-03d3de49b0dd None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:43.382240 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e6fd4-d937-4191-b09a-03d3de49b0dd None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:43.382240 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e6fd4-d937-4191-b09a-03d3de49b0dd None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:43.386733 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1/2] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:01:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:01:43.392333 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142a1f2-f34e-475d-bec5-6a5976b1e603 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:43.392790 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142a1f2-f34e-475d-bec5-6a5976b1e603 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:43.392880 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142a1f2-f34e-475d-bec5-6a5976b1e603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:43.463655 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: INFO dbcounter [None req-5142a1f2-f34e-475d-bec5-6a5976b1e603 None None] Registered counter for database keystone Jul 31 01:01:43.485104 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG oslo_db.sqlalchemy.engines [None req-5142a1f2-f34e-475d-bec5-6a5976b1e603 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80702) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 01:01:43.496933 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writer thread running {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 01:01:43.684253 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG passlib.handlers.bcrypt [None req-5142a1f2-f34e-475d-bec5-6a5976b1e603 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80702) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 31 01:01:43.684658 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG passlib.handlers.bcrypt [None req-5142a1f2-f34e-475d-bec5-6a5976b1e603 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80702) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 31 01:01:43.742355 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-5142a1f2-f34e-475d-bec5-6a5976b1e603 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:43.743998 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-5142a1f2-f34e-475d-bec5-6a5976b1e603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:43.879158 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 2/3] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 488 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 31 01:01:44.017205 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e6fd4-d937-4191-b09a-03d3de49b0dd None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:44.092414 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: INFO dbcounter [None req-4f4e6fd4-d937-4191-b09a-03d3de49b0dd None None] Registered counter for database keystone Jul 31 01:01:44.117236 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG oslo_db.sqlalchemy.engines [None req-4f4e6fd4-d937-4191-b09a-03d3de49b0dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80703) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 01:01:44.126587 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writer thread running {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 01:01:44.248999 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e6fd4-d937-4191-b09a-03d3de49b0dd None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:44.255035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e522594-29ee-4067-bea4-8ea4d2f9e576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:44.255731 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e522594-29ee-4067-bea4-8ea4d2f9e576 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:44.256013 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e522594-29ee-4067-bea4-8ea4d2f9e576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:44.256288 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e522594-29ee-4067-bea4-8ea4d2f9e576 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:44.265351 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e522594-29ee-4067-bea4-8ea4d2f9e576 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:44.317316 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3e522594-29ee-4067-bea4-8ea4d2f9e576 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 31 01:01:44.317590 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e522594-29ee-4067-bea4-8ea4d2f9e576 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:44.328006 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 2/4] 10.222.0.60 () {58 vars in 1324 bytes} [Sun Jul 31 01:01:44 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 01:01:44.334569 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5142a1f2-f34e-475d-bec5-6a5976b1e603 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:44.349877 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5142a1f2-f34e-475d-bec5-6a5976b1e603 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:44.355570 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bae93a-7700-4901-9d33-e63ca3b6c600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:44.356734 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bae93a-7700-4901-9d33-e63ca3b6c600 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:44.357013 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bae93a-7700-4901-9d33-e63ca3b6c600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:44.357288 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bae93a-7700-4901-9d33-e63ca3b6c600 admin admin] PATH_INFO: `/v3/projects/9b95aba7aab1442a9b3944b9e1f7019a` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:44.358935 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bae93a-7700-4901-9d33-e63ca3b6c600 admin admin] RBAC: Authorizing `identity:get_project(project_id=9b95aba7aab1442a9b3944b9e1f7019a)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:44.410256 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: WARNING keystone.common.rbac_enforcer.enforcer [None req-07bae93a-7700-4901-9d33-e63ca3b6c600 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 31 01:01:44.410825 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bae93a-7700-4901-9d33-e63ca3b6c600 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:44.415289 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 3/5] 10.222.0.60 () {56 vars in 1207 bytes} [Sun Jul 31 01:01:44 2022] GET /identity/v3/projects/9b95aba7aab1442a9b3944b9e1f7019a => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:01:46.383377 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e69396-666d-4170-beee-d1eea273fe25 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:46.383904 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e69396-666d-4170-beee-d1eea273fe25 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:46.383904 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e69396-666d-4170-beee-d1eea273fe25 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:46.388073 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 3/6] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:01:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:01:46.393713 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d97c2-d448-465f-8dc4-81652b141317 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:46.394154 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d97c2-d448-465f-8dc4-81652b141317 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:46.394248 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d97c2-d448-465f-8dc4-81652b141317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:46.420655 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-e72d97c2-d448-465f-8dc4-81652b141317 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:46.423009 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-e72d97c2-d448-465f-8dc4-81652b141317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:46.437514 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 4/7] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 31 01:01:46.460237 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e69396-666d-4170-beee-d1eea273fe25 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:46.478319 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e69396-666d-4170-beee-d1eea273fe25 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:46.484338 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb45cd-0571-4109-ac3a-7307f06b0e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:46.484950 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb45cd-0571-4109-ac3a-7307f06b0e1c admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:46.485227 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb45cd-0571-4109-ac3a-7307f06b0e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:46.485499 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb45cd-0571-4109-ac3a-7307f06b0e1c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:46.493979 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdb45cd-0571-4109-ac3a-7307f06b0e1c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:46.495796 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdb45cd-0571-4109-ac3a-7307f06b0e1c admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:46.505059 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 4/8] 10.222.0.60 () {58 vars in 1324 bytes} [Sun Jul 31 01:01:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 01:01:46.513775 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d97c2-d448-465f-8dc4-81652b141317 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:46.528799 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d97c2-d448-465f-8dc4-81652b141317 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:46.535465 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09949c78-9c81-4505-9f01-c397002e961f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:46.536136 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09949c78-9c81-4505-9f01-c397002e961f admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:46.536418 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09949c78-9c81-4505-9f01-c397002e961f admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:46.536689 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09949c78-9c81-4505-9f01-c397002e961f admin admin] PATH_INFO: `/v3/users/652828201b9e47a5b54a3c3110e80fd8` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:46.538212 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09949c78-9c81-4505-9f01-c397002e961f admin admin] RBAC: Authorizing `identity:get_user(user_id=652828201b9e47a5b54a3c3110e80fd8)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:46.540101 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09949c78-9c81-4505-9f01-c397002e961f admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:46.541665 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 5/9] 10.222.0.60 () {56 vars in 1198 bytes} [Sun Jul 31 01:01:46 2022] GET /identity/v3/users/652828201b9e47a5b54a3c3110e80fd8 => generated 247 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:48.616459 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5dd44-0e9b-410c-9938-e21ec13f9c85 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:48.617243 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5dd44-0e9b-410c-9938-e21ec13f9c85 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:48.617243 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5dd44-0e9b-410c-9938-e21ec13f9c85 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:48.619229 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 5/10] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:01:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:01:48.627129 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8872e-2894-44f4-a485-2a0233e49027 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:48.627956 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8872e-2894-44f4-a485-2a0233e49027 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:48.628044 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8872e-2894-44f4-a485-2a0233e49027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:48.635430 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51427e3-8302-4f97-b0db-23b97b3588d0 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:48.635746 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51427e3-8302-4f97-b0db-23b97b3588d0 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:48.636018 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51427e3-8302-4f97-b0db-23b97b3588d0 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:48.637368 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 6/11] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:01:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:01:48.642381 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ac809-b317-4067-9108-188163f5f0a0 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:48.642663 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ac809-b317-4067-9108-188163f5f0a0 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:48.642938 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ac809-b317-4067-9108-188163f5f0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:48.648171 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-34c8872e-2894-44f4-a485-2a0233e49027 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:48.649362 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-34c8872e-2894-44f4-a485-2a0233e49027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:48.685330 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG passlib.handlers.bcrypt [None req-ea2ac809-b317-4067-9108-188163f5f0a0 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80703) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 31 01:01:48.685725 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG passlib.handlers.bcrypt [None req-ea2ac809-b317-4067-9108-188163f5f0a0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80703) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 31 01:01:48.730557 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-ea2ac809-b317-4067-9108-188163f5f0a0 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:48.732164 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-ea2ac809-b317-4067-9108-188163f5f0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:48.732778 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 6/12] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:01:48.756091 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8872e-2894-44f4-a485-2a0233e49027 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:48.781180 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:48.838452 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 7/13] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:01:48.859873 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8872e-2894-44f4-a485-2a0233e49027 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:48.861291 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ac809-b317-4067-9108-188163f5f0a0 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:48.893652 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1e344-16b1-47ec-b6b8-499739109a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:48.894204 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1e344-16b1-47ec-b6b8-499739109a15 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:48.894482 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1e344-16b1-47ec-b6b8-499739109a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:48.894753 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1e344-16b1-47ec-b6b8-499739109a15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:48.962236 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ac809-b317-4067-9108-188163f5f0a0 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:48.964886 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1e344-16b1-47ec-b6b8-499739109a15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:48.965468 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:48.966389 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1e344-16b1-47ec-b6b8-499739109a15 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:48.990117 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:49.002202 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6943c-a022-486d-8ea2-2c6285d939c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:49.003821 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6943c-a022-486d-8ea2-2c6285d939c3 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:49.004111 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6943c-a022-486d-8ea2-2c6285d939c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:49.004383 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6943c-a022-486d-8ea2-2c6285d939c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:49.016810 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce6943c-a022-486d-8ea2-2c6285d939c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:01:49.025448 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-fce6943c-a022-486d-8ea2-2c6285d939c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:01:49.025448 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:49.025448 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:49.025448 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:49.025448 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:49.025448 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:49.025448 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:49.025448 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:49.025448 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:49.025448 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:49.025448 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:49.025448 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:49.025448 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:01:49.025448 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:01:49.025448 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:01:49.025448 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:01:49.026391 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:01:49.026391 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:01:49.026391 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:01:49.026391 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:01:49.026391 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:49.026391 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:49.026391 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:49.026391 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:49.026391 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:49.026391 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:49.026391 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:49.026391 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:49.026391 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:49.026391 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:49.026391 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:49.026391 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:49.027204 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:49.027204 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:49.027204 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:49.027204 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:49.027204 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:01:49.027204 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:01:49.027204 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:01:49.027204 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:01:49.027204 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:01:49.027204 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:01:49.027204 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:01:49.027204 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:01:49.027204 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 8/14] 10.222.0.60 () {56 vars in 1096 bytes} [Sun Jul 31 01:01:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:01:49.032618 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6943c-a022-486d-8ea2-2c6285d939c3 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:49.066533 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 7/15] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:01:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 31 01:01:49.072227 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1e344-16b1-47ec-b6b8-499739109a15 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:49.131125 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6943c-a022-486d-8ea2-2c6285d939c3 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:49.164997 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6acf06-8bc1-4acb-8f6b-a5296a193a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:49.165555 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6acf06-8bc1-4acb-8f6b-a5296a193a83 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:49.165834 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6acf06-8bc1-4acb-8f6b-a5296a193a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:49.166089 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6acf06-8bc1-4acb-8f6b-a5296a193a83 None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:49.166833 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6acf06-8bc1-4acb-8f6b-a5296a193a83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:49.167126 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6acf06-8bc1-4acb-8f6b-a5296a193a83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:49.168608 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6acf06-8bc1-4acb-8f6b-a5296a193a83 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:49.169731 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1e344-16b1-47ec-b6b8-499739109a15 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:49.180440 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 9/16] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:01:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:01:49.185997 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6acf06-8bc1-4acb-8f6b-a5296a193a83 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:49.191862 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:49.204337 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a44e7-924e-497e-8b8f-7c8f854b726a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:49.204987 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a44e7-924e-497e-8b8f-7c8f854b726a None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:49.205267 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a44e7-924e-497e-8b8f-7c8f854b726a None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:49.205538 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a44e7-924e-497e-8b8f-7c8f854b726a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:49.212970 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:49.215728 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a44e7-924e-497e-8b8f-7c8f854b726a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:49.217225 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a44e7-924e-497e-8b8f-7c8f854b726a None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:49.235005 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-433a44e7-924e-497e-8b8f-7c8f854b726a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:01:49.235005 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:49.235005 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:49.235005 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:49.235005 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:49.235005 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:49.235005 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:49.235005 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:49.235005 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:49.235005 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:49.235005 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:49.235005 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:49.235005 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:01:49.235005 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:01:49.235005 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:01:49.235941 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:01:49.235941 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:49.235941 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:49.235941 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:49.235941 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:49.235941 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:49.235941 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:49.235941 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:49.235941 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:49.235941 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:49.235941 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:49.235941 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:49.235941 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:49.235941 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:49.235941 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:49.235941 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:49.235941 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:49.236722 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:01:49.236722 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:01:49.236722 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:01:49.236722 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:01:49.236722 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 8/17] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:01:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:01:49.242185 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a44e7-924e-497e-8b8f-7c8f854b726a None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:49.290324 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6acf06-8bc1-4acb-8f6b-a5296a193a83 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:49.323165 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d0d68-e2cb-4dc5-930a-e03de255b210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:49.323866 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d0d68-e2cb-4dc5-930a-e03de255b210 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:49.324140 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d0d68-e2cb-4dc5-930a-e03de255b210 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:49.324409 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d0d68-e2cb-4dc5-930a-e03de255b210 None admin] PATH_INFO: `/v3/users/652828201b9e47a5b54a3c3110e80fd8` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:49.326030 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28d0d68-e2cb-4dc5-930a-e03de255b210 None admin] RBAC: Authorizing `identity:get_user(user_id=652828201b9e47a5b54a3c3110e80fd8)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:49.327534 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28d0d68-e2cb-4dc5-930a-e03de255b210 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:49.329317 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 10/18] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:01:49 2022] GET /identity/v3/users/652828201b9e47a5b54a3c3110e80fd8 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:01:49.335292 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d0d68-e2cb-4dc5-930a-e03de255b210 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:49.438041 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:49.445706 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d0d68-e2cb-4dc5-930a-e03de255b210 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:49.455024 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a44e7-924e-497e-8b8f-7c8f854b726a None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:49.479905 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a22fd-48db-415c-8628-7c3492396198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:49.480776 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a22fd-48db-415c-8628-7c3492396198 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:49.481093 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a22fd-48db-415c-8628-7c3492396198 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:49.481344 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a22fd-48db-415c-8628-7c3492396198 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:49.482545 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a22fd-48db-415c-8628-7c3492396198 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:49.484066 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a22fd-48db-415c-8628-7c3492396198 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:49.485670 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 11/19] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:01:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:01:49.489220 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7dd40-01e7-4486-b384-2b13bb1b82a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:49.489844 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7dd40-01e7-4486-b384-2b13bb1b82a3 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:49.490123 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7dd40-01e7-4486-b384-2b13bb1b82a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:49.490435 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7dd40-01e7-4486-b384-2b13bb1b82a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:49.491087 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c7dd40-01e7-4486-b384-2b13bb1b82a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:49.491413 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c7dd40-01e7-4486-b384-2b13bb1b82a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:49.491620 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a22fd-48db-415c-8628-7c3492396198 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:49.492829 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c7dd40-01e7-4486-b384-2b13bb1b82a3 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:49.510559 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 9/20] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:01:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:01:49.601087 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a22fd-48db-415c-8628-7c3492396198 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:49.638951 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440c955-c41b-4eb9-996f-f3d969f6a2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:49.639652 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440c955-c41b-4eb9-996f-f3d969f6a2f0 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:49.639848 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440c955-c41b-4eb9-996f-f3d969f6a2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:49.640140 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440c955-c41b-4eb9-996f-f3d969f6a2f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:49.641087 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9440c955-c41b-4eb9-996f-f3d969f6a2f0 None admin] RBAC: Adding query filter params (role.id=fef526a7d2e741ce995d107f3ac934ae, scope.domain.id=default, user.id=652828201b9e47a5b54a3c3110e80fd8) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:49.641390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9440c955-c41b-4eb9-996f-f3d969f6a2f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:49.642862 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9440c955-c41b-4eb9-996f-f3d969f6a2f0 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:49.652733 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 12/21] 10.222.0.60 () {56 vars in 1322 bytes} [Sun Jul 31 01:01:49 2022] GET /identity/v3/role_assignments?user.id=652828201b9e47a5b54a3c3110e80fd8&scope.domain.id=default&role.id=fef526a7d2e741ce995d107f3ac934ae => generated 233 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:51.905997 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cee2e5-409f-40cc-8b54-05f76cef1a84 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:51.906871 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cee2e5-409f-40cc-8b54-05f76cef1a84 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:51.907310 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cee2e5-409f-40cc-8b54-05f76cef1a84 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:51.908852 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 10/22] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:01:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:01:51.914175 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9498d7b-56a9-4416-a288-7e1f33d373d8 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:51.914941 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9498d7b-56a9-4416-a288-7e1f33d373d8 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:51.915391 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9498d7b-56a9-4416-a288-7e1f33d373d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:51.939630 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-a9498d7b-56a9-4416-a288-7e1f33d373d8 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:51.941105 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-a9498d7b-56a9-4416-a288-7e1f33d373d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:51.971202 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:51.985780 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f29ae-2cdc-4031-b69a-7535252b6e4c None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:51.986063 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f29ae-2cdc-4031-b69a-7535252b6e4c None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:51.986338 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f29ae-2cdc-4031-b69a-7535252b6e4c None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:51.987727 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 11/23] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:01:51.993132 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18c895-d1aa-4f4b-8181-f07cad9fd26d None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:51.993424 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18c895-d1aa-4f4b-8181-f07cad9fd26d None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:51.993701 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18c895-d1aa-4f4b-8181-f07cad9fd26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:52.028072 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-9a18c895-d1aa-4f4b-8181-f07cad9fd26d None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:52.029289 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-9a18c895-d1aa-4f4b-8181-f07cad9fd26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:52.072957 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 13/24] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:01:52.086032 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:52.114145 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9498d7b-56a9-4416-a288-7e1f33d373d8 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:52.162831 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 12/25] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:01:52.164067 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6903c12-5126-4a46-b8fa-93b9baabe5b4 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:52.164349 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6903c12-5126-4a46-b8fa-93b9baabe5b4 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:52.164619 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6903c12-5126-4a46-b8fa-93b9baabe5b4 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:52.165854 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 13/26] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:01:52.172434 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad76d7-957f-47d1-ba0f-af36d0a32a21 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:52.172708 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad76d7-957f-47d1-ba0f-af36d0a32a21 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:52.172975 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad76d7-957f-47d1-ba0f-af36d0a32a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:52.204385 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-f9ad76d7-957f-47d1-ba0f-af36d0a32a21 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:52.205553 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-f9ad76d7-957f-47d1-ba0f-af36d0a32a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:52.291039 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9498d7b-56a9-4416-a288-7e1f33d373d8 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:52.332734 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 14/27] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:01:52.333569 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad76d7-957f-47d1-ba0f-af36d0a32a21 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:52.350717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb7f6e0-d7a2-44bc-84cf-97b24ffaace3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:52.351390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7f6e0-d7a2-44bc-84cf-97b24ffaace3 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:52.351708 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7f6e0-d7a2-44bc-84cf-97b24ffaace3 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:52.351982 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7f6e0-d7a2-44bc-84cf-97b24ffaace3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:52.376335 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb7f6e0-d7a2-44bc-84cf-97b24ffaace3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:52.378322 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb7f6e0-d7a2-44bc-84cf-97b24ffaace3 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:52.396710 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-edb7f6e0-d7a2-44bc-84cf-97b24ffaace3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:01:52.396710 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:52.396710 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:52.396710 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:52.396710 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:52.396710 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:52.396710 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:52.396710 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:52.396710 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:52.396710 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:52.396710 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:52.396710 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:52.396710 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:01:52.396710 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:01:52.396710 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:01:52.397580 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:01:52.397580 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:52.397580 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:52.397580 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:52.397580 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:52.397580 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:52.397580 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:52.397580 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:52.397580 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:52.397580 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:52.397580 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:52.397580 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:52.397580 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:52.397580 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:52.397580 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:52.397580 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:52.397580 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:52.398846 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:01:52.398846 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:01:52.398846 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:01:52.398846 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:01:52.398846 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 14/28] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:01:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:01:52.399770 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7db30d-1152-4835-9524-1803ee3350a5 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:52.400049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7db30d-1152-4835-9524-1803ee3350a5 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:52.400318 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7db30d-1152-4835-9524-1803ee3350a5 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:52.405750 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 15/29] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:01:52.405750 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7db30d-1152-4835-9524-1803ee3350a5 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:52.416359 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:52.459131 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:52.465823 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad76d7-957f-47d1-ba0f-af36d0a32a21 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:52.501501 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8619a-aaf8-44bb-9e8d-311cd3bfdc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:52.502275 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8619a-aaf8-44bb-9e8d-311cd3bfdc77 None admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:52.502974 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8619a-aaf8-44bb-9e8d-311cd3bfdc77 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:52.503315 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8619a-aaf8-44bb-9e8d-311cd3bfdc77 None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:52.504166 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b8619a-aaf8-44bb-9e8d-311cd3bfdc77 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:52.505804 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b8619a-aaf8-44bb-9e8d-311cd3bfdc77 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:52.633554 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7db30d-1152-4835-9524-1803ee3350a5 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:52.642062 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 15/30] 10.222.0.60 () {60 vars in 1131 bytes} [Sun Jul 31 01:01:52 2022] POST /identity/v3/roles => generated 219 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:01:52.645692 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8619a-aaf8-44bb-9e8d-311cd3bfdc77 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:52.691206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e118a-3b06-45e3-8bea-ce592375c66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:52.692184 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e118a-3b06-45e3-8bea-ce592375c66d None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:52.692631 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e118a-3b06-45e3-8bea-ce592375c66d None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:52.693217 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e118a-3b06-45e3-8bea-ce592375c66d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:52.705797 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e118a-3b06-45e3-8bea-ce592375c66d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:01:52.711415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-0e2e118a-3b06-45e3-8bea-ce592375c66d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:01:52.711415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:52.711415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:52.711415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:52.711415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:52.711415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:52.711415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:52.711415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:52.711415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:52.711415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:52.711415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:52.711415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:52.711415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:01:52.711415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:01:52.711415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:01:52.711415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:01:52.712330 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:01:52.712330 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:01:52.712330 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:01:52.712330 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:01:52.712330 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:52.712330 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:52.712330 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:52.712330 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:52.712330 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:52.712330 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:52.712330 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:52.712330 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:52.712330 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:52.712330 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:52.712330 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:52.712330 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:52.713059 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:52.713059 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:52.713059 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:52.713059 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:52.713059 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:01:52.713059 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:01:52.713059 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:01:52.713059 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:01:52.713059 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:01:52.713059 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:01:52.713059 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:01:52.713059 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:01:52.715628 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 16/31] 10.222.0.60 () {56 vars in 1096 bytes} [Sun Jul 31 01:01:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:01:52.717856 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cdcd6-debf-4f53-890b-bb8a67ea2eb5 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:52.718320 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cdcd6-debf-4f53-890b-bb8a67ea2eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:52.718821 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cdcd6-debf-4f53-890b-bb8a67ea2eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:52.738471 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-f67cdcd6-debf-4f53-890b-bb8a67ea2eb5 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:52.740107 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-f67cdcd6-debf-4f53-890b-bb8a67ea2eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:52.814431 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 17/32] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:01:52.815093 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:52.817467 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67cdcd6-debf-4f53-890b-bb8a67ea2eb5 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:52.889753 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8619a-aaf8-44bb-9e8d-311cd3bfdc77 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:52.927972 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cad8a38-c22d-4f38-bdbe-d43255925da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:52.929370 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad8a38-c22d-4f38-bdbe-d43255925da4 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:52.930081 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad8a38-c22d-4f38-bdbe-d43255925da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:52.930565 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad8a38-c22d-4f38-bdbe-d43255925da4 None admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:52.931550 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cad8a38-c22d-4f38-bdbe-d43255925da4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:52.932042 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cad8a38-c22d-4f38-bdbe-d43255925da4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:52.933868 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cad8a38-c22d-4f38-bdbe-d43255925da4 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:52.945300 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67cdcd6-debf-4f53-890b-bb8a67ea2eb5 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:52.949063 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 16/33] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:01:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:52.950079 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cad8a38-c22d-4f38-bdbe-d43255925da4 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:52.971174 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:52.990898 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a2384-5384-4c12-a3f4-b19282554872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:52.992896 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a2384-5384-4c12-a3f4-b19282554872 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:52.993429 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a2384-5384-4c12-a3f4-b19282554872 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:52.993916 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a2384-5384-4c12-a3f4-b19282554872 None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:52.994846 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95a2384-5384-4c12-a3f4-b19282554872 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:52.995351 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95a2384-5384-4c12-a3f4-b19282554872 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:52.997181 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95a2384-5384-4c12-a3f4-b19282554872 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:53.009019 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 18/34] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:01:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:53.010416 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a2384-5384-4c12-a3f4-b19282554872 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:53.080177 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cad8a38-c22d-4f38-bdbe-d43255925da4 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:53.090862 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:53.136683 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367fd7b-dcff-4fdb-b572-e665c1185286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:53.137346 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367fd7b-dcff-4fdb-b572-e665c1185286 None admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:53.137622 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367fd7b-dcff-4fdb-b572-e665c1185286 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:53.137898 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367fd7b-dcff-4fdb-b572-e665c1185286 None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:53.138649 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367fd7b-dcff-4fdb-b572-e665c1185286 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:53.140305 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367fd7b-dcff-4fdb-b572-e665c1185286 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:53.160271 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 17/35] 10.222.0.60 () {60 vars in 1131 bytes} [Sun Jul 31 01:01:52 2022] POST /identity/v3/roles => generated 225 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:01:53.161221 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367fd7b-dcff-4fdb-b572-e665c1185286 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:53.162683 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a2384-5384-4c12-a3f4-b19282554872 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:53.204966 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6c531-e256-43f0-8a8d-42f5ecdaad42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:53.206014 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6c531-e256-43f0-8a8d-42f5ecdaad42 None admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:53.206534 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6c531-e256-43f0-8a8d-42f5ecdaad42 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:53.207023 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6c531-e256-43f0-8a8d-42f5ecdaad42 None admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:53.208021 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6c531-e256-43f0-8a8d-42f5ecdaad42 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:53.209896 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6c531-e256-43f0-8a8d-42f5ecdaad42 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:53.260190 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:53.288377 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367fd7b-dcff-4fdb-b572-e665c1185286 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:53.324667 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae9a9e-3b18-4d2d-ba51-acad22313b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:53.325348 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae9a9e-3b18-4d2d-ba51-acad22313b89 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:53.325631 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae9a9e-3b18-4d2d-ba51-acad22313b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:53.325908 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae9a9e-3b18-4d2d-ba51-acad22313b89 None admin] PATH_INFO: `/v3/users/652828201b9e47a5b54a3c3110e80fd8` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:53.327190 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae9a9e-3b18-4d2d-ba51-acad22313b89 None admin] RBAC: Authorizing `identity:get_user(user_id=652828201b9e47a5b54a3c3110e80fd8)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:53.328809 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae9a9e-3b18-4d2d-ba51-acad22313b89 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:53.330741 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 18/36] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:01:53 2022] GET /identity/v3/users/652828201b9e47a5b54a3c3110e80fd8 => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:53.336094 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae9a9e-3b18-4d2d-ba51-acad22313b89 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:53.366968 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 19/37] 10.222.0.60 () {60 vars in 1141 bytes} [Sun Jul 31 01:01:53 2022] POST /identity/v3/projects => generated 301 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:01:53.466395 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae9a9e-3b18-4d2d-ba51-acad22313b89 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:53.472296 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9029b7-a430-4a7b-96f4-e4215e5e40b0 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:53.472635 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9029b7-a430-4a7b-96f4-e4215e5e40b0 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:53.472853 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9029b7-a430-4a7b-96f4-e4215e5e40b0 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:53.474533 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 20/38] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:01:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:01:53.480666 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb30cb-d660-4f25-9af2-65c211c71b60 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:53.480973 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb30cb-d660-4f25-9af2-65c211c71b60 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:53.481226 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb30cb-d660-4f25-9af2-65c211c71b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:53.505971 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-3edb30cb-d660-4f25-9af2-65c211c71b60 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:53.508066 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-3edb30cb-d660-4f25-9af2-65c211c71b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:53.510985 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422501de-7abe-46b5-ab3f-65a596b2b132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:53.512643 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422501de-7abe-46b5-ab3f-65a596b2b132 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:53.512923 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422501de-7abe-46b5-ab3f-65a596b2b132 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:53.513200 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422501de-7abe-46b5-ab3f-65a596b2b132 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:53.514589 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422501de-7abe-46b5-ab3f-65a596b2b132 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:53.516236 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422501de-7abe-46b5-ab3f-65a596b2b132 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:53.518765 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 19/39] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:01:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:01:53.520357 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b2ce2-f710-4a2c-8bc5-6061e24755e7 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:53.520670 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b2ce2-f710-4a2c-8bc5-6061e24755e7 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:53.522336 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b2ce2-f710-4a2c-8bc5-6061e24755e7 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:53.524081 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 20/40] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:01:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:01:53.529785 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483dad0-85ba-40d0-b800-ac9cb6fda830 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:53.530068 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483dad0-85ba-40d0-b800-ac9cb6fda830 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:53.530343 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483dad0-85ba-40d0-b800-ac9cb6fda830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:53.554480 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-d483dad0-85ba-40d0-b800-ac9cb6fda830 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:53.556672 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-d483dad0-85ba-40d0-b800-ac9cb6fda830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:53.560806 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:53.608557 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 21/41] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:01:53.609669 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb30cb-d660-4f25-9af2-65c211c71b60 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:53.642672 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 21/42] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:01:53.643616 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d483dad0-85ba-40d0-b800-ac9cb6fda830 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:53.667208 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:53.723600 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb30cb-d660-4f25-9af2-65c211c71b60 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:53.745655 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d483dad0-85ba-40d0-b800-ac9cb6fda830 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:53.759207 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379b63f-96d3-4c73-b31a-2529b46235da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:53.759926 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379b63f-96d3-4c73-b31a-2529b46235da None admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:53.760205 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379b63f-96d3-4c73-b31a-2529b46235da None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:53.760481 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379b63f-96d3-4c73-b31a-2529b46235da None admin] PATH_INFO: `/v3/domains/default/users/652828201b9e47a5b54a3c3110e80fd8/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:53.762582 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9379b63f-96d3-4c73-b31a-2529b46235da None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=652828201b9e47a5b54a3c3110e80fd8, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:53.764226 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9379b63f-96d3-4c73-b31a-2529b46235da None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:53.778415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 22/43] 10.222.0.60 () {58 vars in 1361 bytes} [Sun Jul 31 01:01:53 2022] PUT /identity/v3/domains/default/users/652828201b9e47a5b54a3c3110e80fd8/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:01:53.779395 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379b63f-96d3-4c73-b31a-2529b46235da None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:53.782987 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7a0f2-056e-4a6a-a2a5-57e1b5f10ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:53.783694 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7a0f2-056e-4a6a-a2a5-57e1b5f10ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:53.783950 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7a0f2-056e-4a6a-a2a5-57e1b5f10ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:53.784222 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7a0f2-056e-4a6a-a2a5-57e1b5f10ce4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:53.785487 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d7a0f2-056e-4a6a-a2a5-57e1b5f10ce4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:53.786965 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d7a0f2-056e-4a6a-a2a5-57e1b5f10ce4 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:53.788707 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 22/44] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:01:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:53.795020 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7a0f2-056e-4a6a-a2a5-57e1b5f10ce4 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:53.807694 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:53.903549 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379b63f-96d3-4c73-b31a-2529b46235da None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:53.905137 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7a0f2-056e-4a6a-a2a5-57e1b5f10ce4 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:53.905591 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:53.946802 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb6161-d6b0-41f0-b2ae-5ea7b84cf9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:53.947597 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb6161-d6b0-41f0-b2ae-5ea7b84cf9d7 None admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:53.947887 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb6161-d6b0-41f0-b2ae-5ea7b84cf9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:53.948169 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb6161-d6b0-41f0-b2ae-5ea7b84cf9d7 None admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:53.948850 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb6161-d6b0-41f0-b2ae-5ea7b84cf9d7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:53.949674 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278b63f-a13a-42b3-b3b6-fecfb2679009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:53.950304 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278b63f-a13a-42b3-b3b6-fecfb2679009 None admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:53.950397 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb6161-d6b0-41f0-b2ae-5ea7b84cf9d7 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:53.950582 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278b63f-a13a-42b3-b3b6-fecfb2679009 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:53.950909 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278b63f-a13a-42b3-b3b6-fecfb2679009 None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:53.951661 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278b63f-a13a-42b3-b3b6-fecfb2679009 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:53.953084 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278b63f-a13a-42b3-b3b6-fecfb2679009 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:53.970751 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 23/45] 10.222.0.60 () {60 vars in 1131 bytes} [Sun Jul 31 01:01:53 2022] POST /identity/v3/roles => generated 223 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:01:53.987624 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 23/46] 10.222.0.60 () {60 vars in 1141 bytes} [Sun Jul 31 01:01:53 2022] POST /identity/v3/projects => generated 312 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:01:55.741304 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625654c9-1355-4ae8-906c-ca115239afa1 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:55.741854 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625654c9-1355-4ae8-906c-ca115239afa1 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:55.741854 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625654c9-1355-4ae8-906c-ca115239afa1 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:55.743324 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 24/47] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:01:55.748948 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608c15f-ad7d-4d8f-9ec0-12d390ec267a None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:55.749404 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608c15f-ad7d-4d8f-9ec0-12d390ec267a None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:55.749493 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608c15f-ad7d-4d8f-9ec0-12d390ec267a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:55.768559 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-2608c15f-ad7d-4d8f-9ec0-12d390ec267a None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:55.769769 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-2608c15f-ad7d-4d8f-9ec0-12d390ec267a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:55.825287 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:55.845353 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 24/48] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:01:55.871412 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625654c9-1355-4ae8-906c-ca115239afa1 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:55.969618 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a68c89-016c-44aa-bc79-0c72e1f8554e None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:55.969927 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a68c89-016c-44aa-bc79-0c72e1f8554e None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:55.970203 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a68c89-016c-44aa-bc79-0c72e1f8554e None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:55.971590 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 25/49] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:01:55.976592 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93134b04-1372-4a56-ab63-a7f2c3a9772e None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:55.976875 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93134b04-1372-4a56-ab63-a7f2c3a9772e None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:55.977147 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93134b04-1372-4a56-ab63-a7f2c3a9772e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:55.979995 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625654c9-1355-4ae8-906c-ca115239afa1 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:55.995106 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-93134b04-1372-4a56-ab63-a7f2c3a9772e None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:55.996255 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-93134b04-1372-4a56-ab63-a7f2c3a9772e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:56.018370 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a942f-f7e0-4d96-882f-e6a52ca01382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:56.019314 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a942f-f7e0-4d96-882f-e6a52ca01382 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:56.019633 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a942f-f7e0-4d96-882f-e6a52ca01382 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:56.020026 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a942f-f7e0-4d96-882f-e6a52ca01382 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:56.032927 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a942f-f7e0-4d96-882f-e6a52ca01382 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:01:56.037934 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-da2a942f-f7e0-4d96-882f-e6a52ca01382 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:01:56.037934 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:01:56.037934 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:01:56.037934 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:01:56.037934 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:01:56.037934 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:01:56.037934 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:01:56.037934 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:01:56.037934 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:01:56.037934 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:01:56.037934 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:01:56.037934 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:01:56.037934 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:01:56.037934 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:01:56.037934 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:01:56.037934 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:01:56.038847 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:01:56.038847 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:01:56.038847 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:01:56.038847 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:01:56.038847 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:01:56.038847 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:01:56.038847 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:01:56.038847 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:01:56.038847 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:01:56.038847 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:01:56.038847 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:01:56.038847 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:01:56.038847 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:01:56.038847 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:01:56.038847 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:01:56.038847 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:01:56.039645 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:01:56.039645 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:01:56.039645 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:01:56.039645 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:01:56.039645 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:01:56.039645 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:01:56.039645 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:01:56.039645 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:01:56.039645 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:01:56.039645 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:01:56.039645 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:01:56.039645 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:01:56.039645 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 25/50] 10.222.0.60 () {56 vars in 1096 bytes} [Sun Jul 31 01:01:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:01:56.045113 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a942f-f7e0-4d96-882f-e6a52ca01382 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:56.069553 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:56.072803 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 26/51] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:01:56.095587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93134b04-1372-4a56-ab63-a7f2c3a9772e None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:56.147907 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a942f-f7e0-4d96-882f-e6a52ca01382 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:56.181761 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516131e7-9d54-43cc-8839-59a04740fcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:56.182399 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516131e7-9d54-43cc-8839-59a04740fcc1 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:56.182684 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516131e7-9d54-43cc-8839-59a04740fcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:56.182959 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516131e7-9d54-43cc-8839-59a04740fcc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:56.183719 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516131e7-9d54-43cc-8839-59a04740fcc1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:56.184028 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516131e7-9d54-43cc-8839-59a04740fcc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:56.185442 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516131e7-9d54-43cc-8839-59a04740fcc1 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:56.194025 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 26/52] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:01:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:01:56.194287 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93134b04-1372-4a56-ab63-a7f2c3a9772e None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:56.199606 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516131e7-9d54-43cc-8839-59a04740fcc1 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:56.214451 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:56.228800 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b80af2-84f8-42c8-bc02-943cf55e0d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:56.229446 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b80af2-84f8-42c8-bc02-943cf55e0d8c None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:56.229727 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b80af2-84f8-42c8-bc02-943cf55e0d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:56.229997 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b80af2-84f8-42c8-bc02-943cf55e0d8c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:56.231148 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b80af2-84f8-42c8-bc02-943cf55e0d8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:56.232638 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b80af2-84f8-42c8-bc02-943cf55e0d8c None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:56.234292 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 27/53] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:01:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:56.240013 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b80af2-84f8-42c8-bc02-943cf55e0d8c None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:56.282657 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:56.298523 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516131e7-9d54-43cc-8839-59a04740fcc1 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:56.331562 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560fe6a-d377-42af-87f1-4d6155311322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:56.332226 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560fe6a-d377-42af-87f1-4d6155311322 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:56.332506 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560fe6a-d377-42af-87f1-4d6155311322 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:56.332773 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560fe6a-d377-42af-87f1-4d6155311322 None admin] PATH_INFO: `/v3/users/652828201b9e47a5b54a3c3110e80fd8` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:56.333960 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560fe6a-d377-42af-87f1-4d6155311322 None admin] RBAC: Authorizing `identity:get_user(user_id=652828201b9e47a5b54a3c3110e80fd8)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:56.335117 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b80af2-84f8-42c8-bc02-943cf55e0d8c None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:56.335403 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560fe6a-d377-42af-87f1-4d6155311322 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:56.337025 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 27/54] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:01:56 2022] GET /identity/v3/users/652828201b9e47a5b54a3c3110e80fd8 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:56.342383 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560fe6a-d377-42af-87f1-4d6155311322 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:56.369413 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736e166-239f-4bec-b063-44937807414d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:56.370042 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736e166-239f-4bec-b063-44937807414d None admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:56.370327 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736e166-239f-4bec-b063-44937807414d None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:56.370601 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736e166-239f-4bec-b063-44937807414d None admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:56.371278 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7736e166-239f-4bec-b063-44937807414d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:56.372774 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7736e166-239f-4bec-b063-44937807414d None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:56.415515 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 28/55] 10.222.0.60 () {60 vars in 1140 bytes} [Sun Jul 31 01:01:56 2022] POST /identity/v3/projects => generated 298 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:01:56.451184 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560fe6a-d377-42af-87f1-4d6155311322 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:56.489428 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70360d1-b164-4192-bb4d-5875554f3800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:56.490123 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70360d1-b164-4192-bb4d-5875554f3800 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:56.490353 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70360d1-b164-4192-bb4d-5875554f3800 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:56.490663 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70360d1-b164-4192-bb4d-5875554f3800 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:56.491933 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70360d1-b164-4192-bb4d-5875554f3800 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:56.493446 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70360d1-b164-4192-bb4d-5875554f3800 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:56.495086 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 28/56] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:01:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:01:56.501219 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736e166-239f-4bec-b063-44937807414d None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:56.546376 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:56.607583 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736e166-239f-4bec-b063-44937807414d None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:56.640579 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e29763-f125-4070-b086-b6229c5f6fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:56.641293 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e29763-f125-4070-b086-b6229c5f6fde None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:56.641582 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e29763-f125-4070-b086-b6229c5f6fde None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:56.641849 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e29763-f125-4070-b086-b6229c5f6fde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:56.642640 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e29763-f125-4070-b086-b6229c5f6fde None admin] RBAC: Adding query filter params (role.id=fef526a7d2e741ce995d107f3ac934ae, scope.domain.id=default, user.id=652828201b9e47a5b54a3c3110e80fd8) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:01:56.642949 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e29763-f125-4070-b086-b6229c5f6fde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:56.644432 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e29763-f125-4070-b086-b6229c5f6fde None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:56.651760 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 29/57] 10.222.0.60 () {56 vars in 1322 bytes} [Sun Jul 31 01:01:56 2022] GET /identity/v3/role_assignments?user.id=652828201b9e47a5b54a3c3110e80fd8&scope.domain.id=default&role.id=fef526a7d2e741ce995d107f3ac934ae => generated 530 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:58.363946 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e07121-b280-4777-95fa-25b36352f401 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:58.364527 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e07121-b280-4777-95fa-25b36352f401 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:58.364527 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e07121-b280-4777-95fa-25b36352f401 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:58.366464 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 29/58] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:01:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:01:58.375137 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9977b5-192b-4813-a9e8-3e462398f38f None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:58.375552 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9977b5-192b-4813-a9e8-3e462398f38f None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:58.375727 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9977b5-192b-4813-a9e8-3e462398f38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:58.396444 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-ff9977b5-192b-4813-a9e8-3e462398f38f None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:01:58.397640 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-ff9977b5-192b-4813-a9e8-3e462398f38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:01:58.467319 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 30/59] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:01:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:01:58.491411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e07121-b280-4777-95fa-25b36352f401 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:58.520301 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:58.607892 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e07121-b280-4777-95fa-25b36352f401 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:58.643405 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae382be-65dc-4c65-a790-a15ba79d8042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:58.644138 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae382be-65dc-4c65-a790-a15ba79d8042 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:58.644420 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae382be-65dc-4c65-a790-a15ba79d8042 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:58.644695 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae382be-65dc-4c65-a790-a15ba79d8042 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:58.645975 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae382be-65dc-4c65-a790-a15ba79d8042 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:58.647438 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae382be-65dc-4c65-a790-a15ba79d8042 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:58.649061 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 30/60] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:01:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:01:58.655784 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9977b5-192b-4813-a9e8-3e462398f38f None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:01:58.694621 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:01:58.764885 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9977b5-192b-4813-a9e8-3e462398f38f None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:01:58.808565 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c219ba3-f5c9-4369-9e2c-3ff59e0615d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:01:58.809184 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c219ba3-f5c9-4369-9e2c-3ff59e0615d4 None admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:01:58.809465 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c219ba3-f5c9-4369-9e2c-3ff59e0615d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:01:58.809742 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c219ba3-f5c9-4369-9e2c-3ff59e0615d4 None admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:01:58.810548 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c219ba3-f5c9-4369-9e2c-3ff59e0615d4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:01:58.812033 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c219ba3-f5c9-4369-9e2c-3ff59e0615d4 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:01:58.852664 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 31/61] 10.222.0.60 () {60 vars in 1132 bytes} [Sun Jul 31 01:01:58 2022] POST /identity/v3/users => generated 275 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:02:01.944900 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3aa0de-1bcb-4b6b-8d36-8ee60f27303d None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:01.945450 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3aa0de-1bcb-4b6b-8d36-8ee60f27303d None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:01.945450 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3aa0de-1bcb-4b6b-8d36-8ee60f27303d None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:01.946949 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 31/62] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:01.955406 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae3816-b827-4af7-9370-433f71c2aa51 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:01.955406 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae3816-b827-4af7-9370-433f71c2aa51 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:01.955406 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae3816-b827-4af7-9370-433f71c2aa51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:01.976510 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-f7ae3816-b827-4af7-9370-433f71c2aa51 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:01.978067 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-f7ae3816-b827-4af7-9370-433f71c2aa51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:02.061181 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 32/63] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:02:02.094062 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3aa0de-1bcb-4b6b-8d36-8ee60f27303d None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:02.109236 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901efa8-0b74-4eaf-bc21-56625f160f54 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:02.109827 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901efa8-0b74-4eaf-bc21-56625f160f54 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:02.110350 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901efa8-0b74-4eaf-bc21-56625f160f54 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:02.111973 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 33/64] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:02:02.133229 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f6e22-f594-4257-9cc4-2e92d73f623f None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:02.133803 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f6e22-f594-4257-9cc4-2e92d73f623f None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:02.134281 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f6e22-f594-4257-9cc4-2e92d73f623f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:02.163948 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-a09f6e22-f594-4257-9cc4-2e92d73f623f None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:02.165518 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-a09f6e22-f594-4257-9cc4-2e92d73f623f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:02.191875 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:02.253928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:02.276620 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3aa0de-1bcb-4b6b-8d36-8ee60f27303d None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:02.277868 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 34/65] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:02:02.279568 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fdf2c-36a6-4c30-8d92-0836c780d5f1 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:02.280048 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fdf2c-36a6-4c30-8d92-0836c780d5f1 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:02.280512 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fdf2c-36a6-4c30-8d92-0836c780d5f1 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:02.282296 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 35/66] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:02.287123 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a837e-5dbe-42ae-8c4c-b4dac8e2f3de None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:02.287684 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a837e-5dbe-42ae-8c4c-b4dac8e2f3de None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:02.288152 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a837e-5dbe-42ae-8c4c-b4dac8e2f3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:02.309663 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-dc9a837e-5dbe-42ae-8c4c-b4dac8e2f3de None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:02.311625 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-dc9a837e-5dbe-42ae-8c4c-b4dac8e2f3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:02.333002 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef451be-781d-4195-a8a8-7488fffcbda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:02.333652 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef451be-781d-4195-a8a8-7488fffcbda7 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:02.333931 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef451be-781d-4195-a8a8-7488fffcbda7 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:02.334209 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef451be-781d-4195-a8a8-7488fffcbda7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:02.345729 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef451be-781d-4195-a8a8-7488fffcbda7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:02.350784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-3ef451be-781d-4195-a8a8-7488fffcbda7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:02:02.350784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:02.350784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:02.350784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:02.350784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:02.350784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:02.350784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:02.350784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:02.350784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:02.350784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:02.350784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:02.350784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:02.350784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:02.350784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:02.350784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:02.350784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:02.351648 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:02.351648 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:02.351648 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:02.351648 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:02.351648 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:02.351648 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:02.351648 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:02.351648 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:02.351648 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:02.351648 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:02.351648 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:02.351648 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:02.351648 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:02.351648 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:02.351648 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:02.351648 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:02.352499 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:02.352499 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:02.352499 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:02.352499 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:02.352499 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:02.352499 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:02.352499 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:02.352499 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:02.352499 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:02.352499 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:02.352499 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:02:02.352499 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:02:02.352499 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 32/67] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:02:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:02.353673 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef451be-781d-4195-a8a8-7488fffcbda7 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:02.389683 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 36/68] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:02:02.390919 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a837e-5dbe-42ae-8c4c-b4dac8e2f3de None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:02.456973 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef451be-781d-4195-a8a8-7488fffcbda7 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:02.491593 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d21a8-c167-417d-90ee-81852979f00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:02.492253 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d21a8-c167-417d-90ee-81852979f00f None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:02.492530 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d21a8-c167-417d-90ee-81852979f00f None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:02.492801 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d21a8-c167-417d-90ee-81852979f00f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:02.504420 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2d21a8-c167-417d-90ee-81852979f00f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:02.509823 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-0a2d21a8-c167-417d-90ee-81852979f00f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:02:02.509823 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:02.509823 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:02.509823 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:02.509823 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:02.509823 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:02.509823 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:02.509823 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:02.509823 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:02.509823 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:02.509823 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:02.509823 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:02.509823 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:02.509823 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:02.509823 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:02.509823 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:02.510664 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:02.510664 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:02.510664 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:02.510664 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:02.510664 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:02.510664 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:02.510664 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:02.510664 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:02.510664 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:02.510664 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:02.510664 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:02.510664 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:02.510664 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:02.510664 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:02.510664 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:02.510664 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:02.511411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:02.511411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:02.511411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:02.511411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:02.511411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:02.511411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:02.511411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:02.511411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:02.511411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:02.511411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:02.511411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:02:02.511411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:02:02.515619 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 33/69] 10.222.0.60 () {56 vars in 1096 bytes} [Sun Jul 31 01:02:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:02.515872 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:02.516478 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d21a8-c167-417d-90ee-81852979f00f None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:02.528263 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:02.528978 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a837e-5dbe-42ae-8c4c-b4dac8e2f3de None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:02.565834 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a0748-3200-4001-a38a-e7e98a76279b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:02.566845 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a0748-3200-4001-a38a-e7e98a76279b None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:02.567320 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a0748-3200-4001-a38a-e7e98a76279b None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:02.567822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a0748-3200-4001-a38a-e7e98a76279b None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:02.568923 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a0748-3200-4001-a38a-e7e98a76279b None admin] RBAC: Adding query filter params (name=member) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:02.569417 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a0748-3200-4001-a38a-e7e98a76279b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:02.571021 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a0748-3200-4001-a38a-e7e98a76279b None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:02.584188 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 37/70] 10.222.0.60 () {56 vars in 1101 bytes} [Sun Jul 31 01:02:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:02.585366 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a0748-3200-4001-a38a-e7e98a76279b None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:02.619928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d21a8-c167-417d-90ee-81852979f00f None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:02.656422 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba21d3b-b505-4868-a7e9-4b3af5761d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:02.657440 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba21d3b-b505-4868-a7e9-4b3af5761d36 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:02.657440 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba21d3b-b505-4868-a7e9-4b3af5761d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:02.657601 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba21d3b-b505-4868-a7e9-4b3af5761d36 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:02.669727 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba21d3b-b505-4868-a7e9-4b3af5761d36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:02.675099 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-4ba21d3b-b505-4868-a7e9-4b3af5761d36 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:02:02.675099 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:02.675099 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:02.675099 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:02.675099 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:02.675099 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:02.675099 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:02.675099 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:02.675099 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:02.675099 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:02.675099 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:02.675099 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:02.675099 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:02.675099 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:02.675099 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:02.675099 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:02.676336 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:02.676336 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:02.676336 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:02.676336 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:02.676336 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:02.676336 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:02.676336 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:02.676336 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:02.676336 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:02.676336 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:02.676336 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:02.676336 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:02.676336 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:02.676336 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:02.676336 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:02.676336 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:02.677094 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:02.677094 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:02.677094 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:02.677094 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:02.677094 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:02.677094 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:02.677094 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:02.677094 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:02.677094 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:02.677094 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:02.677094 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:02:02.677094 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:02:02.677094 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 34/71] 10.222.0.60 () {56 vars in 1114 bytes} [Sun Jul 31 01:02:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:02.677735 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba21d3b-b505-4868-a7e9-4b3af5761d36 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:02.698392 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a0748-3200-4001-a38a-e7e98a76279b None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:02.735631 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9da3c9-1dc1-4938-8420-c5dc7c82db13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:02.736254 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9da3c9-1dc1-4938-8420-c5dc7c82db13 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:02.736531 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9da3c9-1dc1-4938-8420-c5dc7c82db13 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:02.736801 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9da3c9-1dc1-4938-8420-c5dc7c82db13 None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:02.737521 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9da3c9-1dc1-4938-8420-c5dc7c82db13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:02.737819 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9da3c9-1dc1-4938-8420-c5dc7c82db13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:02.739217 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9da3c9-1dc1-4938-8420-c5dc7c82db13 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:02.747406 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 38/72] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:02:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:02.748608 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d27a6-6e58-4ac4-bc1b-ba69f455f4f5 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:02.748888 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d27a6-6e58-4ac4-bc1b-ba69f455f4f5 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:02.749165 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d27a6-6e58-4ac4-bc1b-ba69f455f4f5 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:02.750665 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 39/73] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:02.751163 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d27a6-6e58-4ac4-bc1b-ba69f455f4f5 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:02.753423 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:02.759574 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:02.793370 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba21d3b-b505-4868-a7e9-4b3af5761d36 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:02.827506 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd69a2-eaef-43c8-94f6-4919765216a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:02.828208 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd69a2-eaef-43c8-94f6-4919765216a1 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:02.828488 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd69a2-eaef-43c8-94f6-4919765216a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:02.828759 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd69a2-eaef-43c8-94f6-4919765216a1 None admin] PATH_INFO: `/v3/users/dbf5aa0cc934479191a679aa5d44ed32` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:02.844740 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cd69a2-eaef-43c8-94f6-4919765216a1 None admin] RBAC: Authorizing `identity:get_user(user_id=dbf5aa0cc934479191a679aa5d44ed32)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:02.846260 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cd69a2-eaef-43c8-94f6-4919765216a1 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:02.848163 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 35/74] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:02:02 2022] GET /identity/v3/users/dbf5aa0cc934479191a679aa5d44ed32 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:02.848784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd69a2-eaef-43c8-94f6-4919765216a1 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:02.861079 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d27a6-6e58-4ac4-bc1b-ba69f455f4f5 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:02.894500 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4fc75c-0e0d-4a03-a4b2-4da474aaa4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:02.895125 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4fc75c-0e0d-4a03-a4b2-4da474aaa4d7 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:02.895406 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4fc75c-0e0d-4a03-a4b2-4da474aaa4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:02.895718 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4fc75c-0e0d-4a03-a4b2-4da474aaa4d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:02.896697 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4fc75c-0e0d-4a03-a4b2-4da474aaa4d7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:02.896997 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4fc75c-0e0d-4a03-a4b2-4da474aaa4d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:02.898389 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4fc75c-0e0d-4a03-a4b2-4da474aaa4d7 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:02.906705 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 40/75] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:02:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:02.909065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36b34a-a421-4c83-a646-ee24ea2bb1e7 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:02.909352 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36b34a-a421-4c83-a646-ee24ea2bb1e7 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:02.909621 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36b34a-a421-4c83-a646-ee24ea2bb1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:02.926437 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-8b36b34a-a421-4c83-a646-ee24ea2bb1e7 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:02.927646 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-8b36b34a-a421-4c83-a646-ee24ea2bb1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:02.947764 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd69a2-eaef-43c8-94f6-4919765216a1 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:02.978363 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:02.986265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:02.987762 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9abed-03de-4acf-a3ef-5330283320f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:02.988444 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9abed-03de-4acf-a3ef-5330283320f0 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:02.988709 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9abed-03de-4acf-a3ef-5330283320f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:02.988982 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9abed-03de-4acf-a3ef-5330283320f0 None admin] PATH_INFO: `/v3/users/652828201b9e47a5b54a3c3110e80fd8` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:02.990250 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c9abed-03de-4acf-a3ef-5330283320f0 None admin] RBAC: Authorizing `identity:get_user(user_id=652828201b9e47a5b54a3c3110e80fd8)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:02.991773 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c9abed-03de-4acf-a3ef-5330283320f0 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:02.997886 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 36/76] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:02:02 2022] GET /identity/v3/users/652828201b9e47a5b54a3c3110e80fd8 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:02.998040 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 41/77] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:02:02.998118 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf486a3-820a-4f01-9db5-9a3bc2acf0cd None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:02.998118 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf486a3-820a-4f01-9db5-9a3bc2acf0cd None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:02.998118 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf486a3-820a-4f01-9db5-9a3bc2acf0cd None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:02.998284 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36b34a-a421-4c83-a646-ee24ea2bb1e7 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:02.998355 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 37/78] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:02.998355 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf486a3-820a-4f01-9db5-9a3bc2acf0cd None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:03.097468 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36b34a-a421-4c83-a646-ee24ea2bb1e7 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:03.103882 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf486a3-820a-4f01-9db5-9a3bc2acf0cd None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:03.130860 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef6e24c-638c-4ab8-9096-ef614751f3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:03.131826 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6e24c-638c-4ab8-9096-ef614751f3cd None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:03.132097 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6e24c-638c-4ab8-9096-ef614751f3cd None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:03.132371 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6e24c-638c-4ab8-9096-ef614751f3cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:03.138690 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545ccaa-e221-4236-83c8-a541c6b0b624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:03.139322 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545ccaa-e221-4236-83c8-a541c6b0b624 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:03.139628 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545ccaa-e221-4236-83c8-a541c6b0b624 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:03.139902 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545ccaa-e221-4236-83c8-a541c6b0b624 None admin] PATH_INFO: `/v3/users/dbf5aa0cc934479191a679aa5d44ed32` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:03.141114 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c545ccaa-e221-4236-83c8-a541c6b0b624 None admin] RBAC: Authorizing `identity:get_user(user_id=dbf5aa0cc934479191a679aa5d44ed32)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:03.142591 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c545ccaa-e221-4236-83c8-a541c6b0b624 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:03.144199 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 38/79] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:02:02 2022] GET /identity/v3/users/dbf5aa0cc934479191a679aa5d44ed32 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:03.145019 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545ccaa-e221-4236-83c8-a541c6b0b624 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:03.198688 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:03.206121 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef6e24c-638c-4ab8-9096-ef614751f3cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:03.206259 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:03.207719 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef6e24c-638c-4ab8-9096-ef614751f3cd None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:03.245433 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545ccaa-e221-4236-83c8-a541c6b0b624 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:03.278339 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af727dd-78e8-43fc-9adc-277af881aa49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:03.278955 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af727dd-78e8-43fc-9adc-277af881aa49 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:03.279232 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af727dd-78e8-43fc-9adc-277af881aa49 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:03.279518 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af727dd-78e8-43fc-9adc-277af881aa49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:03.304296 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 42/80] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:02:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:02:03.305558 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc949a0-f7bd-43b7-a52c-412fe6c5cedf None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:03.305819 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc949a0-f7bd-43b7-a52c-412fe6c5cedf None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:03.306094 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc949a0-f7bd-43b7-a52c-412fe6c5cedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:03.323145 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-5fc949a0-f7bd-43b7-a52c-412fe6c5cedf None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:03.324378 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-5fc949a0-f7bd-43b7-a52c-412fe6c5cedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:03.357409 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af727dd-78e8-43fc-9adc-277af881aa49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:03.358820 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af727dd-78e8-43fc-9adc-277af881aa49 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:03.411125 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 43/81] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:02:03.412096 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc949a0-f7bd-43b7-a52c-412fe6c5cedf None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:03.439780 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:03.452969 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:03.480796 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 39/82] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:02:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:02:03.481892 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af727dd-78e8-43fc-9adc-277af881aa49 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:03.530903 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc949a0-f7bd-43b7-a52c-412fe6c5cedf None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:03.567097 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f7387f-2531-4c0a-944e-fc01a1d488bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:03.567785 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7387f-2531-4c0a-944e-fc01a1d488bd None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:03.568067 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7387f-2531-4c0a-944e-fc01a1d488bd None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:03.568339 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7387f-2531-4c0a-944e-fc01a1d488bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:03.580159 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f7387f-2531-4c0a-944e-fc01a1d488bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:03.581944 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af727dd-78e8-43fc-9adc-277af881aa49 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:03.587068 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-07f7387f-2531-4c0a-944e-fc01a1d488bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:02:03.587068 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:03.587068 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:03.587068 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:03.587068 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:03.587068 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:03.587068 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:03.587068 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:03.587068 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:03.587068 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:03.587068 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:03.587068 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:03.587068 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:03.587068 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:03.587068 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:03.587068 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:03.587940 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:03.587940 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:03.587940 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:03.587940 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:03.587940 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:03.587940 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:03.587940 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:03.587940 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:03.587940 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:03.587940 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:03.587940 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:03.587940 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:03.587940 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:03.587940 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:03.587940 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:03.587940 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:03.588705 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:03.588705 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:03.588705 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:03.588705 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:03.588705 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:03.588705 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:03.588705 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:03.588705 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:03.588705 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:03.588705 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:03.588705 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:02:03.588705 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:02:03.588705 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 44/83] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:02:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:03.589330 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f7387f-2531-4c0a-944e-fc01a1d488bd None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:03.621541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f631c-fdd8-4762-bed2-300bbd7bb5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:03.622185 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f631c-fdd8-4762-bed2-300bbd7bb5b6 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:03.622466 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f631c-fdd8-4762-bed2-300bbd7bb5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:03.622740 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f631c-fdd8-4762-bed2-300bbd7bb5b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:03.652864 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:03.674126 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:03.689303 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f7387f-2531-4c0a-944e-fc01a1d488bd None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:03.692915 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f631c-fdd8-4762-bed2-300bbd7bb5b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:03.694426 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f631c-fdd8-4762-bed2-300bbd7bb5b6 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:03.728388 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec31286-e3f1-478d-86d1-b7a208bce32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:03.729041 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec31286-e3f1-478d-86d1-b7a208bce32f None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:03.729321 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec31286-e3f1-478d-86d1-b7a208bce32f None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:03.729599 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec31286-e3f1-478d-86d1-b7a208bce32f None admin] PATH_INFO: `/v3/projects/882624ffe602494b95664e06c16d55a2` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:03.730814 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec31286-e3f1-478d-86d1-b7a208bce32f None admin] RBAC: Authorizing `identity:get_project(project_id=882624ffe602494b95664e06c16d55a2)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:03.732357 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec31286-e3f1-478d-86d1-b7a208bce32f None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:03.734055 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 45/84] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:02:03 2022] GET /identity/v3/projects/882624ffe602494b95664e06c16d55a2 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:03.739211 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec31286-e3f1-478d-86d1-b7a208bce32f None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:03.799196 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 40/85] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:02:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:02:03.803895 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f631c-fdd8-4762-bed2-300bbd7bb5b6 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:03.838137 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec31286-e3f1-478d-86d1-b7a208bce32f None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:03.870618 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:03.874953 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae77cc-25bf-42df-bc54-aecc2c7f6182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:03.875580 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae77cc-25bf-42df-bc54-aecc2c7f6182 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:03.875755 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae77cc-25bf-42df-bc54-aecc2c7f6182 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:03.876026 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae77cc-25bf-42df-bc54-aecc2c7f6182 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:03.878049 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae77cc-25bf-42df-bc54-aecc2c7f6182 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:03.879531 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae77cc-25bf-42df-bc54-aecc2c7f6182 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:03.881181 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 46/86] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:02:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:03.881885 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae77cc-25bf-42df-bc54-aecc2c7f6182 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:03.908015 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:03.911612 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f631c-fdd8-4762-bed2-300bbd7bb5b6 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:03.946776 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ae370-ee96-4bf3-94b8-4ddd22330550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:03.947420 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ae370-ee96-4bf3-94b8-4ddd22330550 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:03.947749 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ae370-ee96-4bf3-94b8-4ddd22330550 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:03.948021 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ae370-ee96-4bf3-94b8-4ddd22330550 None admin] PATH_INFO: `/v3/projects/882624ffe602494b95664e06c16d55a2` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:03.949298 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ae370-ee96-4bf3-94b8-4ddd22330550 None admin] RBAC: Authorizing `identity:get_project(project_id=882624ffe602494b95664e06c16d55a2)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:03.950756 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ae370-ee96-4bf3-94b8-4ddd22330550 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:03.952465 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 41/87] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:02:03 2022] GET /identity/v3/projects/882624ffe602494b95664e06c16d55a2 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:03.953315 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ae370-ee96-4bf3-94b8-4ddd22330550 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:03.988017 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae77cc-25bf-42df-bc54-aecc2c7f6182 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:04.023733 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5dc4a4-ac21-43ea-9df1-be0434a98f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:04.024372 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5dc4a4-ac21-43ea-9df1-be0434a98f72 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:04.024652 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5dc4a4-ac21-43ea-9df1-be0434a98f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:04.024927 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5dc4a4-ac21-43ea-9df1-be0434a98f72 None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:04.025656 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5dc4a4-ac21-43ea-9df1-be0434a98f72 None admin] RBAC: Adding query filter params (name=member) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:04.025961 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5dc4a4-ac21-43ea-9df1-be0434a98f72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:04.027388 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5dc4a4-ac21-43ea-9df1-be0434a98f72 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:04.035526 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 47/88] 10.222.0.60 () {56 vars in 1101 bytes} [Sun Jul 31 01:02:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:04.041007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5dc4a4-ac21-43ea-9df1-be0434a98f72 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:04.053407 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ae370-ee96-4bf3-94b8-4ddd22330550 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:04.082585 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:04.089504 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec1642-390c-4a76-bddf-31ce7125987c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:04.090126 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec1642-390c-4a76-bddf-31ce7125987c None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:04.090401 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec1642-390c-4a76-bddf-31ce7125987c None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:04.090676 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec1642-390c-4a76-bddf-31ce7125987c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:04.091470 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cec1642-390c-4a76-bddf-31ce7125987c None admin] RBAC: Adding query filter params (role.id=12a8e2ae2b6b4d699aac9ba2319cf57d, scope.project.id=882624ffe602494b95664e06c16d55a2, user.id=dbf5aa0cc934479191a679aa5d44ed32) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:04.091802 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cec1642-390c-4a76-bddf-31ce7125987c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:04.093240 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cec1642-390c-4a76-bddf-31ce7125987c None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:04.098601 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 42/89] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:02:03 2022] GET /identity/v3/role_assignments?user.id=dbf5aa0cc934479191a679aa5d44ed32&scope.project.id=882624ffe602494b95664e06c16d55a2&role.id=12a8e2ae2b6b4d699aac9ba2319cf57d => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:04.099354 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec1642-390c-4a76-bddf-31ce7125987c None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:04.132775 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:04.150786 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5dc4a4-ac21-43ea-9df1-be0434a98f72 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:04.190392 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73337d3-1287-4ed8-a1cf-9403bafc0086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:04.191060 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73337d3-1287-4ed8-a1cf-9403bafc0086 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:04.191342 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73337d3-1287-4ed8-a1cf-9403bafc0086 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:04.191654 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73337d3-1287-4ed8-a1cf-9403bafc0086 None admin] PATH_INFO: `/v3/projects/882624ffe602494b95664e06c16d55a2` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:04.192935 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73337d3-1287-4ed8-a1cf-9403bafc0086 None admin] RBAC: Authorizing `identity:get_project(project_id=882624ffe602494b95664e06c16d55a2)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:04.194426 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73337d3-1287-4ed8-a1cf-9403bafc0086 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:04.201311 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 48/90] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:02:04 2022] GET /identity/v3/projects/882624ffe602494b95664e06c16d55a2 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:04.201311 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73337d3-1287-4ed8-a1cf-9403bafc0086 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:04.229633 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec1642-390c-4a76-bddf-31ce7125987c None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:04.272758 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef16c0-d496-4422-9743-0c0d3a44f3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:04.273403 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef16c0-d496-4422-9743-0c0d3a44f3ee None admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:04.273675 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef16c0-d496-4422-9743-0c0d3a44f3ee None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:04.273949 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef16c0-d496-4422-9743-0c0d3a44f3ee None admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:04.274656 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef16c0-d496-4422-9743-0c0d3a44f3ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:04.276298 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef16c0-d496-4422-9743-0c0d3a44f3ee None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:04.308227 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 43/91] 10.222.0.60 () {60 vars in 1132 bytes} [Sun Jul 31 01:02:04 2022] POST /identity/v3/users => generated 289 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:02:04.309081 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef16c0-d496-4422-9743-0c0d3a44f3ee None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:04.336892 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73337d3-1287-4ed8-a1cf-9403bafc0086 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:04.379217 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:04.400935 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb0bed-2d5c-4d6a-8cf6-69e067a8495a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:04.401651 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb0bed-2d5c-4d6a-8cf6-69e067a8495a None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:04.402075 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb0bed-2d5c-4d6a-8cf6-69e067a8495a None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:04.402515 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb0bed-2d5c-4d6a-8cf6-69e067a8495a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:04.403454 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb0bed-2d5c-4d6a-8cf6-69e067a8495a None admin] RBAC: Adding query filter params (role.id=fef526a7d2e741ce995d107f3ac934ae, scope.project.id=882624ffe602494b95664e06c16d55a2, user.id=652828201b9e47a5b54a3c3110e80fd8) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:04.404344 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb0bed-2d5c-4d6a-8cf6-69e067a8495a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:04.410278 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb0bed-2d5c-4d6a-8cf6-69e067a8495a None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:04.416382 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 49/92] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:02:04 2022] GET /identity/v3/role_assignments?user.id=652828201b9e47a5b54a3c3110e80fd8&scope.project.id=882624ffe602494b95664e06c16d55a2&role.id=fef526a7d2e741ce995d107f3ac934ae => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:04.417482 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb0bed-2d5c-4d6a-8cf6-69e067a8495a None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:04.445768 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:04.452220 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef16c0-d496-4422-9743-0c0d3a44f3ee None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:04.499300 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4094a-ce70-48ee-b135-b141a8efd6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:04.500475 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4094a-ce70-48ee-b135-b141a8efd6cd None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:04.500935 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4094a-ce70-48ee-b135-b141a8efd6cd None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:04.501508 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4094a-ce70-48ee-b135-b141a8efd6cd None admin] PATH_INFO: `/v3/users/dbf5aa0cc934479191a679aa5d44ed32` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:04.503534 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c4094a-ce70-48ee-b135-b141a8efd6cd None admin] RBAC: Authorizing `identity:get_user(user_id=dbf5aa0cc934479191a679aa5d44ed32)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:04.505639 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c4094a-ce70-48ee-b135-b141a8efd6cd None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:04.508277 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 44/93] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:02:04 2022] GET /identity/v3/users/dbf5aa0cc934479191a679aa5d44ed32 => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:04.514910 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4094a-ce70-48ee-b135-b141a8efd6cd None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:04.595823 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb0bed-2d5c-4d6a-8cf6-69e067a8495a None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:04.638374 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02198811-b13f-4829-9695-2b2304583a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:04.638981 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02198811-b13f-4829-9695-2b2304583a24 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:04.639264 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02198811-b13f-4829-9695-2b2304583a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:04.639582 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02198811-b13f-4829-9695-2b2304583a24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:04.640462 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02198811-b13f-4829-9695-2b2304583a24 None admin] RBAC: Adding query filter params (role.id=8272ca656a1f41379f9acf1ea055fb4d, scope.project.id=882624ffe602494b95664e06c16d55a2, user.id=dbf5aa0cc934479191a679aa5d44ed32) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:04.640773 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02198811-b13f-4829-9695-2b2304583a24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:04.641895 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4094a-ce70-48ee-b135-b141a8efd6cd None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:04.642270 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02198811-b13f-4829-9695-2b2304583a24 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:04.648816 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 50/94] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:02:04 2022] GET /identity/v3/role_assignments?user.id=dbf5aa0cc934479191a679aa5d44ed32&scope.project.id=882624ffe602494b95664e06c16d55a2&role.id=8272ca656a1f41379f9acf1ea055fb4d => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:04.664124 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:04.695022 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db703273-3ec5-47bb-954f-9d5ef8a1ee4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:04.695728 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db703273-3ec5-47bb-954f-9d5ef8a1ee4c None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:04.696104 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db703273-3ec5-47bb-954f-9d5ef8a1ee4c None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:04.696382 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db703273-3ec5-47bb-954f-9d5ef8a1ee4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:04.778938 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db703273-3ec5-47bb-954f-9d5ef8a1ee4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:04.780494 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db703273-3ec5-47bb-954f-9d5ef8a1ee4c None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:04.889840 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 45/95] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:02:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:02:04.894602 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02198811-b13f-4829-9695-2b2304583a24 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:04.999409 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:05.023366 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02198811-b13f-4829-9695-2b2304583a24 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:05.069850 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff86a431-f51a-498d-8287-7111e6220c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:05.070531 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86a431-f51a-498d-8287-7111e6220c65 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:05.070815 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86a431-f51a-498d-8287-7111e6220c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:05.071098 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86a431-f51a-498d-8287-7111e6220c65 None admin] PATH_INFO: `/v3/projects/d8a9a9026aa248499302aa92fbd6f911` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:05.072315 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff86a431-f51a-498d-8287-7111e6220c65 None admin] RBAC: Authorizing `identity:get_project(project_id=d8a9a9026aa248499302aa92fbd6f911)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:05.073795 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff86a431-f51a-498d-8287-7111e6220c65 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:05.075871 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 51/96] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:02:04 2022] GET /identity/v3/projects/d8a9a9026aa248499302aa92fbd6f911 => generated 312 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:05.083603 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db703273-3ec5-47bb-954f-9d5ef8a1ee4c None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:05.104567 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:05.193058 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db703273-3ec5-47bb-954f-9d5ef8a1ee4c None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:05.237581 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6465671d-dfc4-408a-bb36-b52e9ebbe6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:05.238230 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465671d-dfc4-408a-bb36-b52e9ebbe6c9 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:05.238510 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465671d-dfc4-408a-bb36-b52e9ebbe6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:05.238783 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465671d-dfc4-408a-bb36-b52e9ebbe6c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:05.239634 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6465671d-dfc4-408a-bb36-b52e9ebbe6c9 None admin] RBAC: Adding query filter params (role.id=12a8e2ae2b6b4d699aac9ba2319cf57d, scope.project.id=d8a9a9026aa248499302aa92fbd6f911, user.id=dbf5aa0cc934479191a679aa5d44ed32) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:05.239946 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6465671d-dfc4-408a-bb36-b52e9ebbe6c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:05.241404 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6465671d-dfc4-408a-bb36-b52e9ebbe6c9 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:05.247629 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 46/97] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:02:05 2022] GET /identity/v3/role_assignments?user.id=dbf5aa0cc934479191a679aa5d44ed32&scope.project.id=d8a9a9026aa248499302aa92fbd6f911&role.id=12a8e2ae2b6b4d699aac9ba2319cf57d => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:06.658899 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c1282-54d5-4fe2-be3e-59ba99aa8667 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:06.659424 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c1282-54d5-4fe2-be3e-59ba99aa8667 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:06.659424 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c1282-54d5-4fe2-be3e-59ba99aa8667 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:06.660847 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 52/98] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:06.677447 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533fb2a8-23b3-48e5-8a10-935265e08b6f None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:06.678334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533fb2a8-23b3-48e5-8a10-935265e08b6f None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:06.678782 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533fb2a8-23b3-48e5-8a10-935265e08b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:06.708583 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-533fb2a8-23b3-48e5-8a10-935265e08b6f None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:06.710073 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-533fb2a8-23b3-48e5-8a10-935265e08b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:06.794538 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 47/99] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:02:06.828825 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649c1282-54d5-4fe2-be3e-59ba99aa8667 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:06.949280 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649c1282-54d5-4fe2-be3e-59ba99aa8667 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:06.991797 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3aee7-2a57-45ae-9c66-670de3c4c494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:06.992523 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3aee7-2a57-45ae-9c66-670de3c4c494 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:06.992810 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3aee7-2a57-45ae-9c66-670de3c4c494 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:06.993081 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3aee7-2a57-45ae-9c66-670de3c4c494 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:07.007329 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3aee7-2a57-45ae-9c66-670de3c4c494 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:07.012856 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-8bc3aee7-2a57-45ae-9c66-670de3c4c494 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:02:07.012856 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:07.012856 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:07.012856 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:07.012856 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:07.012856 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:07.012856 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:07.012856 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:07.012856 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:07.012856 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:07.012856 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:07.012856 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:07.012856 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:07.012856 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:07.012856 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:07.012856 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:07.013677 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:07.013677 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:07.013677 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:07.013677 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:07.013677 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:07.013677 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:07.013677 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:07.013677 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:07.013677 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:07.013677 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:07.013677 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:07.013677 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:07.013677 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:07.013677 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:07.013677 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:07.013677 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:07.014419 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:07.014419 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:07.014419 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:07.014419 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:07.014419 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:07.014419 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:07.014419 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:07.014419 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:07.014419 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:07.014419 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:07.014419 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:02:07.014419 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:02:07.014419 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 53/100] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:02:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:07.020523 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533fb2a8-23b3-48e5-8a10-935265e08b6f None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:07.046284 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:07.110553 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5df06-590c-49d6-a106-fa1f62c4452a None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:07.111181 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5df06-590c-49d6-a106-fa1f62c4452a None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:07.111688 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5df06-590c-49d6-a106-fa1f62c4452a None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:07.113425 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 54/101] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:07.118775 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661e90c-615b-49dc-b2d5-e67f7f72e70f None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:07.119396 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661e90c-615b-49dc-b2d5-e67f7f72e70f None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:07.119900 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661e90c-615b-49dc-b2d5-e67f7f72e70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:07.139657 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-a661e90c-615b-49dc-b2d5-e67f7f72e70f None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:07.141881 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-a661e90c-615b-49dc-b2d5-e67f7f72e70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:07.146081 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:07.158385 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533fb2a8-23b3-48e5-8a10-935265e08b6f None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:07.218378 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28515bde-c246-4688-8359-98fc33cefd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:07.219454 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28515bde-c246-4688-8359-98fc33cefd4f None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:07.219963 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28515bde-c246-4688-8359-98fc33cefd4f None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:07.220418 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28515bde-c246-4688-8359-98fc33cefd4f None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:07.221351 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28515bde-c246-4688-8359-98fc33cefd4f None admin] RBAC: Adding query filter params (name=member) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:07.221923 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28515bde-c246-4688-8359-98fc33cefd4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:07.225103 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28515bde-c246-4688-8359-98fc33cefd4f None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:07.239990 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 48/102] 10.222.0.60 () {56 vars in 1101 bytes} [Sun Jul 31 01:02:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:07.246979 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28515bde-c246-4688-8359-98fc33cefd4f None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:07.255201 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 55/103] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:02:07.302067 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661e90c-615b-49dc-b2d5-e67f7f72e70f None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:07.367519 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:07.417625 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28515bde-c246-4688-8359-98fc33cefd4f None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:07.454826 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661e90c-615b-49dc-b2d5-e67f7f72e70f None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:07.493187 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0a059-64db-49c9-8b0a-9da089bba9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:07.494058 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0a059-64db-49c9-8b0a-9da089bba9fa None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:07.494342 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0a059-64db-49c9-8b0a-9da089bba9fa None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:07.494708 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0a059-64db-49c9-8b0a-9da089bba9fa None admin] PATH_INFO: `/v3/users/dbf5aa0cc934479191a679aa5d44ed32` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:07.499166 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea0a059-64db-49c9-8b0a-9da089bba9fa None admin] RBAC: Authorizing `identity:get_user(user_id=dbf5aa0cc934479191a679aa5d44ed32)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:07.500814 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea0a059-64db-49c9-8b0a-9da089bba9fa None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:07.503124 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 49/104] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:02:07 2022] GET /identity/v3/users/dbf5aa0cc934479191a679aa5d44ed32 => generated 275 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:07.504558 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343927d-b303-43a5-86f3-33ab081f4762 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:07.504981 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343927d-b303-43a5-86f3-33ab081f4762 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:07.505390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343927d-b303-43a5-86f3-33ab081f4762 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:07.506801 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 50/105] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:07.508229 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343927d-b303-43a5-86f3-33ab081f4762 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:07.529120 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46979fb-24c8-4ea0-9cc1-7c800916f57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:07.529785 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46979fb-24c8-4ea0-9cc1-7c800916f57a None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:07.530067 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46979fb-24c8-4ea0-9cc1-7c800916f57a None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:07.530341 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46979fb-24c8-4ea0-9cc1-7c800916f57a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:07.547025 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:07.554887 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46979fb-24c8-4ea0-9cc1-7c800916f57a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:07.560011 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-d46979fb-24c8-4ea0-9cc1-7c800916f57a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:02:07.560011 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:07.560011 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:07.560011 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:07.560011 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:07.560011 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:07.560011 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:07.560011 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:07.560011 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:07.560011 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:07.560011 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:07.560011 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:07.560011 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:07.560011 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:07.560011 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:07.560011 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:07.560907 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:07.560907 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:07.560907 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:07.560907 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:07.560907 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:07.560907 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:07.560907 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:07.560907 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:07.560907 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:07.560907 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:07.560907 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:07.560907 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:07.560907 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:07.560907 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:07.560907 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:07.560907 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:07.562060 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:07.562060 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:07.562060 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:07.562060 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:07.562060 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:07.562060 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:07.562060 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:07.562060 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:07.562060 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:07.562060 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:07.562060 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:02:07.562060 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:02:07.562060 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 56/106] 10.222.0.60 () {56 vars in 1114 bytes} [Sun Jul 31 01:02:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:02:07.569624 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca6817-d57f-4a12-be99-5e8b1b53c871 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:07.569929 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca6817-d57f-4a12-be99-5e8b1b53c871 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:07.570209 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca6817-d57f-4a12-be99-5e8b1b53c871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:07.603707 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-12ca6817-d57f-4a12-be99-5e8b1b53c871 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:07.604896 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-12ca6817-d57f-4a12-be99-5e8b1b53c871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:07.638187 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343927d-b303-43a5-86f3-33ab081f4762 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:07.672509 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8983d8-dcbb-4c62-a54b-66631b1be686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:07.673155 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8983d8-dcbb-4c62-a54b-66631b1be686 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:07.673440 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8983d8-dcbb-4c62-a54b-66631b1be686 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:07.673714 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8983d8-dcbb-4c62-a54b-66631b1be686 None admin] PATH_INFO: `/v3/projects/882624ffe602494b95664e06c16d55a2` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:07.674890 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8983d8-dcbb-4c62-a54b-66631b1be686 None admin] RBAC: Authorizing `identity:get_project(project_id=882624ffe602494b95664e06c16d55a2)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:07.676412 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8983d8-dcbb-4c62-a54b-66631b1be686 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:07.678415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 51/107] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:02:07 2022] GET /identity/v3/projects/882624ffe602494b95664e06c16d55a2 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:07.679289 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8983d8-dcbb-4c62-a54b-66631b1be686 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:07.692002 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:07.725479 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 57/108] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:02:07.726325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca6817-d57f-4a12-be99-5e8b1b53c871 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:07.783143 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8983d8-dcbb-4c62-a54b-66631b1be686 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:07.817360 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cfe71a-80d5-4fe0-a2c7-6d3328d6dd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:07.818147 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfe71a-80d5-4fe0-a2c7-6d3328d6dd4e None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:07.818533 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfe71a-80d5-4fe0-a2c7-6d3328d6dd4e None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:07.818887 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfe71a-80d5-4fe0-a2c7-6d3328d6dd4e None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:07.819750 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cfe71a-80d5-4fe0-a2c7-6d3328d6dd4e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:07.820155 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cfe71a-80d5-4fe0-a2c7-6d3328d6dd4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:07.821686 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cfe71a-80d5-4fe0-a2c7-6d3328d6dd4e None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:07.830715 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 52/109] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:02:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:07.832198 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044ce41-a1cf-4220-9ecd-6ffe381bb1a9 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:07.832591 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044ce41-a1cf-4220-9ecd-6ffe381bb1a9 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:07.832958 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044ce41-a1cf-4220-9ecd-6ffe381bb1a9 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:07.834524 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 53/110] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:07.835675 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044ce41-a1cf-4220-9ecd-6ffe381bb1a9 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:07.856537 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca6817-d57f-4a12-be99-5e8b1b53c871 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:07.887882 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:07.893180 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b7a6a-86f0-41a0-9c21-821d6441122f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:07.893907 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b7a6a-86f0-41a0-9c21-821d6441122f None admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:07.894683 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b7a6a-86f0-41a0-9c21-821d6441122f None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:07.894968 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b7a6a-86f0-41a0-9c21-821d6441122f None admin] PATH_INFO: `/v3/projects/882624ffe602494b95664e06c16d55a2/users/dbf5aa0cc934479191a679aa5d44ed32/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:07.897523 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18b7a6a-86f0-41a0-9c21-821d6441122f None admin] RBAC: Authorizing `identity:create_grant(project_id=882624ffe602494b95664e06c16d55a2, user_id=dbf5aa0cc934479191a679aa5d44ed32, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:07.899941 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18b7a6a-86f0-41a0-9c21-821d6441122f None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:07.914904 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:07.920837 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 58/111] 10.222.0.60 () {58 vars in 1439 bytes} [Sun Jul 31 01:02:07 2022] PUT /identity/v3/projects/882624ffe602494b95664e06c16d55a2/users/dbf5aa0cc934479191a679aa5d44ed32/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:02:07.922961 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b7a6a-86f0-41a0-9c21-821d6441122f None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:07.982523 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044ce41-a1cf-4220-9ecd-6ffe381bb1a9 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:08.053787 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33f7cb-207a-4e38-a2c2-3d78b0a9b1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:08.054484 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33f7cb-207a-4e38-a2c2-3d78b0a9b1bd None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:08.054828 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33f7cb-207a-4e38-a2c2-3d78b0a9b1bd None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:08.055168 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33f7cb-207a-4e38-a2c2-3d78b0a9b1bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:08.066309 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b7a6a-86f0-41a0-9c21-821d6441122f None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:08.073604 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33f7cb-207a-4e38-a2c2-3d78b0a9b1bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:08.080068 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-ec33f7cb-207a-4e38-a2c2-3d78b0a9b1bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:02:08.080068 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:08.080068 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:08.080068 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:08.080068 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:08.080068 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:08.080068 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:08.080068 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:08.080068 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:08.080068 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:08.080068 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:08.080068 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:08.080068 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:08.080068 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:08.080068 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:08.080068 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:08.081163 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:08.081163 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:08.081163 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:08.081163 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:08.081163 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:08.081163 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:08.081163 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:08.081163 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:08.081163 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:08.081163 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:08.081163 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:08.081163 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:08.081163 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:08.081163 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:08.081163 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:08.081163 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:08.081983 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:08.081983 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:08.081983 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:08.081983 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:08.081983 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:08.081983 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:08.081983 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:08.081983 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:08.081983 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:08.081983 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:08.081983 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:02:08.081983 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:02:08.084476 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 54/112] 10.222.0.60 () {56 vars in 1096 bytes} [Sun Jul 31 01:02:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:08.086044 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc49a8-1eae-4f6c-8227-60c8eb4146b8 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:08.086546 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc49a8-1eae-4f6c-8227-60c8eb4146b8 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:08.087129 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc49a8-1eae-4f6c-8227-60c8eb4146b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:08.107637 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-95fc49a8-1eae-4f6c-8227-60c8eb4146b8 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:08.108790 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-95fc49a8-1eae-4f6c-8227-60c8eb4146b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:08.118676 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdad9db-80fa-4283-9085-c9b2a51ec96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:08.120359 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdad9db-80fa-4283-9085-c9b2a51ec96d None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:08.120859 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdad9db-80fa-4283-9085-c9b2a51ec96d None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:08.121687 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdad9db-80fa-4283-9085-c9b2a51ec96d None admin] PATH_INFO: `/v3/users/dbf5aa0cc934479191a679aa5d44ed32` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:08.123628 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdad9db-80fa-4283-9085-c9b2a51ec96d None admin] RBAC: Authorizing `identity:get_user(user_id=dbf5aa0cc934479191a679aa5d44ed32)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:08.126329 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdad9db-80fa-4283-9085-c9b2a51ec96d None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:08.129320 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 59/113] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:02:07 2022] GET /identity/v3/users/dbf5aa0cc934479191a679aa5d44ed32 => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:08.130918 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb7a59-be4e-4fcb-9e70-1c55fe1c2b8c None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:08.131426 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb7a59-be4e-4fcb-9e70-1c55fe1c2b8c None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:08.131921 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb7a59-be4e-4fcb-9e70-1c55fe1c2b8c None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:08.138885 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 60/114] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:08.140575 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb7a59-be4e-4fcb-9e70-1c55fe1c2b8c None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:08.194475 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 55/115] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:02:08.195830 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc49a8-1eae-4f6c-8227-60c8eb4146b8 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:08.227858 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:08.281893 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb7a59-be4e-4fcb-9e70-1c55fe1c2b8c None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:08.285298 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:08.319784 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f65f0-719b-45dc-ad0e-629704f55d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:08.320817 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f65f0-719b-45dc-ad0e-629704f55d8f None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:08.321097 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f65f0-719b-45dc-ad0e-629704f55d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:08.321527 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f65f0-719b-45dc-ad0e-629704f55d8f None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:08.322378 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f65f0-719b-45dc-ad0e-629704f55d8f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:08.322689 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f65f0-719b-45dc-ad0e-629704f55d8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:08.324833 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f65f0-719b-45dc-ad0e-629704f55d8f None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:08.335981 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc49a8-1eae-4f6c-8227-60c8eb4146b8 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:08.336140 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 61/116] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:02:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:08.340455 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf2ee1-6909-466a-a48c-53cd63f64731 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:08.340735 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf2ee1-6909-466a-a48c-53cd63f64731 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:08.341089 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf2ee1-6909-466a-a48c-53cd63f64731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:08.368970 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-47bf2ee1-6909-466a-a48c-53cd63f64731 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:08.370348 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-47bf2ee1-6909-466a-a48c-53cd63f64731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:08.384305 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c5d1b-eb27-4f89-8269-3ac7f7264b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:08.385162 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c5d1b-eb27-4f89-8269-3ac7f7264b33 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:08.385513 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c5d1b-eb27-4f89-8269-3ac7f7264b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:08.385851 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c5d1b-eb27-4f89-8269-3ac7f7264b33 None admin] PATH_INFO: `/v3/projects/882624ffe602494b95664e06c16d55a2` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:08.387820 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c5d1b-eb27-4f89-8269-3ac7f7264b33 None admin] RBAC: Authorizing `identity:get_project(project_id=882624ffe602494b95664e06c16d55a2)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:08.389638 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c5d1b-eb27-4f89-8269-3ac7f7264b33 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:08.392345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 56/117] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:02:08 2022] GET /identity/v3/projects/882624ffe602494b95664e06c16d55a2 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:08.393110 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c5d1b-eb27-4f89-8269-3ac7f7264b33 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:08.444400 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 62/118] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:02:08.448127 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf2ee1-6909-466a-a48c-53cd63f64731 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:08.504334 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:08.513430 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c5d1b-eb27-4f89-8269-3ac7f7264b33 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:08.543255 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:08.550686 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2663438-fa17-4e24-95fb-450631916fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:08.551347 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2663438-fa17-4e24-95fb-450631916fa7 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:08.551658 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2663438-fa17-4e24-95fb-450631916fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:08.551938 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2663438-fa17-4e24-95fb-450631916fa7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:08.553098 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2663438-fa17-4e24-95fb-450631916fa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:08.554568 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2663438-fa17-4e24-95fb-450631916fa7 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:08.556224 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 57/119] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:02:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:08.556977 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2663438-fa17-4e24-95fb-450631916fa7 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:08.563056 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf2ee1-6909-466a-a48c-53cd63f64731 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:08.598254 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05faffe-f2bb-44d2-ad6e-f88e8a2398a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:08.598857 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05faffe-f2bb-44d2-ad6e-f88e8a2398a0 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:08.599140 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05faffe-f2bb-44d2-ad6e-f88e8a2398a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:08.599410 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05faffe-f2bb-44d2-ad6e-f88e8a2398a0 None admin] PATH_INFO: `/v3/users/652828201b9e47a5b54a3c3110e80fd8` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:08.600617 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05faffe-f2bb-44d2-ad6e-f88e8a2398a0 None admin] RBAC: Authorizing `identity:get_user(user_id=652828201b9e47a5b54a3c3110e80fd8)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:08.602067 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05faffe-f2bb-44d2-ad6e-f88e8a2398a0 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:08.603860 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 63/120] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:02:08 2022] GET /identity/v3/users/652828201b9e47a5b54a3c3110e80fd8 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:08.604934 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19befb42-b001-45bf-9394-f2572ee9f797 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:08.605218 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19befb42-b001-45bf-9394-f2572ee9f797 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:08.605485 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19befb42-b001-45bf-9394-f2572ee9f797 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:08.608847 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 64/121] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:08.608847 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19befb42-b001-45bf-9394-f2572ee9f797 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:08.671506 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2663438-fa17-4e24-95fb-450631916fa7 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:08.705400 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae7b56-a967-46d9-a6ad-f3be282c1e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:08.706082 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae7b56-a967-46d9-a6ad-f3be282c1e12 None admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:08.706359 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae7b56-a967-46d9-a6ad-f3be282c1e12 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:08.706630 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae7b56-a967-46d9-a6ad-f3be282c1e12 None admin] PATH_INFO: `/v3/projects/882624ffe602494b95664e06c16d55a2/users/dbf5aa0cc934479191a679aa5d44ed32/roles/8272ca656a1f41379f9acf1ea055fb4d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:08.708895 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae7b56-a967-46d9-a6ad-f3be282c1e12 None admin] RBAC: Authorizing `identity:create_grant(project_id=882624ffe602494b95664e06c16d55a2, user_id=dbf5aa0cc934479191a679aa5d44ed32, role_id=8272ca656a1f41379f9acf1ea055fb4d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:08.710878 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae7b56-a967-46d9-a6ad-f3be282c1e12 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:08.716582 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19befb42-b001-45bf-9394-f2572ee9f797 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:08.735515 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 58/122] 10.222.0.60 () {58 vars in 1439 bytes} [Sun Jul 31 01:02:08 2022] PUT /identity/v3/projects/882624ffe602494b95664e06c16d55a2/users/dbf5aa0cc934479191a679aa5d44ed32/roles/8272ca656a1f41379f9acf1ea055fb4d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:02:08.735515 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae7b56-a967-46d9-a6ad-f3be282c1e12 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:08.748844 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:08.772263 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a227178-c7f9-4611-9eb0-d192dc3f5d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:08.773064 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a227178-c7f9-4611-9eb0-d192dc3f5d4f None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:08.773404 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a227178-c7f9-4611-9eb0-d192dc3f5d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:08.773735 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a227178-c7f9-4611-9eb0-d192dc3f5d4f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:08.786806 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a227178-c7f9-4611-9eb0-d192dc3f5d4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:08.792583 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-4a227178-c7f9-4611-9eb0-d192dc3f5d4f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 01:02:08.792583 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:08.792583 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:08.792583 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:08.792583 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:08.792583 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:08.792583 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:08.792583 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:08.792583 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:08.792583 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:08.792583 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:08.792583 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:08.792583 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:08.792583 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:08.792583 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:08.792583 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:08.793633 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:08.793633 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:08.793633 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:08.793633 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:08.793633 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:08.793633 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:08.793633 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:08.793633 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:08.793633 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:08.793633 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:08.793633 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:08.793633 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:08.793633 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:08.793633 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:08.793633 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:08.793633 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:08.794459 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:08.794459 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:08.794459 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:08.794459 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:08.794459 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:08.794459 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:08.794459 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:08.794459 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:08.794459 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:08.794459 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:08.794459 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 01:02:08.794459 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:02:08.799648 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 65/123] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:02:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:08.800710 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a227178-c7f9-4611-9eb0-d192dc3f5d4f None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:08.805263 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:08.860111 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae7b56-a967-46d9-a6ad-f3be282c1e12 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:08.912208 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2bd8c-4b82-465d-9457-a3c680177944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:08.913300 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2bd8c-4b82-465d-9457-a3c680177944 None admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:08.914106 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2bd8c-4b82-465d-9457-a3c680177944 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:08.914489 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2bd8c-4b82-465d-9457-a3c680177944 None admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:08.915607 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab2bd8c-4b82-465d-9457-a3c680177944 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:08.918226 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab2bd8c-4b82-465d-9457-a3c680177944 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:08.923087 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a227178-c7f9-4611-9eb0-d192dc3f5d4f None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:08.961796 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 59/124] 10.222.0.60 () {60 vars in 1141 bytes} [Sun Jul 31 01:02:08 2022] POST /identity/v3/projects => generated 302 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:02:08.963368 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304cdd94-523b-4349-8135-0494b3f9dbe5 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:08.963779 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304cdd94-523b-4349-8135-0494b3f9dbe5 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:08.964229 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304cdd94-523b-4349-8135-0494b3f9dbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:08.970296 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd1f40-11ae-4aac-b8f0-4cd73323ce5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:08.970959 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd1f40-11ae-4aac-b8f0-4cd73323ce5e None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:08.971235 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd1f40-11ae-4aac-b8f0-4cd73323ce5e None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:08.971623 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd1f40-11ae-4aac-b8f0-4cd73323ce5e None admin] PATH_INFO: `/v3/projects/882624ffe602494b95664e06c16d55a2` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:08.974080 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd1f40-11ae-4aac-b8f0-4cd73323ce5e None admin] RBAC: Authorizing `identity:get_project(project_id=882624ffe602494b95664e06c16d55a2)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:08.975647 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd1f40-11ae-4aac-b8f0-4cd73323ce5e None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:08.978020 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 66/125] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:02:08 2022] GET /identity/v3/projects/882624ffe602494b95664e06c16d55a2 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:08.978861 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd1f40-11ae-4aac-b8f0-4cd73323ce5e None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:08.990122 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-304cdd94-523b-4349-8135-0494b3f9dbe5 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:08.991362 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-304cdd94-523b-4349-8135-0494b3f9dbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:09.053429 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:09.113361 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd1f40-11ae-4aac-b8f0-4cd73323ce5e None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:09.134052 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 60/126] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:02:09.134934 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304cdd94-523b-4349-8135-0494b3f9dbe5 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:09.155723 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c45887-6a49-4c41-b02c-21123907048f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:09.156448 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c45887-6a49-4c41-b02c-21123907048f None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:09.156724 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c45887-6a49-4c41-b02c-21123907048f None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:09.156992 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c45887-6a49-4c41-b02c-21123907048f None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:09.157862 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c45887-6a49-4c41-b02c-21123907048f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:09.158166 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c45887-6a49-4c41-b02c-21123907048f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:09.159641 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c45887-6a49-4c41-b02c-21123907048f None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:09.169723 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 67/127] 10.222.0.60 () {56 vars in 1101 bytes} [Sun Jul 31 01:02:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:09.173900 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c45887-6a49-4c41-b02c-21123907048f None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:09.209160 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:09.278401 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304cdd94-523b-4349-8135-0494b3f9dbe5 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:09.280070 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c45887-6a49-4c41-b02c-21123907048f None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:09.287086 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:09.315303 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e97cbc-e482-417a-936e-f20c3494b1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:09.315991 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e97cbc-e482-417a-936e-f20c3494b1f4 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:09.316273 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e97cbc-e482-417a-936e-f20c3494b1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:09.316543 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e97cbc-e482-417a-936e-f20c3494b1f4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:09.319339 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eef6f7-fd89-42f6-8780-58477651f059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:09.320065 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eef6f7-fd89-42f6-8780-58477651f059 None admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:09.320344 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eef6f7-fd89-42f6-8780-58477651f059 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:09.320619 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eef6f7-fd89-42f6-8780-58477651f059 None admin] PATH_INFO: `/v3/projects/882624ffe602494b95664e06c16d55a2/users/652828201b9e47a5b54a3c3110e80fd8/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:09.322587 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eef6f7-fd89-42f6-8780-58477651f059 None admin] RBAC: Authorizing `identity:create_grant(project_id=882624ffe602494b95664e06c16d55a2, user_id=652828201b9e47a5b54a3c3110e80fd8, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:09.324272 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eef6f7-fd89-42f6-8780-58477651f059 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:09.327014 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e97cbc-e482-417a-936e-f20c3494b1f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:09.333160 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-c1e97cbc-e482-417a-936e-f20c3494b1f4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:02:09.333160 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:09.333160 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:09.333160 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:09.333160 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:09.333160 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:09.333160 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:09.333160 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:09.333160 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:09.333160 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:09.333160 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:09.333160 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:09.333160 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:09.333160 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:09.333160 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:09.333160 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:09.333996 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:09.333996 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:09.333996 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:09.333996 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:09.333996 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:09.333996 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:09.333996 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:09.333996 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:09.333996 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:09.333996 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:09.333996 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:09.333996 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:09.333996 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:09.333996 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:09.333996 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:09.333996 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:09.335432 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:09.335432 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:09.335432 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:09.335432 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:09.335432 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:09.335432 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:09.335432 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:09.335432 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:09.335432 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:09.335432 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:09.335432 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:02:09.335432 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:02:09.335432 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 68/128] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:02:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:09.335432 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e97cbc-e482-417a-936e-f20c3494b1f4 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:09.355663 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 61/129] 10.222.0.60 () {58 vars in 1439 bytes} [Sun Jul 31 01:02:09 2022] PUT /identity/v3/projects/882624ffe602494b95664e06c16d55a2/users/652828201b9e47a5b54a3c3110e80fd8/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:02:09.356925 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eef6f7-fd89-42f6-8780-58477651f059 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:09.519860 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e97cbc-e482-417a-936e-f20c3494b1f4 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:09.609615 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:09.618564 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eef6f7-fd89-42f6-8780-58477651f059 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:09.636106 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feee2e5-35ee-4bfb-a068-6cabe4e1062d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:09.636696 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feee2e5-35ee-4bfb-a068-6cabe4e1062d None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:09.637017 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feee2e5-35ee-4bfb-a068-6cabe4e1062d None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:09.637293 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feee2e5-35ee-4bfb-a068-6cabe4e1062d None admin] PATH_INFO: `/v3/users/97bdfc2b9d1340a6827cccdc5cad631d` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:09.653634 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feee2e5-35ee-4bfb-a068-6cabe4e1062d None admin] RBAC: Authorizing `identity:get_user(user_id=97bdfc2b9d1340a6827cccdc5cad631d)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:09.655129 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feee2e5-35ee-4bfb-a068-6cabe4e1062d None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:09.657991 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 69/130] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:02:09 2022] GET /identity/v3/users/97bdfc2b9d1340a6827cccdc5cad631d => generated 289 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:09.663769 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feee2e5-35ee-4bfb-a068-6cabe4e1062d None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:09.686603 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf30f6-6155-4252-82cf-5b9538836fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:09.688202 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf30f6-6155-4252-82cf-5b9538836fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:09.688684 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf30f6-6155-4252-82cf-5b9538836fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:09.689423 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf30f6-6155-4252-82cf-5b9538836fa9 None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:09.690613 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf30f6-6155-4252-82cf-5b9538836fa9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:09.691114 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf30f6-6155-4252-82cf-5b9538836fa9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:09.693040 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf30f6-6155-4252-82cf-5b9538836fa9 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:09.704821 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:09.705712 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 62/131] 10.222.0.60 () {56 vars in 1101 bytes} [Sun Jul 31 01:02:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:09.714355 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf30f6-6155-4252-82cf-5b9538836fa9 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:09.848125 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feee2e5-35ee-4bfb-a068-6cabe4e1062d None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:09.891242 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf30f6-6155-4252-82cf-5b9538836fa9 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:09.928670 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b84fda-846c-46ad-8807-96a735ed7d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:09.929327 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b84fda-846c-46ad-8807-96a735ed7d7a None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:09.929605 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b84fda-846c-46ad-8807-96a735ed7d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:09.929878 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b84fda-846c-46ad-8807-96a735ed7d7a None admin] PATH_INFO: `/v3/users/dbf5aa0cc934479191a679aa5d44ed32` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:09.931053 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b84fda-846c-46ad-8807-96a735ed7d7a None admin] RBAC: Authorizing `identity:get_user(user_id=dbf5aa0cc934479191a679aa5d44ed32)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:09.932649 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b84fda-846c-46ad-8807-96a735ed7d7a None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:09.934681 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 63/132] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:02:09 2022] GET /identity/v3/users/dbf5aa0cc934479191a679aa5d44ed32 => generated 275 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:09.940274 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ec3e6-452c-40ac-ad8b-556e27a4dc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:09.940625 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b84fda-846c-46ad-8807-96a735ed7d7a None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:09.940934 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ec3e6-452c-40ac-ad8b-556e27a4dc46 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:09.941217 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ec3e6-452c-40ac-ad8b-556e27a4dc46 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:09.941492 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ec3e6-452c-40ac-ad8b-556e27a4dc46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:09.995466 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:10.116666 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ec3e6-452c-40ac-ad8b-556e27a4dc46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:10.118117 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ec3e6-452c-40ac-ad8b-556e27a4dc46 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:10.126922 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b84fda-846c-46ad-8807-96a735ed7d7a None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:10.178719 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb206f-29e2-4d7b-8eee-f58b3507adcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:10.179379 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb206f-29e2-4d7b-8eee-f58b3507adcb None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:10.179686 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb206f-29e2-4d7b-8eee-f58b3507adcb None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:10.179967 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb206f-29e2-4d7b-8eee-f58b3507adcb None admin] PATH_INFO: `/v3/projects/d8a9a9026aa248499302aa92fbd6f911` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:10.181206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fb206f-29e2-4d7b-8eee-f58b3507adcb None admin] RBAC: Authorizing `identity:get_project(project_id=d8a9a9026aa248499302aa92fbd6f911)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:10.182746 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fb206f-29e2-4d7b-8eee-f58b3507adcb None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:10.185012 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:10.185770 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 64/133] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:02:09 2022] GET /identity/v3/projects/d8a9a9026aa248499302aa92fbd6f911 => generated 312 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:02:10.192349 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb206f-29e2-4d7b-8eee-f58b3507adcb None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:10.299340 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 70/134] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:02:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 31 01:02:10.304902 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ec3e6-452c-40ac-ad8b-556e27a4dc46 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:10.389916 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:10.394309 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb206f-29e2-4d7b-8eee-f58b3507adcb None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:10.434581 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e254084-3d76-43a4-b7d8-6c738ee49110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:10.435189 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e254084-3d76-43a4-b7d8-6c738ee49110 None admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:10.435465 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e254084-3d76-43a4-b7d8-6c738ee49110 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:10.435781 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e254084-3d76-43a4-b7d8-6c738ee49110 None admin] PATH_INFO: `/v3/projects/d8a9a9026aa248499302aa92fbd6f911/users/dbf5aa0cc934479191a679aa5d44ed32/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:10.437813 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e254084-3d76-43a4-b7d8-6c738ee49110 None admin] RBAC: Authorizing `identity:create_grant(project_id=d8a9a9026aa248499302aa92fbd6f911, user_id=dbf5aa0cc934479191a679aa5d44ed32, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:10.439269 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e254084-3d76-43a4-b7d8-6c738ee49110 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:10.463862 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 65/135] 10.222.0.60 () {58 vars in 1439 bytes} [Sun Jul 31 01:02:10 2022] PUT /identity/v3/projects/d8a9a9026aa248499302aa92fbd6f911/users/dbf5aa0cc934479191a679aa5d44ed32/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:02:10.465154 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465b8f0-b6b8-4e23-8594-1a0dacd9a31d None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:10.465487 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465b8f0-b6b8-4e23-8594-1a0dacd9a31d None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:10.465763 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465b8f0-b6b8-4e23-8594-1a0dacd9a31d None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:10.467164 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 66/136] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:10.472652 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7acf5-098f-42ab-ad9c-5b5b71696699 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:10.472937 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7acf5-098f-42ab-ad9c-5b5b71696699 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:10.473311 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7acf5-098f-42ab-ad9c-5b5b71696699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:10.507587 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-c8e7acf5-098f-42ab-ad9c-5b5b71696699 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:10.510276 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-c8e7acf5-098f-42ab-ad9c-5b5b71696699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:10.535865 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ec3e6-452c-40ac-ad8b-556e27a4dc46 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:10.571919 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c47e2a-f5c9-4fe8-895d-5c06f7b5363a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:10.572625 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c47e2a-f5c9-4fe8-895d-5c06f7b5363a None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:10.572906 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c47e2a-f5c9-4fe8-895d-5c06f7b5363a None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:10.573177 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c47e2a-f5c9-4fe8-895d-5c06f7b5363a None admin] PATH_INFO: `/v3/projects/882624ffe602494b95664e06c16d55a2` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:10.574441 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c47e2a-f5c9-4fe8-895d-5c06f7b5363a None admin] RBAC: Authorizing `identity:get_project(project_id=882624ffe602494b95664e06c16d55a2)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:10.576097 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c47e2a-f5c9-4fe8-895d-5c06f7b5363a None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:10.578338 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 71/137] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:02:10 2022] GET /identity/v3/projects/882624ffe602494b95664e06c16d55a2 => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:02:10.578650 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:10.591535 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c47e2a-f5c9-4fe8-895d-5c06f7b5363a None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:10.636036 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 67/138] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:02:10.662638 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e7acf5-098f-42ab-ad9c-5b5b71696699 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:10.759881 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c47e2a-f5c9-4fe8-895d-5c06f7b5363a None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:10.825595 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e5b6c-4de5-4c2c-9d15-625c3a39ca42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:10.826234 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e5b6c-4de5-4c2c-9d15-625c3a39ca42 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:10.826515 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e5b6c-4de5-4c2c-9d15-625c3a39ca42 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:10.826789 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e5b6c-4de5-4c2c-9d15-625c3a39ca42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:10.827618 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e5b6c-4de5-4c2c-9d15-625c3a39ca42 None admin] RBAC: Adding query filter params (role.id=d902e34269cc4d79b49b0d035055c40b, scope.project.id=882624ffe602494b95664e06c16d55a2, user.id=97bdfc2b9d1340a6827cccdc5cad631d) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:10.827996 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e5b6c-4de5-4c2c-9d15-625c3a39ca42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:10.829462 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e5b6c-4de5-4c2c-9d15-625c3a39ca42 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:10.839630 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 72/139] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:02:10 2022] GET /identity/v3/role_assignments?user.id=97bdfc2b9d1340a6827cccdc5cad631d&scope.project.id=882624ffe602494b95664e06c16d55a2&role.id=d902e34269cc4d79b49b0d035055c40b => generated 259 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:10.858251 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:10.875647 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e7acf5-098f-42ab-ad9c-5b5b71696699 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:10.916032 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85175e1-a739-4867-a64e-cf7fb6db1279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:10.916695 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85175e1-a739-4867-a64e-cf7fb6db1279 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:10.916974 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85175e1-a739-4867-a64e-cf7fb6db1279 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:10.917246 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85175e1-a739-4867-a64e-cf7fb6db1279 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:10.927861 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85175e1-a739-4867-a64e-cf7fb6db1279 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:10.933276 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-b85175e1-a739-4867-a64e-cf7fb6db1279 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:02:10.933276 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:10.933276 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:10.933276 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:10.933276 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:10.933276 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:10.933276 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:10.933276 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:10.933276 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:10.933276 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:10.933276 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:10.933276 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:10.933276 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:10.933276 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:10.933276 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:10.933276 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:10.935369 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:10.935369 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:10.935369 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:10.935369 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:10.935369 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:10.935369 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:10.935369 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:10.935369 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:10.935369 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:10.935369 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:10.935369 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:10.935369 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:10.935369 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:10.935369 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:10.935369 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:10.935369 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:10.937395 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:10.937395 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:10.937395 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:10.937395 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:10.937395 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:10.937395 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:10.937395 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:10.937395 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:10.937395 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:10.937395 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:10.937395 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:02:10.937395 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:02:10.937395 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 68/140] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:02:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:10.944854 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e5b6c-4de5-4c2c-9d15-625c3a39ca42 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:11.018149 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:11.055754 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e5b6c-4de5-4c2c-9d15-625c3a39ca42 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:11.091882 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869926b-a358-4d51-8143-2faaedbcef7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:11.092557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869926b-a358-4d51-8143-2faaedbcef7e None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:11.092841 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869926b-a358-4d51-8143-2faaedbcef7e None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:11.093186 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869926b-a358-4d51-8143-2faaedbcef7e None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:11.094207 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2869926b-a358-4d51-8143-2faaedbcef7e None admin] RBAC: Adding query filter params (name=member) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:11.094588 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2869926b-a358-4d51-8143-2faaedbcef7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:11.096126 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2869926b-a358-4d51-8143-2faaedbcef7e None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:11.106624 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 73/141] 10.222.0.60 () {56 vars in 1101 bytes} [Sun Jul 31 01:02:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:11.112856 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85175e1-a739-4867-a64e-cf7fb6db1279 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:11.240296 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85175e1-a739-4867-a64e-cf7fb6db1279 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:11.284037 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c877362-4665-4105-84b7-df1826c96334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:11.284614 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c877362-4665-4105-84b7-df1826c96334 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:11.284885 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c877362-4665-4105-84b7-df1826c96334 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:11.285153 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c877362-4665-4105-84b7-df1826c96334 None admin] PATH_INFO: `/v3/users/dbf5aa0cc934479191a679aa5d44ed32` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:11.286345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c877362-4665-4105-84b7-df1826c96334 None admin] RBAC: Authorizing `identity:get_user(user_id=dbf5aa0cc934479191a679aa5d44ed32)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:11.287826 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c877362-4665-4105-84b7-df1826c96334 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:11.289621 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 69/142] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:02:11 2022] GET /identity/v3/users/dbf5aa0cc934479191a679aa5d44ed32 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:11.295272 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869926b-a358-4d51-8143-2faaedbcef7e None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:11.414834 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869926b-a358-4d51-8143-2faaedbcef7e None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:11.431789 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:11.453515 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da233fd1-c9db-4205-b371-16bd3e84ba7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:11.454143 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da233fd1-c9db-4205-b371-16bd3e84ba7a None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:11.454416 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da233fd1-c9db-4205-b371-16bd3e84ba7a None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:11.454686 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da233fd1-c9db-4205-b371-16bd3e84ba7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:11.539124 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da233fd1-c9db-4205-b371-16bd3e84ba7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:11.540558 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da233fd1-c9db-4205-b371-16bd3e84ba7a None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:11.590036 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76f52c-a16a-4ed0-a3b9-5ab410919810 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:11.590380 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76f52c-a16a-4ed0-a3b9-5ab410919810 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:11.590582 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76f52c-a16a-4ed0-a3b9-5ab410919810 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:11.592163 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 70/143] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:02:11.599950 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e7076-aca7-46d0-b9e9-494e88b484d0 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:11.600228 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e7076-aca7-46d0-b9e9-494e88b484d0 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:11.600501 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e7076-aca7-46d0-b9e9-494e88b484d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:11.626268 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-821e7076-aca7-46d0-b9e9-494e88b484d0 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:11.627844 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-821e7076-aca7-46d0-b9e9-494e88b484d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:11.647659 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:11.747846 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 74/144] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:02:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:02:11.754969 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da233fd1-c9db-4205-b371-16bd3e84ba7a None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:11.775562 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 71/145] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:02:11.784848 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:11.822102 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e7076-aca7-46d0-b9e9-494e88b484d0 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:11.927271 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da233fd1-c9db-4205-b371-16bd3e84ba7a None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:12.009102 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ce2fc-b937-405f-9dda-3bf61e62cb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:12.009766 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ce2fc-b937-405f-9dda-3bf61e62cb26 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:12.010031 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ce2fc-b937-405f-9dda-3bf61e62cb26 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:12.010310 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ce2fc-b937-405f-9dda-3bf61e62cb26 None admin] PATH_INFO: `/v3/projects/882624ffe602494b95664e06c16d55a2` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:12.011575 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e7076-aca7-46d0-b9e9-494e88b484d0 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:12.015451 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ce2fc-b937-405f-9dda-3bf61e62cb26 None admin] RBAC: Authorizing `identity:get_project(project_id=882624ffe602494b95664e06c16d55a2)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:12.015451 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ce2fc-b937-405f-9dda-3bf61e62cb26 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:12.015451 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 75/146] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:02:11 2022] GET /identity/v3/projects/882624ffe602494b95664e06c16d55a2 => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:12.022147 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ce2fc-b937-405f-9dda-3bf61e62cb26 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:12.082941 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12267977-c0c6-4b85-a4d9-1f51c92db39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:12.083929 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12267977-c0c6-4b85-a4d9-1f51c92db39d None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:12.084393 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12267977-c0c6-4b85-a4d9-1f51c92db39d None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:12.084839 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12267977-c0c6-4b85-a4d9-1f51c92db39d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:12.109347 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12267977-c0c6-4b85-a4d9-1f51c92db39d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:12.115159 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-12267977-c0c6-4b85-a4d9-1f51c92db39d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:02:12.115159 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:12.115159 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:12.115159 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:12.115159 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:12.115159 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:12.115159 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:12.115159 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:12.115159 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:12.115159 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:12.115159 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:12.115159 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:12.115159 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:12.115159 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:12.115159 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:12.115159 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:12.116073 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:12.116073 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:12.116073 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:12.116073 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:12.116073 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:12.116073 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:12.116073 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:12.116073 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:12.116073 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:12.116073 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:12.116073 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:12.116073 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:12.116073 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:12.116073 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:12.116073 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:12.116073 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:12.116838 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:12.116838 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:12.116838 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:12.116838 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:12.116838 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:12.116838 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:12.116838 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:12.116838 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:12.116838 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:12.116838 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:12.116838 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:02:12.116838 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:02:12.123507 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 72/147] 10.222.0.60 () {56 vars in 1114 bytes} [Sun Jul 31 01:02:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:02:12.126350 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12267977-c0c6-4b85-a4d9-1f51c92db39d None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:12.139850 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:12.175904 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:12.184266 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ce2fc-b937-405f-9dda-3bf61e62cb26 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:12.220320 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e194428-9e91-46f6-8bb3-6f4722de58ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:12.221091 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e194428-9e91-46f6-8bb3-6f4722de58ae None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:12.221376 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e194428-9e91-46f6-8bb3-6f4722de58ae None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:12.221651 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e194428-9e91-46f6-8bb3-6f4722de58ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:12.222447 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e194428-9e91-46f6-8bb3-6f4722de58ae None admin] RBAC: Adding query filter params (role.id=12a8e2ae2b6b4d699aac9ba2319cf57d, scope.project.id=882624ffe602494b95664e06c16d55a2, user.id=dbf5aa0cc934479191a679aa5d44ed32) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:12.222753 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e194428-9e91-46f6-8bb3-6f4722de58ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:12.225170 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e194428-9e91-46f6-8bb3-6f4722de58ae None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:12.235833 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 76/148] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:02:12 2022] GET /identity/v3/role_assignments?user.id=dbf5aa0cc934479191a679aa5d44ed32&scope.project.id=882624ffe602494b95664e06c16d55a2&role.id=12a8e2ae2b6b4d699aac9ba2319cf57d => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:12.237254 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94e16e-b34f-45dc-b748-3b78862dac6f None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:12.237539 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94e16e-b34f-45dc-b748-3b78862dac6f None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:12.237813 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94e16e-b34f-45dc-b748-3b78862dac6f None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:12.239133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 77/149] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:12.249426 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f208a36-c83b-4f15-96cd-73968eb4f970 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:12.251845 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f208a36-c83b-4f15-96cd-73968eb4f970 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:12.252214 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f208a36-c83b-4f15-96cd-73968eb4f970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:12.283640 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-6f208a36-c83b-4f15-96cd-73968eb4f970 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:12.285023 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-6f208a36-c83b-4f15-96cd-73968eb4f970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:12.392677 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 78/150] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:02:12.399544 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3fa8a-b9c3-47d4-a3f6-d8c20c0ee03e None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:12.400689 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3fa8a-b9c3-47d4-a3f6-d8c20c0ee03e None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:12.402743 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3fa8a-b9c3-47d4-a3f6-d8c20c0ee03e None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:12.406318 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 79/151] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:12 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:12.413478 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26c1b4-8d7a-4453-b887-9b5a3a303d06 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:12.414337 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26c1b4-8d7a-4453-b887-9b5a3a303d06 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:12.415720 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26c1b4-8d7a-4453-b887-9b5a3a303d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:12.419341 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12267977-c0c6-4b85-a4d9-1f51c92db39d None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:12.457533 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-3b26c1b4-8d7a-4453-b887-9b5a3a303d06 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:12.459084 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-3b26c1b4-8d7a-4453-b887-9b5a3a303d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:12.486769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a223052-9ec6-4529-858c-534e5046188f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:12.487401 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a223052-9ec6-4529-858c-534e5046188f None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:12.487727 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a223052-9ec6-4529-858c-534e5046188f None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:12.487998 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a223052-9ec6-4529-858c-534e5046188f None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:12.488724 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a223052-9ec6-4529-858c-534e5046188f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:12.489023 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a223052-9ec6-4529-858c-534e5046188f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:12.490979 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a223052-9ec6-4529-858c-534e5046188f None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:12.500826 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 73/152] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:02:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:12.501933 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a223052-9ec6-4529-858c-534e5046188f None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:12.541770 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 80/153] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:02:12.542752 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26c1b4-8d7a-4453-b887-9b5a3a303d06 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:12.555356 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:12.586188 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:12.626740 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a223052-9ec6-4529-858c-534e5046188f None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:12.666082 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22abc720-d562-4b46-8e82-4461e35d9266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:12.667598 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abc720-d562-4b46-8e82-4461e35d9266 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:12.668362 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abc720-d562-4b46-8e82-4461e35d9266 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:12.668856 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abc720-d562-4b46-8e82-4461e35d9266 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:12.670064 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26c1b4-8d7a-4453-b887-9b5a3a303d06 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:12.670336 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22abc720-d562-4b46-8e82-4461e35d9266 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:12.672314 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22abc720-d562-4b46-8e82-4461e35d9266 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:12.675091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 74/154] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:02:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:12.676095 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22abc720-d562-4b46-8e82-4461e35d9266 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:12.726131 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d621bc-bf46-4ce2-8ca2-5a16ae645ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:12.727687 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d621bc-bf46-4ce2-8ca2-5a16ae645ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:12.728103 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d621bc-bf46-4ce2-8ca2-5a16ae645ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:12.728631 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d621bc-bf46-4ce2-8ca2-5a16ae645ee2 None admin] PATH_INFO: `/v3/users/dbf5aa0cc934479191a679aa5d44ed32` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:12.731549 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d621bc-bf46-4ce2-8ca2-5a16ae645ee2 None admin] RBAC: Authorizing `identity:get_user(user_id=dbf5aa0cc934479191a679aa5d44ed32)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:12.734284 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d621bc-bf46-4ce2-8ca2-5a16ae645ee2 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:12.736186 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 81/155] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:02:12 2022] GET /identity/v3/users/dbf5aa0cc934479191a679aa5d44ed32 => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:12.737180 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d621bc-bf46-4ce2-8ca2-5a16ae645ee2 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:12.823278 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22abc720-d562-4b46-8e82-4461e35d9266 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:12.839894 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:12.868634 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d621bc-bf46-4ce2-8ca2-5a16ae645ee2 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:12.872473 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db5712-6773-44a1-95b5-072e752451f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:12.873298 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db5712-6773-44a1-95b5-072e752451f9 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:12.873794 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db5712-6773-44a1-95b5-072e752451f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:12.874208 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db5712-6773-44a1-95b5-072e752451f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:12.878244 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:12.890451 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db5712-6773-44a1-95b5-072e752451f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:12.898235 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-90db5712-6773-44a1-95b5-072e752451f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:02:12.898235 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:12.898235 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:12.898235 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:12.898235 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:12.898235 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:12.898235 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:12.898235 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:12.898235 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:12.898235 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:12.898235 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:12.898235 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:12.898235 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:12.898235 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:12.898235 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:12.898235 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:12.899538 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:12.899538 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:12.899538 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:12.899538 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:12.899538 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:12.899538 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:12.899538 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:12.899538 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:12.899538 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:12.899538 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:12.899538 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:12.899538 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:12.899538 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:12.899538 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:12.899538 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:12.899538 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:12.900403 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:12.900403 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:12.900403 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:12.900403 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:12.900403 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:12.900403 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:12.900403 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:12.900403 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:12.900403 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:12.900403 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:12.900403 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:02:12.900403 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:02:12.900976 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 75/156] 10.222.0.60 () {56 vars in 1096 bytes} [Sun Jul 31 01:02:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:12.901890 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db5712-6773-44a1-95b5-072e752451f9 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:12.914508 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078590b-017a-4b2d-932c-8d1dd8f39669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:12.915413 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078590b-017a-4b2d-932c-8d1dd8f39669 None admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:12.915857 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078590b-017a-4b2d-932c-8d1dd8f39669 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:12.916258 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078590b-017a-4b2d-932c-8d1dd8f39669 None admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:12.917077 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078590b-017a-4b2d-932c-8d1dd8f39669 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:12.918713 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078590b-017a-4b2d-932c-8d1dd8f39669 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:12.947282 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 82/157] 10.222.0.60 () {60 vars in 1132 bytes} [Sun Jul 31 01:02:12 2022] POST /identity/v3/users => generated 283 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:02:12.948457 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078590b-017a-4b2d-932c-8d1dd8f39669 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:13.073105 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078590b-017a-4b2d-932c-8d1dd8f39669 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:13.095269 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db5712-6773-44a1-95b5-072e752451f9 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:13.114969 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83e69f-fc67-4716-b58e-120ff3064032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:13.116300 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83e69f-fc67-4716-b58e-120ff3064032 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:13.116759 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83e69f-fc67-4716-b58e-120ff3064032 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:13.117191 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83e69f-fc67-4716-b58e-120ff3064032 None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:13.118731 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e83e69f-fc67-4716-b58e-120ff3064032 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:13.119241 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e83e69f-fc67-4716-b58e-120ff3064032 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:13.123024 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e83e69f-fc67-4716-b58e-120ff3064032 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:13.125213 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:13.136777 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 83/158] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:02:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:13.145388 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83e69f-fc67-4716-b58e-120ff3064032 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:13.178744 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc11025-da86-4479-9333-d8175db85587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:13.179391 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc11025-da86-4479-9333-d8175db85587 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:13.180494 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc11025-da86-4479-9333-d8175db85587 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:13.180774 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc11025-da86-4479-9333-d8175db85587 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:13.297284 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:13.306300 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc11025-da86-4479-9333-d8175db85587 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:13.308139 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc11025-da86-4479-9333-d8175db85587 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:13.326622 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83e69f-fc67-4716-b58e-120ff3064032 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:13.381480 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573593b-b242-4118-bc9a-36228af2cb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:13.382724 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573593b-b242-4118-bc9a-36228af2cb58 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:13.383707 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573593b-b242-4118-bc9a-36228af2cb58 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:13.384211 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573593b-b242-4118-bc9a-36228af2cb58 None admin] PATH_INFO: `/v3/users/652828201b9e47a5b54a3c3110e80fd8` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:13.386055 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5573593b-b242-4118-bc9a-36228af2cb58 None admin] RBAC: Authorizing `identity:get_user(user_id=652828201b9e47a5b54a3c3110e80fd8)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:13.388079 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5573593b-b242-4118-bc9a-36228af2cb58 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:13.390878 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 84/159] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:02:13 2022] GET /identity/v3/users/652828201b9e47a5b54a3c3110e80fd8 => generated 247 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:13.392727 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35cc19-c63c-4ae0-a22f-d8b8b3db0e12 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:13.393473 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35cc19-c63c-4ae0-a22f-d8b8b3db0e12 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:13.394308 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35cc19-c63c-4ae0-a22f-d8b8b3db0e12 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:13.398201 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 85/160] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:13.399157 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa35cc19-c63c-4ae0-a22f-d8b8b3db0e12 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:13.453752 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 76/161] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:02:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:02:13.455862 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513fa6ff-711c-4e03-96ba-a910c15b6d5b None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:13.456487 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513fa6ff-711c-4e03-96ba-a910c15b6d5b None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:13.457049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513fa6ff-711c-4e03-96ba-a910c15b6d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:13.478366 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:13.483752 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-513fa6ff-711c-4e03-96ba-a910c15b6d5b None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:13.484868 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-513fa6ff-711c-4e03-96ba-a910c15b6d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:13.527664 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa35cc19-c63c-4ae0-a22f-d8b8b3db0e12 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:13.566762 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 77/162] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:02:13.568051 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513fa6ff-711c-4e03-96ba-a910c15b6d5b None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:13.571642 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59678a98-885f-44b6-9ac8-23dbdf62f4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:13.572970 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59678a98-885f-44b6-9ac8-23dbdf62f4cf None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:13.572970 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59678a98-885f-44b6-9ac8-23dbdf62f4cf None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:13.572970 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59678a98-885f-44b6-9ac8-23dbdf62f4cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:13.600775 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:13.663019 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59678a98-885f-44b6-9ac8-23dbdf62f4cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:13.664459 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59678a98-885f-44b6-9ac8-23dbdf62f4cf None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:13.701830 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513fa6ff-711c-4e03-96ba-a910c15b6d5b None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:13.746479 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00cf10-9f1a-4e92-b133-896163102481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:13.747143 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00cf10-9f1a-4e92-b133-896163102481 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:13.747424 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00cf10-9f1a-4e92-b133-896163102481 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:13.747733 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00cf10-9f1a-4e92-b133-896163102481 None admin] PATH_INFO: `/v3/projects/882624ffe602494b95664e06c16d55a2` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:13.748910 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00cf10-9f1a-4e92-b133-896163102481 None admin] RBAC: Authorizing `identity:get_project(project_id=882624ffe602494b95664e06c16d55a2)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:13.750407 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00cf10-9f1a-4e92-b133-896163102481 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:13.751601 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:13.752761 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 78/163] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:02:13 2022] GET /identity/v3/projects/882624ffe602494b95664e06c16d55a2 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:13.753257 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00cf10-9f1a-4e92-b133-896163102481 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:13.797489 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 86/164] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:02:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:02:13.799084 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a8a05-0f69-4c5d-bd00-73d339f510fd None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:13.799441 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a8a05-0f69-4c5d-bd00-73d339f510fd None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:13.799830 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a8a05-0f69-4c5d-bd00-73d339f510fd None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:13.801261 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 87/165] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:13.802241 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a8a05-0f69-4c5d-bd00-73d339f510fd None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:13.865563 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:13.874647 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00cf10-9f1a-4e92-b133-896163102481 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:13.918040 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49fdf3b-74c1-4515-87e8-776b1c7092fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:13.918621 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49fdf3b-74c1-4515-87e8-776b1c7092fd None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:13.918901 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49fdf3b-74c1-4515-87e8-776b1c7092fd None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:13.919172 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49fdf3b-74c1-4515-87e8-776b1c7092fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:13.924993 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a8a05-0f69-4c5d-bd00-73d339f510fd None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:13.931786 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49fdf3b-74c1-4515-87e8-776b1c7092fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:13.936892 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-a49fdf3b-74c1-4515-87e8-776b1c7092fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:02:13.936892 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:13.936892 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:13.936892 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:13.936892 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:13.936892 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:13.936892 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:13.936892 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:13.936892 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:13.936892 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:13.936892 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:13.936892 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:13.936892 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:13.936892 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:13.936892 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:13.936892 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:13.937842 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:13.937842 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:13.937842 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:13.937842 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:13.937842 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:13.937842 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:13.937842 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:13.937842 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:13.937842 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:13.937842 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:13.937842 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:13.937842 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:13.937842 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:13.937842 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:13.937842 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:13.937842 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:13.938868 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:13.938868 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:13.938868 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:13.938868 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:13.938868 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:13.938868 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:13.938868 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:13.938868 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:13.938868 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:13.938868 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:13.938868 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:02:13.938868 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:02:13.938868 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 79/166] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:02:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:13.939538 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49fdf3b-74c1-4515-87e8-776b1c7092fd None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:13.980688 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e702fb-0422-46aa-9f02-1bef585bd11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:13.982071 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e702fb-0422-46aa-9f02-1bef585bd11f None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:13.982536 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e702fb-0422-46aa-9f02-1bef585bd11f None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:13.982959 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e702fb-0422-46aa-9f02-1bef585bd11f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:13.984640 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e702fb-0422-46aa-9f02-1bef585bd11f None admin] RBAC: Adding query filter params (role.id=8272ca656a1f41379f9acf1ea055fb4d, scope.project.id=882624ffe602494b95664e06c16d55a2, user.id=dbf5aa0cc934479191a679aa5d44ed32) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:13.985124 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e702fb-0422-46aa-9f02-1bef585bd11f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:13.987010 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e702fb-0422-46aa-9f02-1bef585bd11f None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:13.994932 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 88/167] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:02:13 2022] GET /identity/v3/role_assignments?user.id=dbf5aa0cc934479191a679aa5d44ed32&scope.project.id=882624ffe602494b95664e06c16d55a2&role.id=8272ca656a1f41379f9acf1ea055fb4d => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:13.996909 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b1695-3c42-4a7c-b086-8568fd22afe5 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:13.997363 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b1695-3c42-4a7c-b086-8568fd22afe5 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:13.997837 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b1695-3c42-4a7c-b086-8568fd22afe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:14.021899 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-e22b1695-3c42-4a7c-b086-8568fd22afe5 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:14.023956 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-e22b1695-3c42-4a7c-b086-8568fd22afe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:14.093626 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:14.133087 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49fdf3b-74c1-4515-87e8-776b1c7092fd None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:14.186467 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 89/168] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:02:14.187580 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b1695-3c42-4a7c-b086-8568fd22afe5 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:14.201547 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad9032-9729-4d0f-874f-22c06071928a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:14.202231 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad9032-9729-4d0f-874f-22c06071928a None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:14.202507 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad9032-9729-4d0f-874f-22c06071928a None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:14.202835 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad9032-9729-4d0f-874f-22c06071928a None admin] PATH_INFO: `/v3/projects/882624ffe602494b95664e06c16d55a2` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:14.204117 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad9032-9729-4d0f-874f-22c06071928a None admin] RBAC: Authorizing `identity:get_project(project_id=882624ffe602494b95664e06c16d55a2)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:14.206603 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad9032-9729-4d0f-874f-22c06071928a None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:14.207545 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 80/169] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:02:13 2022] GET /identity/v3/projects/882624ffe602494b95664e06c16d55a2 => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:14.216769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad9032-9729-4d0f-874f-22c06071928a None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:14.255217 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:14.394544 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad9032-9729-4d0f-874f-22c06071928a None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:14.400060 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b1695-3c42-4a7c-b086-8568fd22afe5 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:14.450816 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb780a-c8be-4b39-9e89-871a99eef5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:14.451379 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb780a-c8be-4b39-9e89-871a99eef5e4 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:14.451706 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb780a-c8be-4b39-9e89-871a99eef5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:14.451986 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb780a-c8be-4b39-9e89-871a99eef5e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:14.452867 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb780a-c8be-4b39-9e89-871a99eef5e4 None admin] RBAC: Adding query filter params (role.id=fef526a7d2e741ce995d107f3ac934ae, scope.project.id=882624ffe602494b95664e06c16d55a2, user.id=652828201b9e47a5b54a3c3110e80fd8) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:14.453186 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb780a-c8be-4b39-9e89-871a99eef5e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:14.454731 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb780a-c8be-4b39-9e89-871a99eef5e4 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:14.463957 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 81/170] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:02:14 2022] GET /identity/v3/role_assignments?user.id=652828201b9e47a5b54a3c3110e80fd8&scope.project.id=882624ffe602494b95664e06c16d55a2&role.id=fef526a7d2e741ce995d107f3ac934ae => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:14.464851 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb780a-c8be-4b39-9e89-871a99eef5e4 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:14.465040 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919072c-7699-489f-b25b-28e7aefc2d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:14.465790 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919072c-7699-489f-b25b-28e7aefc2d69 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:14.466064 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919072c-7699-489f-b25b-28e7aefc2d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:14.466333 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919072c-7699-489f-b25b-28e7aefc2d69 None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:14.467062 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0919072c-7699-489f-b25b-28e7aefc2d69 None admin] RBAC: Adding query filter params (name=member) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:14.467364 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0919072c-7699-489f-b25b-28e7aefc2d69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:14.468869 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0919072c-7699-489f-b25b-28e7aefc2d69 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:14.490363 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 90/171] 10.222.0.60 () {56 vars in 1101 bytes} [Sun Jul 31 01:02:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:14.496975 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919072c-7699-489f-b25b-28e7aefc2d69 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:14.535557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:14.607896 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:14.620262 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb780a-c8be-4b39-9e89-871a99eef5e4 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:14.636822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919072c-7699-489f-b25b-28e7aefc2d69 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:14.660687 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab9dee-3a32-4edc-a80c-3d147f77e19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:14.661447 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab9dee-3a32-4edc-a80c-3d147f77e19f None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:14.661776 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab9dee-3a32-4edc-a80c-3d147f77e19f None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:14.662053 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab9dee-3a32-4edc-a80c-3d147f77e19f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:14.671937 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c32b4-d803-4006-a3e1-f46b87c3201c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:14.672595 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c32b4-d803-4006-a3e1-f46b87c3201c None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:14.672868 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c32b4-d803-4006-a3e1-f46b87c3201c None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:14.673134 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c32b4-d803-4006-a3e1-f46b87c3201c None admin] PATH_INFO: `/v3/users/dbf5aa0cc934479191a679aa5d44ed32` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:14.674308 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9c32b4-d803-4006-a3e1-f46b87c3201c None admin] RBAC: Authorizing `identity:get_user(user_id=dbf5aa0cc934479191a679aa5d44ed32)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:14.674488 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ab9dee-3a32-4edc-a80c-3d147f77e19f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:14.675793 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9c32b4-d803-4006-a3e1-f46b87c3201c None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:14.677419 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 91/172] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:02:14 2022] GET /identity/v3/users/dbf5aa0cc934479191a679aa5d44ed32 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:02:14.680298 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-e4ab9dee-3a32-4edc-a80c-3d147f77e19f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 01:02:14.680298 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:14.680298 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:14.680298 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:14.680298 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:14.680298 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:14.680298 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:14.680298 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:14.680298 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:14.680298 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:14.680298 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:14.680298 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:14.680298 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:14.680298 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:14.680298 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:14.680298 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:14.681230 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:14.681230 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:14.681230 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:14.681230 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:14.681230 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:14.681230 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:14.681230 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:14.681230 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:14.681230 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:14.681230 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:14.681230 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:14.681230 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:14.681230 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:14.681230 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:14.681230 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:14.681230 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:14.682035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:14.682035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:14.682035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:14.682035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:14.682035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:14.682035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:14.682035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:14.682035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:14.682035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:14.682035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:14.682035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 01:02:14.682035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:02:14.682035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 82/173] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:02:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:14.687405 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c32b4-d803-4006-a3e1-f46b87c3201c None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:14.688872 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab9dee-3a32-4edc-a80c-3d147f77e19f None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:14.832874 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:14.857698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c32b4-d803-4006-a3e1-f46b87c3201c None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:14.872175 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab9dee-3a32-4edc-a80c-3d147f77e19f None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:14.935047 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824191ff-2eb8-45be-b072-dfce448ddd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:14.935749 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824191ff-2eb8-45be-b072-dfce448ddd18 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:14.936034 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824191ff-2eb8-45be-b072-dfce448ddd18 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:14.936309 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824191ff-2eb8-45be-b072-dfce448ddd18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:14.952818 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540f6ac-1817-4aba-9946-340637279ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:14.953471 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540f6ac-1817-4aba-9946-340637279ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:14.953750 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540f6ac-1817-4aba-9946-340637279ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:14.954023 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540f6ac-1817-4aba-9946-340637279ae5 None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:14.954766 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a540f6ac-1817-4aba-9946-340637279ae5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:14.955067 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a540f6ac-1817-4aba-9946-340637279ae5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:14.956686 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a540f6ac-1817-4aba-9946-340637279ae5 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:14.972138 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 83/174] 10.222.0.60 () {56 vars in 1101 bytes} [Sun Jul 31 01:02:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:14.976486 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540f6ac-1817-4aba-9946-340637279ae5 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:14.994070 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:15.064603 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824191ff-2eb8-45be-b072-dfce448ddd18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:15.066263 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824191ff-2eb8-45be-b072-dfce448ddd18 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:15.168730 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540f6ac-1817-4aba-9946-340637279ae5 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:15.211891 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:15.234017 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 92/175] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:02:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:02:15.239521 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b22d72-6e10-49ec-bcda-677d977098aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:15.240198 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b22d72-6e10-49ec-bcda-677d977098aa None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:15.240478 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b22d72-6e10-49ec-bcda-677d977098aa None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:15.240754 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b22d72-6e10-49ec-bcda-677d977098aa None admin] PATH_INFO: `/v3/users/97bdfc2b9d1340a6827cccdc5cad631d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:15.242173 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824191ff-2eb8-45be-b072-dfce448ddd18 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:15.244643 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b22d72-6e10-49ec-bcda-677d977098aa None admin] RBAC: Authorizing `identity:get_user(user_id=97bdfc2b9d1340a6827cccdc5cad631d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:15.246120 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b22d72-6e10-49ec-bcda-677d977098aa None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:15.247791 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 84/176] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:02:14 2022] GET /identity/v3/users/97bdfc2b9d1340a6827cccdc5cad631d => generated 289 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:02:15.255145 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b22d72-6e10-49ec-bcda-677d977098aa None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:15.390906 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:15.423097 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824191ff-2eb8-45be-b072-dfce448ddd18 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:15.439831 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b22d72-6e10-49ec-bcda-677d977098aa None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:15.485256 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5064f-5496-48d0-893d-7b214cc404dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:15.485922 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5064f-5496-48d0-893d-7b214cc404dd None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:15.486202 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5064f-5496-48d0-893d-7b214cc404dd None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:15.486472 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5064f-5496-48d0-893d-7b214cc404dd None admin] PATH_INFO: `/v3/projects/d8a9a9026aa248499302aa92fbd6f911` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:15.492210 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee5064f-5496-48d0-893d-7b214cc404dd None admin] RBAC: Authorizing `identity:get_project(project_id=d8a9a9026aa248499302aa92fbd6f911)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:15.493689 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee5064f-5496-48d0-893d-7b214cc404dd None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:15.494434 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323fe6c-4bf1-4f05-bab0-19fb2df8f2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:15.495237 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323fe6c-4bf1-4f05-bab0-19fb2df8f2ec None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:15.495548 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 93/177] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:02:15 2022] GET /identity/v3/projects/d8a9a9026aa248499302aa92fbd6f911 => generated 312 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:15.496091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323fe6c-4bf1-4f05-bab0-19fb2df8f2ec None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:15.496500 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323fe6c-4bf1-4f05-bab0-19fb2df8f2ec None admin] PATH_INFO: `/v3/projects/882624ffe602494b95664e06c16d55a2` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:15.497832 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c323fe6c-4bf1-4f05-bab0-19fb2df8f2ec None admin] RBAC: Authorizing `identity:get_project(project_id=882624ffe602494b95664e06c16d55a2)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:15.499410 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c323fe6c-4bf1-4f05-bab0-19fb2df8f2ec None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:15.501395 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 85/178] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:02:15 2022] GET /identity/v3/projects/882624ffe602494b95664e06c16d55a2 => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:15.502762 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5064f-5496-48d0-893d-7b214cc404dd None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:15.516484 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323fe6c-4bf1-4f05-bab0-19fb2df8f2ec None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:15.608448 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:15.621320 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323fe6c-4bf1-4f05-bab0-19fb2df8f2ec None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:15.656975 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e1d64e-bf14-4f77-8d62-c0cf901cda14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:15.658140 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1d64e-bf14-4f77-8d62-c0cf901cda14 None admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:15.658614 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1d64e-bf14-4f77-8d62-c0cf901cda14 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:15.659102 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1d64e-bf14-4f77-8d62-c0cf901cda14 None admin] PATH_INFO: `/v3/projects/882624ffe602494b95664e06c16d55a2/users/97bdfc2b9d1340a6827cccdc5cad631d/roles/d902e34269cc4d79b49b0d035055c40b` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:15.661741 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e1d64e-bf14-4f77-8d62-c0cf901cda14 None admin] RBAC: Authorizing `identity:create_grant(project_id=882624ffe602494b95664e06c16d55a2, user_id=97bdfc2b9d1340a6827cccdc5cad631d, role_id=d902e34269cc4d79b49b0d035055c40b)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:15.663763 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e1d64e-bf14-4f77-8d62-c0cf901cda14 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:15.686125 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 86/179] 10.222.0.60 () {58 vars in 1439 bytes} [Sun Jul 31 01:02:15 2022] PUT /identity/v3/projects/882624ffe602494b95664e06c16d55a2/users/97bdfc2b9d1340a6827cccdc5cad631d/roles/d902e34269cc4d79b49b0d035055c40b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:02:15.694751 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5064f-5496-48d0-893d-7b214cc404dd None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:15.732905 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffab65f-816e-4667-924a-78642cfba45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:15.734092 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffab65f-816e-4667-924a-78642cfba45c None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:15.734579 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffab65f-816e-4667-924a-78642cfba45c None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:15.735123 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffab65f-816e-4667-924a-78642cfba45c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:15.736229 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffab65f-816e-4667-924a-78642cfba45c None admin] RBAC: Adding query filter params (role.id=12a8e2ae2b6b4d699aac9ba2319cf57d, scope.project.id=d8a9a9026aa248499302aa92fbd6f911, user.id=dbf5aa0cc934479191a679aa5d44ed32) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:15.736759 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffab65f-816e-4667-924a-78642cfba45c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:15.738500 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffab65f-816e-4667-924a-78642cfba45c None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:15.745981 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 94/180] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:02:15 2022] GET /identity/v3/role_assignments?user.id=dbf5aa0cc934479191a679aa5d44ed32&scope.project.id=d8a9a9026aa248499302aa92fbd6f911&role.id=12a8e2ae2b6b4d699aac9ba2319cf57d => generated 608 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:02:15.931718 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c567b-933f-439a-9fe2-7215156affe1 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:15.932458 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c567b-933f-439a-9fe2-7215156affe1 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:15.932966 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c567b-933f-439a-9fe2-7215156affe1 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:15.934615 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 87/181] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:15.942617 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832485d-88dd-4bdb-a2d5-a60a1960c713 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:15.942901 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832485d-88dd-4bdb-a2d5-a60a1960c713 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:15.943083 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832485d-88dd-4bdb-a2d5-a60a1960c713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:15.967411 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-e832485d-88dd-4bdb-a2d5-a60a1960c713 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:15.968677 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-e832485d-88dd-4bdb-a2d5-a60a1960c713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:16.047084 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 95/182] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:02:16.052971 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23049c68-46e9-4d74-a2da-1de33bbca6fb None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:16.053261 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23049c68-46e9-4d74-a2da-1de33bbca6fb None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:16.053538 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23049c68-46e9-4d74-a2da-1de33bbca6fb None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:16.055045 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 88/183] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:16.060314 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ad0ea-8d97-482e-8bad-eee29b3244e2 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:16.060812 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ad0ea-8d97-482e-8bad-eee29b3244e2 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:16.061272 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ad0ea-8d97-482e-8bad-eee29b3244e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:16.074964 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23049c68-46e9-4d74-a2da-1de33bbca6fb None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:16.081890 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-e12ad0ea-8d97-482e-8bad-eee29b3244e2 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:16.082715 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:16.083317 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-e12ad0ea-8d97-482e-8bad-eee29b3244e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:16.137561 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:16.171565 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 96/184] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:02:16.191185 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ad0ea-8d97-482e-8bad-eee29b3244e2 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:16.228729 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23049c68-46e9-4d74-a2da-1de33bbca6fb None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:16.264063 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70471db2-e146-4888-85c0-78ba5f44a4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:16.265116 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70471db2-e146-4888-85c0-78ba5f44a4e3 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:16.265897 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70471db2-e146-4888-85c0-78ba5f44a4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:16.266661 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70471db2-e146-4888-85c0-78ba5f44a4e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:16.282550 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70471db2-e146-4888-85c0-78ba5f44a4e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:16.288541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-70471db2-e146-4888-85c0-78ba5f44a4e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:02:16.288541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:16.288541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:16.288541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:16.288541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:16.288541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:16.288541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:16.288541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:16.288541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:16.288541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:16.288541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:16.288541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:16.288541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:16.288541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:16.288541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:16.288541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:16.289445 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:16.289445 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:16.289445 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:16.289445 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:16.289445 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:16.289445 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:16.289445 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:16.289445 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:16.289445 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:16.289445 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:16.289445 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:16.289445 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:16.289445 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:16.289445 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:16.289445 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:16.289445 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:16.290207 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:16.290207 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:16.290207 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:16.290207 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:16.290207 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:16.290207 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:16.290207 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:16.290207 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:16.290207 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:16.290207 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:16.290207 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:02:16.290207 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:02:16.292611 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 89/185] 10.222.0.60 () {56 vars in 1096 bytes} [Sun Jul 31 01:02:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:02:16.298661 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70471db2-e146-4888-85c0-78ba5f44a4e3 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:16.304698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ad0ea-8d97-482e-8bad-eee29b3244e2 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:16.340205 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a026c8f-5803-4f9e-8ca2-0c9aa806420f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:16.341277 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a026c8f-5803-4f9e-8ca2-0c9aa806420f None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:16.341798 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a026c8f-5803-4f9e-8ca2-0c9aa806420f None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:16.342303 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a026c8f-5803-4f9e-8ca2-0c9aa806420f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:16.353319 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a026c8f-5803-4f9e-8ca2-0c9aa806420f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:16.358654 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-7a026c8f-5803-4f9e-8ca2-0c9aa806420f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:02:16.358654 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:16.358654 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:16.358654 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:16.358654 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:16.358654 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:16.358654 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:16.358654 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:16.358654 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:16.358654 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:16.358654 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:16.358654 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:16.358654 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:16.358654 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:16.358654 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:16.358654 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:16.359639 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:16.359639 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:16.359639 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:16.359639 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:16.359639 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:16.359639 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:16.359639 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:16.359639 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:16.359639 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:16.359639 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:16.359639 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:16.359639 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:16.359639 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:16.359639 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:16.359639 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:16.359639 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:16.360488 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:16.360488 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:16.360488 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:16.360488 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:16.360488 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:16.360488 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:16.360488 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:16.360488 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:16.360488 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:16.360488 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:16.360488 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:02:16.360488 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:02:16.363212 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 97/186] 10.222.0.60 () {56 vars in 1114 bytes} [Sun Jul 31 01:02:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:02:16.368894 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a026c8f-5803-4f9e-8ca2-0c9aa806420f None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:16.383911 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:16.420433 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:16.428703 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70471db2-e146-4888-85c0-78ba5f44a4e3 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:16.464795 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115de444-4bf1-41cc-8124-18e6ead1cf50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:16.465438 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115de444-4bf1-41cc-8124-18e6ead1cf50 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:16.465714 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115de444-4bf1-41cc-8124-18e6ead1cf50 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:16.465979 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115de444-4bf1-41cc-8124-18e6ead1cf50 None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:16.466697 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115de444-4bf1-41cc-8124-18e6ead1cf50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:16.466997 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115de444-4bf1-41cc-8124-18e6ead1cf50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:16.468453 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115de444-4bf1-41cc-8124-18e6ead1cf50 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:16.472179 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a026c8f-5803-4f9e-8ca2-0c9aa806420f None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:16.480805 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 90/187] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:02:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:16.480805 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21814cd9-09dd-4cac-860d-4e8d89663554 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:16.480805 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21814cd9-09dd-4cac-860d-4e8d89663554 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:16.480805 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21814cd9-09dd-4cac-860d-4e8d89663554 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:16.480805 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 91/188] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:16.484211 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21814cd9-09dd-4cac-860d-4e8d89663554 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:16.515596 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea576544-284d-44aa-9514-c47f8c5a926e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:16.516200 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea576544-284d-44aa-9514-c47f8c5a926e None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:16.516478 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea576544-284d-44aa-9514-c47f8c5a926e None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:16.516745 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea576544-284d-44aa-9514-c47f8c5a926e None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:16.517464 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea576544-284d-44aa-9514-c47f8c5a926e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:16.517763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea576544-284d-44aa-9514-c47f8c5a926e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:16.519144 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea576544-284d-44aa-9514-c47f8c5a926e None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:16.532080 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 98/189] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:02:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:02:16.532080 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab0ebd-6fbd-4b34-aae1-9696ae681b77 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:16.532080 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab0ebd-6fbd-4b34-aae1-9696ae681b77 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:16.532080 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab0ebd-6fbd-4b34-aae1-9696ae681b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:16.547905 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-46ab0ebd-6fbd-4b34-aae1-9696ae681b77 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:16.549090 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-46ab0ebd-6fbd-4b34-aae1-9696ae681b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:16.593867 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21814cd9-09dd-4cac-860d-4e8d89663554 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:16.619768 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:16.624709 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 99/190] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:02:16.625611 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab0ebd-6fbd-4b34-aae1-9696ae681b77 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:16.636606 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c639a8c-46c3-4ea3-b0cf-c9871a903239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:16.638022 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c639a8c-46c3-4ea3-b0cf-c9871a903239 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:16.638839 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c639a8c-46c3-4ea3-b0cf-c9871a903239 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:16.639311 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c639a8c-46c3-4ea3-b0cf-c9871a903239 None admin] PATH_INFO: `/v3/users/4a88747d1abd439bb1c225d264d1521b` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:16.657360 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:16.657972 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c639a8c-46c3-4ea3-b0cf-c9871a903239 None admin] RBAC: Authorizing `identity:get_user(user_id=4a88747d1abd439bb1c225d264d1521b)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:16.659981 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c639a8c-46c3-4ea3-b0cf-c9871a903239 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:16.667650 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 92/191] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:02:16 2022] GET /identity/v3/users/4a88747d1abd439bb1c225d264d1521b => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:16.668474 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c639a8c-46c3-4ea3-b0cf-c9871a903239 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:16.732470 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab0ebd-6fbd-4b34-aae1-9696ae681b77 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:16.769698 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c639a8c-46c3-4ea3-b0cf-c9871a903239 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:16.770096 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0420ddf-3d8e-4fee-94b7-f698e34c76f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:16.770746 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0420ddf-3d8e-4fee-94b7-f698e34c76f8 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:16.771126 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0420ddf-3d8e-4fee-94b7-f698e34c76f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:16.771313 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0420ddf-3d8e-4fee-94b7-f698e34c76f8 None admin] PATH_INFO: `/v3/users/4a88747d1abd439bb1c225d264d1521b` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:16.772497 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0420ddf-3d8e-4fee-94b7-f698e34c76f8 None admin] RBAC: Authorizing `identity:get_user(user_id=4a88747d1abd439bb1c225d264d1521b)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:16.773928 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0420ddf-3d8e-4fee-94b7-f698e34c76f8 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:16.775553 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 100/192] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:02:16 2022] GET /identity/v3/users/4a88747d1abd439bb1c225d264d1521b => generated 283 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:16.777445 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0420ddf-3d8e-4fee-94b7-f698e34c76f8 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:16.805127 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3d7c8-0611-47b5-9e49-fc896f0d740f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:16.805779 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3d7c8-0611-47b5-9e49-fc896f0d740f None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:16.806054 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3d7c8-0611-47b5-9e49-fc896f0d740f None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:16.806319 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3d7c8-0611-47b5-9e49-fc896f0d740f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:16.807448 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d3d7c8-0611-47b5-9e49-fc896f0d740f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:16.808910 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d3d7c8-0611-47b5-9e49-fc896f0d740f None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:16.810503 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 93/193] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:02:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:16.811246 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3d7c8-0611-47b5-9e49-fc896f0d740f None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:16.863899 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:16.896504 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:16.900242 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0420ddf-3d8e-4fee-94b7-f698e34c76f8 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:16.910519 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3d7c8-0611-47b5-9e49-fc896f0d740f None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:16.934840 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b2a52-f8b2-473a-bf8a-68c7dffbc7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:16.935460 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b2a52-f8b2-473a-bf8a-68c7dffbc7f7 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:16.935778 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b2a52-f8b2-473a-bf8a-68c7dffbc7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:16.936046 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b2a52-f8b2-473a-bf8a-68c7dffbc7f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:16.946652 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4281f-4a6a-40c0-aeb5-5b9efacba538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:16.947612 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4281f-4a6a-40c0-aeb5-5b9efacba538 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:16.948046 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4281f-4a6a-40c0-aeb5-5b9efacba538 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:16.948319 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4281f-4a6a-40c0-aeb5-5b9efacba538 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:17.018582 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026b2a52-f8b2-473a-bf8a-68c7dffbc7f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:17.020000 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026b2a52-f8b2-473a-bf8a-68c7dffbc7f7 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:17.021031 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4281f-4a6a-40c0-aeb5-5b9efacba538 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:17.022506 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4281f-4a6a-40c0-aeb5-5b9efacba538 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:17.079359 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:17.119511 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:17.123065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 101/194] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:02:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:02:17.123978 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b2a52-f8b2-473a-bf8a-68c7dffbc7f7 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:17.135227 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 94/195] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:02:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:02:17.136340 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4281f-4a6a-40c0-aeb5-5b9efacba538 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:17.238215 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b2a52-f8b2-473a-bf8a-68c7dffbc7f7 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:17.242172 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4281f-4a6a-40c0-aeb5-5b9efacba538 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:17.275806 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4007a7-3130-42df-b3ae-c0734b9d3b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:17.276384 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4007a7-3130-42df-b3ae-c0734b9d3b7d None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:17.276661 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4007a7-3130-42df-b3ae-c0734b9d3b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:17.276936 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4007a7-3130-42df-b3ae-c0734b9d3b7d None admin] PATH_INFO: `/v3/projects/7c49b7e2947f42c096eb6b5a5fca321a` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:17.277991 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18cc9ae-ba19-496c-992d-ed0af8681a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:17.278115 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4007a7-3130-42df-b3ae-c0734b9d3b7d None admin] RBAC: Authorizing `identity:get_project(project_id=7c49b7e2947f42c096eb6b5a5fca321a)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:17.278612 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cc9ae-ba19-496c-992d-ed0af8681a63 None admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:17.278884 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cc9ae-ba19-496c-992d-ed0af8681a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:17.279149 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cc9ae-ba19-496c-992d-ed0af8681a63 None admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:17.279545 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4007a7-3130-42df-b3ae-c0734b9d3b7d None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:17.279855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18cc9ae-ba19-496c-992d-ed0af8681a63 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:17.281447 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 95/196] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:02:17 2022] GET /identity/v3/projects/7c49b7e2947f42c096eb6b5a5fca321a => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:17.281546 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18cc9ae-ba19-496c-992d-ed0af8681a63 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:17.286822 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4007a7-3130-42df-b3ae-c0734b9d3b7d None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:17.305599 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 102/197] 10.222.0.60 () {60 vars in 1132 bytes} [Sun Jul 31 01:02:17 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:02:17.306425 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18cc9ae-ba19-496c-992d-ed0af8681a63 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:17.310295 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:17.383992 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:17.419994 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4007a7-3130-42df-b3ae-c0734b9d3b7d None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:17.436879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18cc9ae-ba19-496c-992d-ed0af8681a63 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:17.458409 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa35df-36d2-4702-8a8b-2222f2d87eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:17.459355 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa35df-36d2-4702-8a8b-2222f2d87eff None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:17.459797 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa35df-36d2-4702-8a8b-2222f2d87eff None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:17.460299 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa35df-36d2-4702-8a8b-2222f2d87eff None admin] PATH_INFO: `/v3/projects/7c49b7e2947f42c096eb6b5a5fca321a` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:17.461715 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa35df-36d2-4702-8a8b-2222f2d87eff None admin] RBAC: Authorizing `identity:get_project(project_id=7c49b7e2947f42c096eb6b5a5fca321a)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:17.463376 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa35df-36d2-4702-8a8b-2222f2d87eff None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:17.465658 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 96/198] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:02:17 2022] GET /identity/v3/projects/7c49b7e2947f42c096eb6b5a5fca321a => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:17.472088 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa35df-36d2-4702-8a8b-2222f2d87eff None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:17.482790 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23bc256-56bb-42fb-ac0a-b362fd2ddec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:17.483424 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23bc256-56bb-42fb-ac0a-b362fd2ddec0 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:17.483729 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23bc256-56bb-42fb-ac0a-b362fd2ddec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:17.484128 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23bc256-56bb-42fb-ac0a-b362fd2ddec0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:17.484924 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23bc256-56bb-42fb-ac0a-b362fd2ddec0 None admin] RBAC: Adding query filter params (role.id=fef526a7d2e741ce995d107f3ac934ae, scope.project.id=7c49b7e2947f42c096eb6b5a5fca321a, user.id=4a88747d1abd439bb1c225d264d1521b) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:17.485229 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23bc256-56bb-42fb-ac0a-b362fd2ddec0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:17.486675 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23bc256-56bb-42fb-ac0a-b362fd2ddec0 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:17.493004 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 103/199] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:02:17 2022] GET /identity/v3/role_assignments?user.id=4a88747d1abd439bb1c225d264d1521b&scope.project.id=7c49b7e2947f42c096eb6b5a5fca321a&role.id=fef526a7d2e741ce995d107f3ac934ae => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:17.580137 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:17.596193 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa35df-36d2-4702-8a8b-2222f2d87eff None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:17.638529 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c2bd3-9213-43fd-b714-58d9e0e37201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:17.639178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c2bd3-9213-43fd-b714-58d9e0e37201 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:17.639453 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c2bd3-9213-43fd-b714-58d9e0e37201 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:17.639751 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c2bd3-9213-43fd-b714-58d9e0e37201 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:17.640658 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c2bd3-9213-43fd-b714-58d9e0e37201 None admin] RBAC: Adding query filter params (role.id=8272ca656a1f41379f9acf1ea055fb4d, scope.project.id=7c49b7e2947f42c096eb6b5a5fca321a, user.id=4a88747d1abd439bb1c225d264d1521b) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:17.640964 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c2bd3-9213-43fd-b714-58d9e0e37201 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:17.642449 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c2bd3-9213-43fd-b714-58d9e0e37201 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:17.653074 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 97/200] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:02:17 2022] GET /identity/v3/role_assignments?user.id=4a88747d1abd439bb1c225d264d1521b&scope.project.id=7c49b7e2947f42c096eb6b5a5fca321a&role.id=8272ca656a1f41379f9acf1ea055fb4d => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:17.927596 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca9fa1-7662-47c7-90e4-76b513778152 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:17.927872 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca9fa1-7662-47c7-90e4-76b513778152 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:17.928148 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca9fa1-7662-47c7-90e4-76b513778152 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:17.929803 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 104/201] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:17.935043 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a131a5c-04a2-431a-a920-dabdb41e66b6 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:17.935606 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a131a5c-04a2-431a-a920-dabdb41e66b6 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:17.936066 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a131a5c-04a2-431a-a920-dabdb41e66b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:17.964556 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-6a131a5c-04a2-431a-a920-dabdb41e66b6 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:17.965774 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-6a131a5c-04a2-431a-a920-dabdb41e66b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:18.049169 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 98/202] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:02:18.071635 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca9fa1-7662-47c7-90e4-76b513778152 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:18.187731 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca9fa1-7662-47c7-90e4-76b513778152 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:18.207627 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:18.228516 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff205da-caad-488c-ace4-8afdebb350d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:18.229131 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff205da-caad-488c-ace4-8afdebb350d3 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:18.229404 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff205da-caad-488c-ace4-8afdebb350d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:18.229673 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff205da-caad-488c-ace4-8afdebb350d3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:18.247315 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff205da-caad-488c-ace4-8afdebb350d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:18.253476 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-aff205da-caad-488c-ace4-8afdebb350d3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 01:02:18.253476 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:18.253476 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:18.253476 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:18.253476 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:18.253476 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:18.253476 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:18.253476 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:18.253476 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:18.253476 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:18.253476 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:18.253476 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:18.253476 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:18.253476 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:18.253476 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:18.253476 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:18.254443 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:18.254443 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:18.254443 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:18.254443 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:18.254443 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:18.254443 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:18.254443 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:18.254443 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:18.254443 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:18.254443 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:18.254443 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:18.254443 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:18.254443 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:18.254443 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:18.254443 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:18.254443 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:18.255234 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:18.255234 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:18.255234 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:18.255234 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:18.255234 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:18.255234 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:18.255234 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:18.255234 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:18.255234 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:18.255234 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:18.255234 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 01:02:18.255234 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:02:18.255234 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 105/203] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:02:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:18.260636 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a131a5c-04a2-431a-a920-dabdb41e66b6 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:18.352123 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:18.379817 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a131a5c-04a2-431a-a920-dabdb41e66b6 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:18.415712 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f9417-7d54-407d-bb94-fe9fd81d96ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:18.416346 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f9417-7d54-407d-bb94-fe9fd81d96ec None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:18.416623 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f9417-7d54-407d-bb94-fe9fd81d96ec None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:18.416951 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f9417-7d54-407d-bb94-fe9fd81d96ec None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:18.417684 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f9417-7d54-407d-bb94-fe9fd81d96ec None admin] RBAC: Adding query filter params (name=reader) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:18.418036 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f9417-7d54-407d-bb94-fe9fd81d96ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:18.419443 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f9417-7d54-407d-bb94-fe9fd81d96ec None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:18.428335 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 99/204] 10.222.0.60 () {56 vars in 1101 bytes} [Sun Jul 31 01:02:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:18.434108 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff205da-caad-488c-ace4-8afdebb350d3 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:18.542295 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff205da-caad-488c-ace4-8afdebb350d3 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:18.582027 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e176554-c998-4388-9cd1-1323330e88b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:18.583035 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e176554-c998-4388-9cd1-1323330e88b2 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:18.583563 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e176554-c998-4388-9cd1-1323330e88b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:18.584038 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e176554-c998-4388-9cd1-1323330e88b2 None admin] PATH_INFO: `/v3/users/97bdfc2b9d1340a6827cccdc5cad631d` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:18.585462 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e176554-c998-4388-9cd1-1323330e88b2 None admin] RBAC: Authorizing `identity:get_user(user_id=97bdfc2b9d1340a6827cccdc5cad631d)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:18.587105 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e176554-c998-4388-9cd1-1323330e88b2 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:18.588976 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 106/205] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:02:18 2022] GET /identity/v3/users/97bdfc2b9d1340a6827cccdc5cad631d => generated 289 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:18.594751 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f9417-7d54-407d-bb94-fe9fd81d96ec None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:18.747073 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f9417-7d54-407d-bb94-fe9fd81d96ec None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:18.794934 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36915ec1-7156-4481-bf57-9b06fddfb942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:18.795476 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36915ec1-7156-4481-bf57-9b06fddfb942 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:18.795776 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36915ec1-7156-4481-bf57-9b06fddfb942 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:18.796045 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36915ec1-7156-4481-bf57-9b06fddfb942 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:18.819410 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:18.890980 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36915ec1-7156-4481-bf57-9b06fddfb942 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:18.892570 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36915ec1-7156-4481-bf57-9b06fddfb942 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:19.010794 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 100/206] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:02:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:02:19.016338 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e176554-c998-4388-9cd1-1323330e88b2 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:19.082611 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:19.134996 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e176554-c998-4388-9cd1-1323330e88b2 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:19.171211 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21015c-b723-47d1-b48f-2d79b311cc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:19.171916 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21015c-b723-47d1-b48f-2d79b311cc45 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:19.172191 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21015c-b723-47d1-b48f-2d79b311cc45 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:19.172459 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21015c-b723-47d1-b48f-2d79b311cc45 None admin] PATH_INFO: `/v3/projects/882624ffe602494b95664e06c16d55a2` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:19.173616 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b21015c-b723-47d1-b48f-2d79b311cc45 None admin] RBAC: Authorizing `identity:get_project(project_id=882624ffe602494b95664e06c16d55a2)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:19.175076 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b21015c-b723-47d1-b48f-2d79b311cc45 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:19.176778 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 107/207] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:02:19 2022] GET /identity/v3/projects/882624ffe602494b95664e06c16d55a2 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:19.188615 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36915ec1-7156-4481-bf57-9b06fddfb942 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:19.245659 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:19.311678 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36915ec1-7156-4481-bf57-9b06fddfb942 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:19.352291 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb23dfa-7488-45f4-9a7c-1024a073d072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:19.352845 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb23dfa-7488-45f4-9a7c-1024a073d072 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:19.353117 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb23dfa-7488-45f4-9a7c-1024a073d072 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:19.353387 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb23dfa-7488-45f4-9a7c-1024a073d072 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:19.354195 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb23dfa-7488-45f4-9a7c-1024a073d072 None admin] RBAC: Adding query filter params (role.id=d902e34269cc4d79b49b0d035055c40b, scope.project.id=882624ffe602494b95664e06c16d55a2, user.id=97bdfc2b9d1340a6827cccdc5cad631d) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:19.354498 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb23dfa-7488-45f4-9a7c-1024a073d072 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:19.355974 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb23dfa-7488-45f4-9a7c-1024a073d072 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:19.373699 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 101/208] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:02:19 2022] GET /identity/v3/role_assignments?user.id=97bdfc2b9d1340a6827cccdc5cad631d&scope.project.id=882624ffe602494b95664e06c16d55a2&role.id=d902e34269cc4d79b49b0d035055c40b => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:19.942044 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d290f-65c6-49b7-a7e6-33295dd40e72 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:19.942741 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d290f-65c6-49b7-a7e6-33295dd40e72 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:19.942741 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d290f-65c6-49b7-a7e6-33295dd40e72 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:19.944234 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 108/209] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:19.949458 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913579a3-64c0-46dd-a980-a65f8fdb8e4c None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:19.949989 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913579a3-64c0-46dd-a980-a65f8fdb8e4c None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:19.950461 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913579a3-64c0-46dd-a980-a65f8fdb8e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:19.971410 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-913579a3-64c0-46dd-a980-a65f8fdb8e4c None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:19.972986 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-913579a3-64c0-46dd-a980-a65f8fdb8e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:20.045465 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 102/210] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:02:20.049459 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb188e2e-88bd-4212-a1af-fc524e5f5ae1 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:20.049741 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb188e2e-88bd-4212-a1af-fc524e5f5ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:20.050008 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb188e2e-88bd-4212-a1af-fc524e5f5ae1 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:20.052576 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 109/211] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:20.056773 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b6424-8acc-4233-901a-62ee9945e43d None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:20.057058 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b6424-8acc-4233-901a-62ee9945e43d None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:20.057327 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b6424-8acc-4233-901a-62ee9945e43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:20.075843 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb188e2e-88bd-4212-a1af-fc524e5f5ae1 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:20.076025 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-9f5b6424-8acc-4233-901a-62ee9945e43d None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:20.077267 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-9f5b6424-8acc-4233-901a-62ee9945e43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:20.115630 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:20.157619 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 103/212] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:02:20.158879 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bfff6-bfe3-48e4-b790-7a7e50fd204f None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:20.159239 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bfff6-bfe3-48e4-b790-7a7e50fd204f None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:20.159818 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bfff6-bfe3-48e4-b790-7a7e50fd204f None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:20.161149 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 104/213] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:20.166233 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbde3a-336e-49b7-84eb-559d92327bc5 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:20.166582 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbde3a-336e-49b7-84eb-559d92327bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:20.166930 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbde3a-336e-49b7-84eb-559d92327bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:20.183876 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb188e2e-88bd-4212-a1af-fc524e5f5ae1 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:20.187255 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-20fbde3a-336e-49b7-84eb-559d92327bc5 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:20.188499 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-20fbde3a-336e-49b7-84eb-559d92327bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:20.199885 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:20.217666 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d6510-d468-4cbe-a9ca-b9627d5ed353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:20.218430 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d6510-d468-4cbe-a9ca-b9627d5ed353 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:20.218712 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d6510-d468-4cbe-a9ca-b9627d5ed353 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:20.218984 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d6510-d468-4cbe-a9ca-b9627d5ed353 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:20.229178 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d6510-d468-4cbe-a9ca-b9627d5ed353 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:20.234257 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-3e5d6510-d468-4cbe-a9ca-b9627d5ed353 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:02:20.234257 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:20.234257 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:20.234257 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:20.234257 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:20.234257 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:20.234257 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:20.234257 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:20.234257 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:20.234257 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:20.234257 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:20.234257 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:20.234257 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:20.234257 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:20.234257 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:20.234257 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:20.235144 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:20.235144 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:20.235144 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:20.235144 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:20.235144 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:20.235144 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:20.235144 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:20.235144 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:20.235144 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:20.235144 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:20.235144 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:20.235144 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:20.235144 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:20.235144 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:20.235144 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:20.235144 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:20.235946 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:20.235946 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:20.235946 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:20.235946 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:20.235946 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:20.235946 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:20.235946 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:20.235946 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:20.235946 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:20.235946 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:20.235946 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:02:20.235946 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:02:20.240342 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 110/214] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:02:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:02:20.241522 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2213ee-76f1-4333-b9e9-1b1a81f7f0ae None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:20.241807 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2213ee-76f1-4333-b9e9-1b1a81f7f0ae None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:20.242083 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2213ee-76f1-4333-b9e9-1b1a81f7f0ae None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:20.243384 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 111/215] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:20.244096 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2213ee-76f1-4333-b9e9-1b1a81f7f0ae None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:20.259350 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 105/216] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:02:20.264633 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fbde3a-336e-49b7-84eb-559d92327bc5 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:20.345411 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2213ee-76f1-4333-b9e9-1b1a81f7f0ae None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:20.362240 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:20.368501 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fbde3a-336e-49b7-84eb-559d92327bc5 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:20.380879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a82f0-8d7d-4eee-befa-a31ee0f9f0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:20.381532 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a82f0-8d7d-4eee-befa-a31ee0f9f0c6 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:20.381808 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a82f0-8d7d-4eee-befa-a31ee0f9f0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:20.382079 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a82f0-8d7d-4eee-befa-a31ee0f9f0c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:20.383225 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a82f0-8d7d-4eee-befa-a31ee0f9f0c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:20.384832 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a82f0-8d7d-4eee-befa-a31ee0f9f0c6 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:20.386629 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 112/217] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:02:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:20.387550 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6b6af-fa57-4d36-a2d2-94dc270fdf40 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:20.387812 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6b6af-fa57-4d36-a2d2-94dc270fdf40 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:20.388081 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6b6af-fa57-4d36-a2d2-94dc270fdf40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:20.403330 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b164c8-72b3-4b8d-a3e2-5290c441abd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:20.403994 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b164c8-72b3-4b8d-a3e2-5290c441abd6 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:20.404262 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b164c8-72b3-4b8d-a3e2-5290c441abd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:20.404540 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b164c8-72b3-4b8d-a3e2-5290c441abd6 None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:20.405261 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b164c8-72b3-4b8d-a3e2-5290c441abd6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:20.405449 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-abc6b6af-fa57-4d36-a2d2-94dc270fdf40 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:20.405542 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b164c8-72b3-4b8d-a3e2-5290c441abd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:20.406669 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-abc6b6af-fa57-4d36-a2d2-94dc270fdf40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:20.406951 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b164c8-72b3-4b8d-a3e2-5290c441abd6 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:20.415175 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 106/218] 10.222.0.60 () {56 vars in 1101 bytes} [Sun Jul 31 01:02:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:20.415822 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b164c8-72b3-4b8d-a3e2-5290c441abd6 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:20.444640 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:20.471050 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 113/219] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:02:20.472527 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6b6af-fa57-4d36-a2d2-94dc270fdf40 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:20.519470 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b164c8-72b3-4b8d-a3e2-5290c441abd6 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:20.553124 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2606c89-e057-4d64-a6ba-e947ac4ec35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:20.553769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2606c89-e057-4d64-a6ba-e947ac4ec35f None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:20.554035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2606c89-e057-4d64-a6ba-e947ac4ec35f None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:20.554303 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2606c89-e057-4d64-a6ba-e947ac4ec35f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:20.565360 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2606c89-e057-4d64-a6ba-e947ac4ec35f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:20.569804 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6b6af-fa57-4d36-a2d2-94dc270fdf40 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:20.570702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-a2606c89-e057-4d64-a6ba-e947ac4ec35f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:02:20.570702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:20.570702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:20.570702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:20.570702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:20.570702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:20.570702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:20.570702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:20.570702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:20.570702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:20.570702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:20.570702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:20.570702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:20.570702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:20.570702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:20.570702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:20.571655 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:20.571655 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:20.571655 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:20.571655 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:20.571655 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:20.571655 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:20.571655 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:20.571655 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:20.571655 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:20.571655 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:20.571655 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:20.571655 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:20.571655 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:20.571655 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:20.571655 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:20.571655 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:20.572458 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:20.572458 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:20.572458 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:20.572458 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:20.572458 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:20.572458 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:20.572458 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:20.572458 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:20.572458 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:20.572458 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:20.572458 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:02:20.572458 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:02:20.572458 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 107/220] 10.222.0.60 () {56 vars in 1114 bytes} [Sun Jul 31 01:02:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:20.573123 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2606c89-e057-4d64-a6ba-e947ac4ec35f None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:20.594135 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:20.606024 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4f571-ae12-4ac4-ab6f-c8ac95feeca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:20.606648 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4f571-ae12-4ac4-ab6f-c8ac95feeca8 None admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:20.606925 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4f571-ae12-4ac4-ab6f-c8ac95feeca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:20.607198 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4f571-ae12-4ac4-ab6f-c8ac95feeca8 None admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:20.607917 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba4f571-ae12-4ac4-ab6f-c8ac95feeca8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:20.609428 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba4f571-ae12-4ac4-ab6f-c8ac95feeca8 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:20.631744 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 114/221] 10.222.0.60 () {60 vars in 1132 bytes} [Sun Jul 31 01:02:20 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:02:20.632515 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4f571-ae12-4ac4-ab6f-c8ac95feeca8 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:20.666213 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:20.687191 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2606c89-e057-4d64-a6ba-e947ac4ec35f None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:20.726795 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb0391-65d7-4f12-9123-fef3db544ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:20.727370 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb0391-65d7-4f12-9123-fef3db544ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:20.727685 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb0391-65d7-4f12-9123-fef3db544ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:20.727963 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb0391-65d7-4f12-9123-fef3db544ac0 None admin] PATH_INFO: `/v3/users/cfedeefa365747b7abad05a53a8fa7e9` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:20.743671 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb0391-65d7-4f12-9123-fef3db544ac0 None admin] RBAC: Authorizing `identity:get_user(user_id=cfedeefa365747b7abad05a53a8fa7e9)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:20.743879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4f571-ae12-4ac4-ab6f-c8ac95feeca8 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:20.745167 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb0391-65d7-4f12-9123-fef3db544ac0 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:20.746950 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 108/222] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:02:20 2022] GET /identity/v3/users/cfedeefa365747b7abad05a53a8fa7e9 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:20.753071 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb0391-65d7-4f12-9123-fef3db544ac0 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:20.786631 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f57bec-ecd4-4015-aaa9-7edb9a88a7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:20.786631 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f57bec-ecd4-4015-aaa9-7edb9a88a7ac None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:20.786631 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f57bec-ecd4-4015-aaa9-7edb9a88a7ac None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:20.786631 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f57bec-ecd4-4015-aaa9-7edb9a88a7ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:20.802918 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f57bec-ecd4-4015-aaa9-7edb9a88a7ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:20.809981 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-00f57bec-ecd4-4015-aaa9-7edb9a88a7ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:02:20.809981 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:20.809981 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:20.809981 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:20.809981 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:20.809981 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:20.809981 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:20.809981 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:20.809981 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:20.809981 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:20.809981 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:20.809981 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:20.809981 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:20.809981 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:20.809981 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:20.809981 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:20.810866 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:20.810866 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:20.810866 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:20.810866 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:20.810866 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:20.810866 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:20.810866 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:20.810866 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:20.810866 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:20.810866 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:20.810866 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:20.810866 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:20.810866 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:20.810866 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:20.810866 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:20.810866 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:20.812022 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:20.812022 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:20.812022 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:20.812022 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:20.812022 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:20.812022 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:20.812022 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:20.812022 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:20.812022 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:20.812022 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:20.812022 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:02:20.812022 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:02:20.812022 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 115/223] 10.222.0.60 () {56 vars in 1096 bytes} [Sun Jul 31 01:02:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:20.812853 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f57bec-ecd4-4015-aaa9-7edb9a88a7ac None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:20.849551 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:20.878938 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb0391-65d7-4f12-9123-fef3db544ac0 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:20.923380 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed267c-0d2c-407e-924d-00093a216885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:20.923666 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed267c-0d2c-407e-924d-00093a216885 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:20.924008 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed267c-0d2c-407e-924d-00093a216885 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:20.924355 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed267c-0d2c-407e-924d-00093a216885 None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:20.925220 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed267c-0d2c-407e-924d-00093a216885 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:20.925588 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed267c-0d2c-407e-924d-00093a216885 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:20.926028 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:20.927176 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed267c-0d2c-407e-924d-00093a216885 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:20.937088 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 109/224] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:02:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:20.937935 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed267c-0d2c-407e-924d-00093a216885 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:20.938862 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f57bec-ecd4-4015-aaa9-7edb9a88a7ac None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:20.981844 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7c73a-422f-42dd-8795-13d29fdb6e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:20.982447 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7c73a-422f-42dd-8795-13d29fdb6e96 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:20.983023 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7c73a-422f-42dd-8795-13d29fdb6e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:20.983023 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7c73a-422f-42dd-8795-13d29fdb6e96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:21.054694 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7c73a-422f-42dd-8795-13d29fdb6e96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:21.056225 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7c73a-422f-42dd-8795-13d29fdb6e96 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:21.071263 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed267c-0d2c-407e-924d-00093a216885 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:21.115434 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374793cf-ddb3-4bc4-a6fb-16fc28e2812a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:21.116652 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374793cf-ddb3-4bc4-a6fb-16fc28e2812a None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:21.117534 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374793cf-ddb3-4bc4-a6fb-16fc28e2812a None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:21.117982 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374793cf-ddb3-4bc4-a6fb-16fc28e2812a None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:21.119148 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374793cf-ddb3-4bc4-a6fb-16fc28e2812a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:21.119724 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374793cf-ddb3-4bc4-a6fb-16fc28e2812a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:21.122092 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374793cf-ddb3-4bc4-a6fb-16fc28e2812a None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:21.134386 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 110/225] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:02:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:21.135428 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374793cf-ddb3-4bc4-a6fb-16fc28e2812a None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:21.151881 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:21.155049 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:21.169325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 116/226] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:02:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:02:21.170650 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7c73a-422f-42dd-8795-13d29fdb6e96 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:21.271616 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374793cf-ddb3-4bc4-a6fb-16fc28e2812a None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:21.286522 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7c73a-422f-42dd-8795-13d29fdb6e96 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:21.314409 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a7dd6-7adf-45c2-b72e-21bb8dde9073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:21.315064 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a7dd6-7adf-45c2-b72e-21bb8dde9073 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:21.315341 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a7dd6-7adf-45c2-b72e-21bb8dde9073 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:21.315654 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a7dd6-7adf-45c2-b72e-21bb8dde9073 None admin] PATH_INFO: `/v3/users/4a88747d1abd439bb1c225d264d1521b` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:21.317294 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a7dd6-7adf-45c2-b72e-21bb8dde9073 None admin] RBAC: Authorizing `identity:get_user(user_id=4a88747d1abd439bb1c225d264d1521b)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:21.319178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a7dd6-7adf-45c2-b72e-21bb8dde9073 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:21.325723 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 111/227] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:02:21 2022] GET /identity/v3/users/4a88747d1abd439bb1c225d264d1521b => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:21.325723 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a7dd6-7adf-45c2-b72e-21bb8dde9073 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:21.329682 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf007e-7a0c-43a2-9df0-8f913ff394fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:21.330653 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf007e-7a0c-43a2-9df0-8f913ff394fc None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:21.331152 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf007e-7a0c-43a2-9df0-8f913ff394fc None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:21.331652 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf007e-7a0c-43a2-9df0-8f913ff394fc None admin] PATH_INFO: `/v3/users/4a88747d1abd439bb1c225d264d1521b` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:21.333212 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf007e-7a0c-43a2-9df0-8f913ff394fc None admin] RBAC: Authorizing `identity:get_user(user_id=4a88747d1abd439bb1c225d264d1521b)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:21.334963 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf007e-7a0c-43a2-9df0-8f913ff394fc None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:21.337270 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 117/228] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:02:21 2022] GET /identity/v3/users/4a88747d1abd439bb1c225d264d1521b => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:21.338389 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf007e-7a0c-43a2-9df0-8f913ff394fc None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:21.411951 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:21.413663 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:21.446078 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a7dd6-7adf-45c2-b72e-21bb8dde9073 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:21.467289 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf007e-7a0c-43a2-9df0-8f913ff394fc None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:21.483618 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acddcef-415f-45a1-a256-e85143e19d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:21.484664 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acddcef-415f-45a1-a256-e85143e19d62 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:21.485163 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acddcef-415f-45a1-a256-e85143e19d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:21.485626 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acddcef-415f-45a1-a256-e85143e19d62 None admin] PATH_INFO: `/v3/projects/7c49b7e2947f42c096eb6b5a5fca321a` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:21.487009 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acddcef-415f-45a1-a256-e85143e19d62 None admin] RBAC: Authorizing `identity:get_project(project_id=7c49b7e2947f42c096eb6b5a5fca321a)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:21.488720 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acddcef-415f-45a1-a256-e85143e19d62 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:21.490992 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 112/229] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:02:21 2022] GET /identity/v3/projects/7c49b7e2947f42c096eb6b5a5fca321a => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:21.492118 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acddcef-415f-45a1-a256-e85143e19d62 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:21.509580 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc0b8d-d1ab-47e9-893f-5335f8c86e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:21.510241 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc0b8d-d1ab-47e9-893f-5335f8c86e0e None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:21.510516 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc0b8d-d1ab-47e9-893f-5335f8c86e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:21.510787 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc0b8d-d1ab-47e9-893f-5335f8c86e0e None admin] PATH_INFO: `/v3/projects/7c49b7e2947f42c096eb6b5a5fca321a` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:21.512236 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc0b8d-d1ab-47e9-893f-5335f8c86e0e None admin] RBAC: Authorizing `identity:get_project(project_id=7c49b7e2947f42c096eb6b5a5fca321a)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:21.514115 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc0b8d-d1ab-47e9-893f-5335f8c86e0e None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:21.515892 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 118/230] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:02:21 2022] GET /identity/v3/projects/7c49b7e2947f42c096eb6b5a5fca321a => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:21.519545 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc0b8d-d1ab-47e9-893f-5335f8c86e0e None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:21.610365 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acddcef-415f-45a1-a256-e85143e19d62 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:21.645523 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e13fd-73e4-4101-9665-3c4e8f87a447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:21.646340 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e13fd-73e4-4101-9665-3c4e8f87a447 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:21.646700 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e13fd-73e4-4101-9665-3c4e8f87a447 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:21.647042 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e13fd-73e4-4101-9665-3c4e8f87a447 None admin] PATH_INFO: `/v3/projects/7c49b7e2947f42c096eb6b5a5fca321a` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:21.648313 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e13fd-73e4-4101-9665-3c4e8f87a447 None admin] RBAC: Authorizing `identity:get_project(project_id=7c49b7e2947f42c096eb6b5a5fca321a)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:21.648586 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc0b8d-d1ab-47e9-893f-5335f8c86e0e None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:21.649899 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e13fd-73e4-4101-9665-3c4e8f87a447 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:21.651684 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 113/231] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:02:21 2022] GET /identity/v3/projects/7c49b7e2947f42c096eb6b5a5fca321a => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:21.652550 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e13fd-73e4-4101-9665-3c4e8f87a447 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:21.662178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:21.681660 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:21.695195 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803840b6-6dfe-4ad1-821c-162517c8939b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:21.696031 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803840b6-6dfe-4ad1-821c-162517c8939b None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:21.696447 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803840b6-6dfe-4ad1-821c-162517c8939b None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:21.696853 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803840b6-6dfe-4ad1-821c-162517c8939b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:21.697781 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803840b6-6dfe-4ad1-821c-162517c8939b None admin] RBAC: Adding query filter params (role.id=12a8e2ae2b6b4d699aac9ba2319cf57d, scope.project.id=7c49b7e2947f42c096eb6b5a5fca321a, user.id=cfedeefa365747b7abad05a53a8fa7e9) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:21.698246 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803840b6-6dfe-4ad1-821c-162517c8939b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:21.700368 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803840b6-6dfe-4ad1-821c-162517c8939b None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:21.708481 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 119/232] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:02:21 2022] GET /identity/v3/role_assignments?user.id=cfedeefa365747b7abad05a53a8fa7e9&scope.project.id=7c49b7e2947f42c096eb6b5a5fca321a&role.id=12a8e2ae2b6b4d699aac9ba2319cf57d => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:21.709681 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803840b6-6dfe-4ad1-821c-162517c8939b None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:21.773049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e13fd-73e4-4101-9665-3c4e8f87a447 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:21.822221 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91798329-ac8a-49a8-95b9-5f10b08defc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:21.823425 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91798329-ac8a-49a8-95b9-5f10b08defc6 None admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:21.824314 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91798329-ac8a-49a8-95b9-5f10b08defc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:21.824734 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91798329-ac8a-49a8-95b9-5f10b08defc6 None admin] PATH_INFO: `/v3/projects/7c49b7e2947f42c096eb6b5a5fca321a/users/4a88747d1abd439bb1c225d264d1521b/roles/8272ca656a1f41379f9acf1ea055fb4d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:21.828520 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91798329-ac8a-49a8-95b9-5f10b08defc6 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c49b7e2947f42c096eb6b5a5fca321a, user_id=4a88747d1abd439bb1c225d264d1521b, role_id=8272ca656a1f41379f9acf1ea055fb4d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:21.830211 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803840b6-6dfe-4ad1-821c-162517c8939b None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:21.830367 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91798329-ac8a-49a8-95b9-5f10b08defc6 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:21.862918 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 114/233] 10.222.0.60 () {58 vars in 1439 bytes} [Sun Jul 31 01:02:21 2022] PUT /identity/v3/projects/7c49b7e2947f42c096eb6b5a5fca321a/users/4a88747d1abd439bb1c225d264d1521b/roles/8272ca656a1f41379f9acf1ea055fb4d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:02:21.887811 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39758704-c133-4a78-bd63-b6a09dd96147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:21.888769 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39758704-c133-4a78-bd63-b6a09dd96147 None admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:21.889053 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39758704-c133-4a78-bd63-b6a09dd96147 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:21.889332 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39758704-c133-4a78-bd63-b6a09dd96147 None admin] PATH_INFO: `/v3/projects/7c49b7e2947f42c096eb6b5a5fca321a/users/4a88747d1abd439bb1c225d264d1521b/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:21.893559 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39758704-c133-4a78-bd63-b6a09dd96147 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c49b7e2947f42c096eb6b5a5fca321a, user_id=4a88747d1abd439bb1c225d264d1521b, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:21.895089 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39758704-c133-4a78-bd63-b6a09dd96147 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:21.913123 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 120/234] 10.222.0.60 () {58 vars in 1439 bytes} [Sun Jul 31 01:02:21 2022] PUT /identity/v3/projects/7c49b7e2947f42c096eb6b5a5fca321a/users/4a88747d1abd439bb1c225d264d1521b/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:02:22.802136 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07759468-6606-4ad6-9675-effa5e9a2b0d None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:22.802668 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07759468-6606-4ad6-9675-effa5e9a2b0d None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:22.802668 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07759468-6606-4ad6-9675-effa5e9a2b0d None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:22.804253 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 115/235] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:22.817225 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff90ef-5ff8-4967-a129-be1a73cf7ddf None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:22.818136 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff90ef-5ff8-4967-a129-be1a73cf7ddf None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:22.818665 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff90ef-5ff8-4967-a129-be1a73cf7ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:22.839390 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-59ff90ef-5ff8-4967-a129-be1a73cf7ddf None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:22.840615 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-59ff90ef-5ff8-4967-a129-be1a73cf7ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:22.903692 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:22.931170 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 121/236] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:02:22.965747 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07759468-6606-4ad6-9675-effa5e9a2b0d None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:23.049935 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:23.091022 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32bc5db-b80e-4460-8c67-486d08387d50 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:23.091210 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32bc5db-b80e-4460-8c67-486d08387d50 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:23.091468 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32bc5db-b80e-4460-8c67-486d08387d50 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:23.092879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 122/237] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:02:23.098084 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852db668-063e-444d-9291-ace298b81a9a None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:23.098364 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852db668-063e-444d-9291-ace298b81a9a None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:23.098656 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852db668-063e-444d-9291-ace298b81a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:23.109353 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07759468-6606-4ad6-9675-effa5e9a2b0d None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:23.132897 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-852db668-063e-444d-9291-ace298b81a9a None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:23.135563 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-852db668-063e-444d-9291-ace298b81a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:23.185111 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a86d1-bee8-4a44-ba15-133dfb9db000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:23.185759 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a86d1-bee8-4a44-ba15-133dfb9db000 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:23.186043 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a86d1-bee8-4a44-ba15-133dfb9db000 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:23.186317 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a86d1-bee8-4a44-ba15-133dfb9db000 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:23.212149 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a86d1-bee8-4a44-ba15-133dfb9db000 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:23.218953 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-474a86d1-bee8-4a44-ba15-133dfb9db000 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 01:02:23.218953 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:23.218953 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:23.218953 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:23.218953 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:23.218953 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:23.218953 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:23.218953 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:23.218953 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:23.218953 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:23.218953 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:23.218953 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:23.218953 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:23.218953 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:23.218953 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:23.218953 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:23.219840 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:23.219840 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:23.219840 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:23.219840 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:23.219840 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:23.219840 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:23.219840 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:23.219840 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:23.219840 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:23.219840 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:23.219840 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:23.219840 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:23.219840 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:23.219840 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:23.219840 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:23.219840 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:23.220619 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:23.220619 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:23.220619 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:23.220619 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:23.220619 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:23.220619 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:23.220619 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:23.220619 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:23.220619 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:23.220619 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:23.220619 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 01:02:23.220619 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:02:23.223702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 116/238] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:02:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:23.228978 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a86d1-bee8-4a44-ba15-133dfb9db000 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:23.272238 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 123/239] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:02:23.322004 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852db668-063e-444d-9291-ace298b81a9a None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:23.441667 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a86d1-bee8-4a44-ba15-133dfb9db000 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:23.451254 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852db668-063e-444d-9291-ace298b81a9a None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:23.464383 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:23.502019 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:23.502347 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4317b-e7b1-42a2-9217-eda2851b6239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:23.503403 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4317b-e7b1-42a2-9217-eda2851b6239 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:23.503718 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4317b-e7b1-42a2-9217-eda2851b6239 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:23.504597 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4317b-e7b1-42a2-9217-eda2851b6239 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:23.506022 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4317b-e7b1-42a2-9217-eda2851b6239 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:23.508377 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4317b-e7b1-42a2-9217-eda2851b6239 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:23.512211 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 124/240] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:02:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:23.517830 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4317b-e7b1-42a2-9217-eda2851b6239 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:23.521464 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d896c61-d331-4c83-9ac9-dad9f72481fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:23.522999 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d896c61-d331-4c83-9ac9-dad9f72481fa None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:23.523281 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d896c61-d331-4c83-9ac9-dad9f72481fa None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:23.523570 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d896c61-d331-4c83-9ac9-dad9f72481fa None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:23.524301 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d896c61-d331-4c83-9ac9-dad9f72481fa None admin] RBAC: Adding query filter params (name=reader) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:23.524599 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d896c61-d331-4c83-9ac9-dad9f72481fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:23.525988 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d896c61-d331-4c83-9ac9-dad9f72481fa None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:23.544650 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 117/241] 10.222.0.60 () {56 vars in 1101 bytes} [Sun Jul 31 01:02:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:02:23.550654 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d896c61-d331-4c83-9ac9-dad9f72481fa None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:23.678206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d896c61-d331-4c83-9ac9-dad9f72481fa None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:23.715810 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc22e60-45ad-4744-966e-01defa4fe44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:23.716479 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc22e60-45ad-4744-966e-01defa4fe44d None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:23.716753 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc22e60-45ad-4744-966e-01defa4fe44d None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:23.717023 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc22e60-45ad-4744-966e-01defa4fe44d None admin] PATH_INFO: `/v3/users/fd2884be553947478c4ab65fa34dda7d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:23.732408 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc22e60-45ad-4744-966e-01defa4fe44d None admin] RBAC: Authorizing `identity:get_user(user_id=fd2884be553947478c4ab65fa34dda7d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:23.733967 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc22e60-45ad-4744-966e-01defa4fe44d None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:23.735748 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 118/242] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:02:23 2022] GET /identity/v3/users/fd2884be553947478c4ab65fa34dda7d => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:02:23.741793 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc22e60-45ad-4744-966e-01defa4fe44d None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:23.751311 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4317b-e7b1-42a2-9217-eda2851b6239 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:23.812812 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2446bc1-b6ae-414b-8c95-61d49ad173d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:23.813445 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2446bc1-b6ae-414b-8c95-61d49ad173d4 None admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:23.813723 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2446bc1-b6ae-414b-8c95-61d49ad173d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:23.813993 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2446bc1-b6ae-414b-8c95-61d49ad173d4 None admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:23.816145 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2446bc1-b6ae-414b-8c95-61d49ad173d4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:23.817623 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2446bc1-b6ae-414b-8c95-61d49ad173d4 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:23.825781 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:23.858386 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 125/243] 10.222.0.60 () {60 vars in 1132 bytes} [Sun Jul 31 01:02:23 2022] POST /identity/v3/users => generated 293 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:02:23.907569 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc22e60-45ad-4744-966e-01defa4fe44d None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:23.958200 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d2e06-8e86-4e56-85d9-1fe00cad1114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:23.958775 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d2e06-8e86-4e56-85d9-1fe00cad1114 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:23.959048 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d2e06-8e86-4e56-85d9-1fe00cad1114 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:23.959323 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d2e06-8e86-4e56-85d9-1fe00cad1114 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:24.050576 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151d2e06-8e86-4e56-85d9-1fe00cad1114 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:24.052123 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151d2e06-8e86-4e56-85d9-1fe00cad1114 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:24.106328 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:24.161964 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 119/244] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:02:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 31 01:02:24.167980 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2446bc1-b6ae-414b-8c95-61d49ad173d4 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:24.211074 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:24.284717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbda38e-6e79-49c6-a2bc-d0e899a6bd8c None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:24.284998 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbda38e-6e79-49c6-a2bc-d0e899a6bd8c None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:24.285276 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbda38e-6e79-49c6-a2bc-d0e899a6bd8c None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:24.286971 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 120/245] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:24.290328 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2446bc1-b6ae-414b-8c95-61d49ad173d4 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:24.291926 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e72702-2dea-4a87-9437-5ad6a1359530 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:24.292197 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e72702-2dea-4a87-9437-5ad6a1359530 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:24.292471 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e72702-2dea-4a87-9437-5ad6a1359530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:24.320552 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-85e72702-2dea-4a87-9437-5ad6a1359530 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:24.321775 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-85e72702-2dea-4a87-9437-5ad6a1359530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:24.334148 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee520da-3c45-4865-b432-b5dc24216fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:24.335143 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee520da-3c45-4865-b432-b5dc24216fbe None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:24.335642 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee520da-3c45-4865-b432-b5dc24216fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:24.336106 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee520da-3c45-4865-b432-b5dc24216fbe None admin] PATH_INFO: `/v3/projects/7c49b7e2947f42c096eb6b5a5fca321a` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:24.338942 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee520da-3c45-4865-b432-b5dc24216fbe None admin] RBAC: Authorizing `identity:get_project(project_id=7c49b7e2947f42c096eb6b5a5fca321a)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:24.340738 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee520da-3c45-4865-b432-b5dc24216fbe None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:24.342765 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 126/246] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:02:24 2022] GET /identity/v3/projects/7c49b7e2947f42c096eb6b5a5fca321a => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:24.351517 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee520da-3c45-4865-b432-b5dc24216fbe None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:24.423031 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 121/247] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:02:24.444620 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576af8e2-0a7c-464f-b114-c18de26e1205 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:24.445129 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576af8e2-0a7c-464f-b114-c18de26e1205 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:24.445564 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576af8e2-0a7c-464f-b114-c18de26e1205 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:24.447162 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 122/248] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:02:24.451314 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576af8e2-0a7c-464f-b114-c18de26e1205 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:24.474205 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee520da-3c45-4865-b432-b5dc24216fbe None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:24.476786 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:24.525603 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3ef09-7f83-4f31-a688-beaec7c2d901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:24.526729 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3ef09-7f83-4f31-a688-beaec7c2d901 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:24.527016 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3ef09-7f83-4f31-a688-beaec7c2d901 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:24.527296 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3ef09-7f83-4f31-a688-beaec7c2d901 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:24.528515 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe3ef09-7f83-4f31-a688-beaec7c2d901 None admin] RBAC: Adding query filter params (role.id=d902e34269cc4d79b49b0d035055c40b, scope.project.id=7c49b7e2947f42c096eb6b5a5fca321a, user.id=fd2884be553947478c4ab65fa34dda7d) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:24.528828 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe3ef09-7f83-4f31-a688-beaec7c2d901 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:24.530821 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe3ef09-7f83-4f31-a688-beaec7c2d901 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:24.539562 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 127/249] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:02:24 2022] GET /identity/v3/role_assignments?user.id=fd2884be553947478c4ab65fa34dda7d&scope.project.id=7c49b7e2947f42c096eb6b5a5fca321a&role.id=d902e34269cc4d79b49b0d035055c40b => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:24.540895 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e3cd0-027b-4bde-9be8-d26611c58cf7 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:24.541178 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e3cd0-027b-4bde-9be8-d26611c58cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:24.541449 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e3cd0-027b-4bde-9be8-d26611c58cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:24.547019 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:24.560702 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-868e3cd0-027b-4bde-9be8-d26611c58cf7 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:24.562016 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-868e3cd0-027b-4bde-9be8-d26611c58cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:24.586382 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576af8e2-0a7c-464f-b114-c18de26e1205 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:24.637738 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c7282-e9e0-471b-a7f3-89194033bf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:24.638527 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c7282-e9e0-471b-a7f3-89194033bf39 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:24.638816 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c7282-e9e0-471b-a7f3-89194033bf39 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:24.639087 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c7282-e9e0-471b-a7f3-89194033bf39 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:24.641309 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 128/250] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:02:24.642713 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35190432-0732-4c15-91b6-58c8c75f0aa6 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:24.643001 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35190432-0732-4c15-91b6-58c8c75f0aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:24.643275 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35190432-0732-4c15-91b6-58c8c75f0aa6 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:24.652447 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51c7282-e9e0-471b-a7f3-89194033bf39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:24.652997 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 129/251] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:24 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:24.658908 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be3d81-b8a5-4d34-bd6f-945c9afb8390 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:24.659221 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be3d81-b8a5-4d34-bd6f-945c9afb8390 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:24.659467 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be3d81-b8a5-4d34-bd6f-945c9afb8390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:24.660717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-c51c7282-e9e0-471b-a7f3-89194033bf39 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:02:24.660717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:24.660717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:24.660717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:24.660717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:24.660717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:24.660717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:24.660717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:24.660717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:24.660717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:24.660717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:24.660717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:24.660717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:24.660717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:24.660717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:24.660717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:24.662355 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:24.662355 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:24.662355 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:24.662355 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:24.662355 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:24.662355 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:24.662355 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:24.662355 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:24.662355 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:24.662355 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:24.662355 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:24.662355 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:24.662355 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:24.662355 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:24.662355 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:24.662355 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:24.663821 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:24.663821 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:24.663821 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:24.663821 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:24.663821 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:24.663821 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:24.663821 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:24.663821 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:24.663821 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:24.663821 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:24.663821 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:02:24.663821 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:02:24.663821 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 123/252] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:02:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:02:24.668464 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c7282-e9e0-471b-a7f3-89194033bf39 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:24.711617 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-73be3d81-b8a5-4d34-bd6f-945c9afb8390 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:24.712841 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-73be3d81-b8a5-4d34-bd6f-945c9afb8390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:24.794814 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c7282-e9e0-471b-a7f3-89194033bf39 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:24.814406 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 130/253] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:02:24.815706 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be3d81-b8a5-4d34-bd6f-945c9afb8390 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:24.845801 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:24.858906 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815cd89-87a6-49ae-a2eb-c6abe43d8259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:24.859615 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815cd89-87a6-49ae-a2eb-c6abe43d8259 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:24.859891 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815cd89-87a6-49ae-a2eb-c6abe43d8259 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:24.860158 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815cd89-87a6-49ae-a2eb-c6abe43d8259 None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:24.860941 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0815cd89-87a6-49ae-a2eb-c6abe43d8259 None admin] RBAC: Adding query filter params (name=member) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:24.861243 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0815cd89-87a6-49ae-a2eb-c6abe43d8259 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:24.862639 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0815cd89-87a6-49ae-a2eb-c6abe43d8259 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:24.865906 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:24.874404 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 124/254] 10.222.0.60 () {56 vars in 1101 bytes} [Sun Jul 31 01:02:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:02:24.875405 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815cd89-87a6-49ae-a2eb-c6abe43d8259 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:24.941491 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be3d81-b8a5-4d34-bd6f-945c9afb8390 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:24.979047 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbb610-d887-4484-afe7-03c9667426e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:24.980210 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbb610-d887-4484-afe7-03c9667426e8 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:24.980629 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbb610-d887-4484-afe7-03c9667426e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:24.981065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbb610-d887-4484-afe7-03c9667426e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:25.003759 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dbb610-d887-4484-afe7-03c9667426e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:25.008785 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-c2dbb610-d887-4484-afe7-03c9667426e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:02:25.008785 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:25.008785 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:25.008785 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:25.008785 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:25.008785 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:25.008785 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:25.008785 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:25.008785 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:25.008785 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:25.008785 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:25.008785 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:25.008785 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:25.008785 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:25.008785 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:25.008785 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:25.009659 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:25.009659 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:25.009659 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:25.009659 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:25.009659 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:25.009659 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:25.009659 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:25.009659 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:25.009659 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:25.009659 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:25.009659 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:25.009659 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:25.009659 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:25.009659 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:25.009659 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:25.009659 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:25.010430 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:25.010430 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:25.010430 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:25.010430 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:25.010430 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:25.010430 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:25.010430 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:25.010430 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:25.010430 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:25.010430 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:25.010430 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:02:25.010430 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:02:25.010430 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 131/255] 10.222.0.60 () {56 vars in 1096 bytes} [Sun Jul 31 01:02:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:25.011082 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbb610-d887-4484-afe7-03c9667426e8 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:25.046468 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815cd89-87a6-49ae-a2eb-c6abe43d8259 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:25.095747 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d8d605-e599-4634-a0fa-b94faa02ff6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:25.096409 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8d605-e599-4634-a0fa-b94faa02ff6f None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:25.096689 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8d605-e599-4634-a0fa-b94faa02ff6f None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:25.096973 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8d605-e599-4634-a0fa-b94faa02ff6f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:25.116420 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d8d605-e599-4634-a0fa-b94faa02ff6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:25.124643 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-f1d8d605-e599-4634-a0fa-b94faa02ff6f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:02:25.124643 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:25.124643 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:25.124643 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:25.124643 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:25.124643 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:25.124643 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:25.124643 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:25.124643 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:25.124643 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:25.124643 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:25.124643 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:25.124643 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:25.124643 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:25.124643 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:25.124643 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:25.125533 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:25.125533 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:25.125533 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:25.125533 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:25.125533 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:25.125533 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:25.125533 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:25.125533 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:25.125533 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:25.125533 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:25.125533 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:25.125533 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:25.125533 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:25.125533 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:25.125533 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:25.125533 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:25.126326 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:25.126326 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:25.126326 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:25.126326 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:25.126326 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:25.126326 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:25.126326 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:25.126326 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:25.126326 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:25.126326 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:25.126326 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:02:25.126326 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:02:25.126919 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 125/256] 10.222.0.60 () {56 vars in 1114 bytes} [Sun Jul 31 01:02:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:25.128325 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d8d605-e599-4634-a0fa-b94faa02ff6f None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:25.167030 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:25.193340 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbb610-d887-4484-afe7-03c9667426e8 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:25.234074 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:25.253721 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6136f-5ac7-458d-a39c-6ad0d51ecfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:25.254387 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6136f-5ac7-458d-a39c-6ad0d51ecfec None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:25.254662 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6136f-5ac7-458d-a39c-6ad0d51ecfec None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:25.254931 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6136f-5ac7-458d-a39c-6ad0d51ecfec None admin] PATH_INFO: `/v3/users/cfedeefa365747b7abad05a53a8fa7e9` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:25.256142 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea6136f-5ac7-458d-a39c-6ad0d51ecfec None admin] RBAC: Authorizing `identity:get_user(user_id=cfedeefa365747b7abad05a53a8fa7e9)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:25.258126 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea6136f-5ac7-458d-a39c-6ad0d51ecfec None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:25.260482 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 132/257] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:02:25 2022] GET /identity/v3/users/cfedeefa365747b7abad05a53a8fa7e9 => generated 297 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:25.261308 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6136f-5ac7-458d-a39c-6ad0d51ecfec None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:25.318769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d8d605-e599-4634-a0fa-b94faa02ff6f None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:25.378529 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6136f-5ac7-458d-a39c-6ad0d51ecfec None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:25.416206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15e620-b8c9-416c-b14c-545598a01905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:25.416444 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6a0b1-2752-404a-a1a6-650f386a9951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:25.416852 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15e620-b8c9-416c-b14c-545598a01905 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:25.417038 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6a0b1-2752-404a-a1a6-650f386a9951 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:25.417130 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15e620-b8c9-416c-b14c-545598a01905 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:25.417271 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6a0b1-2752-404a-a1a6-650f386a9951 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:25.417427 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15e620-b8c9-416c-b14c-545598a01905 None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:25.417524 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6a0b1-2752-404a-a1a6-650f386a9951 None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:25.418124 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da15e620-b8c9-416c-b14c-545598a01905 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:25.418222 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6a0b1-2752-404a-a1a6-650f386a9951 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:25.418428 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da15e620-b8c9-416c-b14c-545598a01905 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:25.418533 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6a0b1-2752-404a-a1a6-650f386a9951 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:25.419847 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da15e620-b8c9-416c-b14c-545598a01905 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:25.419971 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6a0b1-2752-404a-a1a6-650f386a9951 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:25.428912 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 133/258] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:02:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:25.429539 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6a0b1-2752-404a-a1a6-650f386a9951 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:25.441423 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 126/259] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:02:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:25.442399 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15e620-b8c9-416c-b14c-545598a01905 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:25.449078 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:25.539745 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6a0b1-2752-404a-a1a6-650f386a9951 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:25.576303 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834df24a-073e-47a3-8156-3aaabdaee3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:25.576881 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834df24a-073e-47a3-8156-3aaabdaee3c7 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:25.577158 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834df24a-073e-47a3-8156-3aaabdaee3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:25.577520 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834df24a-073e-47a3-8156-3aaabdaee3c7 None admin] PATH_INFO: `/v3/projects/7c49b7e2947f42c096eb6b5a5fca321a` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:25.578788 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834df24a-073e-47a3-8156-3aaabdaee3c7 None admin] RBAC: Authorizing `identity:get_project(project_id=7c49b7e2947f42c096eb6b5a5fca321a)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:25.580415 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834df24a-073e-47a3-8156-3aaabdaee3c7 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:25.582097 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 134/260] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:02:25 2022] GET /identity/v3/projects/7c49b7e2947f42c096eb6b5a5fca321a => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:25.582851 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834df24a-073e-47a3-8156-3aaabdaee3c7 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:25.679266 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:25.697192 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834df24a-073e-47a3-8156-3aaabdaee3c7 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:25.729489 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15e620-b8c9-416c-b14c-545598a01905 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:25.736561 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43fad6f-d51f-421c-abd4-e8a7102d4b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:25.737227 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43fad6f-d51f-421c-abd4-e8a7102d4b8b None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:25.737503 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43fad6f-d51f-421c-abd4-e8a7102d4b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:25.737776 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43fad6f-d51f-421c-abd4-e8a7102d4b8b None admin] PATH_INFO: `/v3/users/4a88747d1abd439bb1c225d264d1521b` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:25.739006 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43fad6f-d51f-421c-abd4-e8a7102d4b8b None admin] RBAC: Authorizing `identity:get_user(user_id=4a88747d1abd439bb1c225d264d1521b)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:25.740971 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43fad6f-d51f-421c-abd4-e8a7102d4b8b None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:25.742616 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 135/261] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:02:25 2022] GET /identity/v3/users/4a88747d1abd439bb1c225d264d1521b => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:25.743353 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43fad6f-d51f-421c-abd4-e8a7102d4b8b None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:25.790665 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:25.840292 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd0cc4-ba74-4202-9f73-e589b1c49f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:25.840874 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd0cc4-ba74-4202-9f73-e589b1c49f3e None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:25.841159 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd0cc4-ba74-4202-9f73-e589b1c49f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:25.841432 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd0cc4-ba74-4202-9f73-e589b1c49f3e None admin] PATH_INFO: `/v3/users/4a88747d1abd439bb1c225d264d1521b` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:25.848205 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fd0cc4-ba74-4202-9f73-e589b1c49f3e None admin] RBAC: Authorizing `identity:get_user(user_id=4a88747d1abd439bb1c225d264d1521b)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:25.849700 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fd0cc4-ba74-4202-9f73-e589b1c49f3e None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:25.851622 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 127/262] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:02:25 2022] GET /identity/v3/users/4a88747d1abd439bb1c225d264d1521b => generated 283 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:25.852244 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd0cc4-ba74-4202-9f73-e589b1c49f3e None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:25.853409 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43fad6f-d51f-421c-abd4-e8a7102d4b8b None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:25.892062 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859571d-e7d7-4104-a984-12c7c3c381a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:25.892765 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859571d-e7d7-4104-a984-12c7c3c381a3 None admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:25.893040 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859571d-e7d7-4104-a984-12c7c3c381a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:25.893313 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859571d-e7d7-4104-a984-12c7c3c381a3 None admin] PATH_INFO: `/v3/projects/7c49b7e2947f42c096eb6b5a5fca321a/users/cfedeefa365747b7abad05a53a8fa7e9/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:25.895356 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8859571d-e7d7-4104-a984-12c7c3c381a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c49b7e2947f42c096eb6b5a5fca321a, user_id=cfedeefa365747b7abad05a53a8fa7e9, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:25.897500 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8859571d-e7d7-4104-a984-12c7c3c381a3 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:25.920546 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 136/263] 10.222.0.60 () {58 vars in 1439 bytes} [Sun Jul 31 01:02:25 2022] PUT /identity/v3/projects/7c49b7e2947f42c096eb6b5a5fca321a/users/cfedeefa365747b7abad05a53a8fa7e9/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:02:25.922575 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859571d-e7d7-4104-a984-12c7c3c381a3 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:25.949821 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:26.103588 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859571d-e7d7-4104-a984-12c7c3c381a3 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:26.145762 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd0cc4-ba74-4202-9f73-e589b1c49f3e None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:26.163363 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bbd71d-e2ce-4b64-b681-93f6df3dcef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:26.164391 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbd71d-e2ce-4b64-b681-93f6df3dcef4 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:26.164888 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbd71d-e2ce-4b64-b681-93f6df3dcef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:26.165471 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbd71d-e2ce-4b64-b681-93f6df3dcef4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:26.241686 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bbd71d-e2ce-4b64-b681-93f6df3dcef4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:26.243532 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bbd71d-e2ce-4b64-b681-93f6df3dcef4 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:26.250709 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334d07b-dc08-401d-a7a5-8637716ed286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:26.251360 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334d07b-dc08-401d-a7a5-8637716ed286 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:26.251667 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334d07b-dc08-401d-a7a5-8637716ed286 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:26.251939 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334d07b-dc08-401d-a7a5-8637716ed286 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:26.282192 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:26.385376 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:26.402489 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 137/264] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:02:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:02:26.406053 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8334d07b-dc08-401d-a7a5-8637716ed286 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:26.408274 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bbd71d-e2ce-4b64-b681-93f6df3dcef4 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:26.411657 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8334d07b-dc08-401d-a7a5-8637716ed286 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:26.520956 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 128/265] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:02:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 669 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:02:26.526758 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334d07b-dc08-401d-a7a5-8637716ed286 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:26.586308 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bbd71d-e2ce-4b64-b681-93f6df3dcef4 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:26.619960 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:26.676081 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e0124b-6be2-4be2-a4b2-64c6d6f5e980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:26.676759 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e0124b-6be2-4be2-a4b2-64c6d6f5e980 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:26.677084 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e0124b-6be2-4be2-a4b2-64c6d6f5e980 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:26.677350 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e0124b-6be2-4be2-a4b2-64c6d6f5e980 None admin] PATH_INFO: `/v3/projects/7c49b7e2947f42c096eb6b5a5fca321a` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:26.678631 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e0124b-6be2-4be2-a4b2-64c6d6f5e980 None admin] RBAC: Authorizing `identity:get_project(project_id=7c49b7e2947f42c096eb6b5a5fca321a)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:26.680221 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e0124b-6be2-4be2-a4b2-64c6d6f5e980 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:26.682267 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 138/266] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:02:26 2022] GET /identity/v3/projects/7c49b7e2947f42c096eb6b5a5fca321a => generated 302 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:26.692054 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e0124b-6be2-4be2-a4b2-64c6d6f5e980 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:26.728052 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:26.768917 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334d07b-dc08-401d-a7a5-8637716ed286 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:26.830905 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29057f95-f4a1-4d1c-a488-80e8b9e82ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:26.831966 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29057f95-f4a1-4d1c-a488-80e8b9e82ade None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:26.832459 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29057f95-f4a1-4d1c-a488-80e8b9e82ade None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:26.832952 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29057f95-f4a1-4d1c-a488-80e8b9e82ade None admin] PATH_INFO: `/v3/projects/7c49b7e2947f42c096eb6b5a5fca321a` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:26.834318 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29057f95-f4a1-4d1c-a488-80e8b9e82ade None admin] RBAC: Authorizing `identity:get_project(project_id=7c49b7e2947f42c096eb6b5a5fca321a)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:26.835996 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29057f95-f4a1-4d1c-a488-80e8b9e82ade None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:26.838226 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 129/267] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:02:26 2022] GET /identity/v3/projects/7c49b7e2947f42c096eb6b5a5fca321a => generated 302 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:26.842749 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e0124b-6be2-4be2-a4b2-64c6d6f5e980 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:26.843991 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29057f95-f4a1-4d1c-a488-80e8b9e82ade None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:26.882644 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfdc5f9-bca1-487e-9219-951c866a32ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:26.883712 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfdc5f9-bca1-487e-9219-951c866a32ef None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:26.883988 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfdc5f9-bca1-487e-9219-951c866a32ef None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:26.884254 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfdc5f9-bca1-487e-9219-951c866a32ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:26.887519 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfdc5f9-bca1-487e-9219-951c866a32ef None admin] RBAC: Adding query filter params (role.id=8272ca656a1f41379f9acf1ea055fb4d, scope.project.id=7c49b7e2947f42c096eb6b5a5fca321a, user.id=4a88747d1abd439bb1c225d264d1521b) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:26.887519 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfdc5f9-bca1-487e-9219-951c866a32ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:26.887519 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfdc5f9-bca1-487e-9219-951c866a32ef None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:26.900179 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 139/268] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:02:26 2022] GET /identity/v3/role_assignments?user.id=4a88747d1abd439bb1c225d264d1521b&scope.project.id=7c49b7e2947f42c096eb6b5a5fca321a&role.id=8272ca656a1f41379f9acf1ea055fb4d => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:02:26.901960 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9cc845-f6cb-4b48-a1c8-ca7c7018f5fd None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:26.902248 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9cc845-f6cb-4b48-a1c8-ca7c7018f5fd None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:26.902643 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9cc845-f6cb-4b48-a1c8-ca7c7018f5fd None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:26.907534 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 140/269] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:26.921349 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57dd296-5a13-4402-bfd7-b44c6a613e1b None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:26.921660 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57dd296-5a13-4402-bfd7-b44c6a613e1b None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:26.921893 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57dd296-5a13-4402-bfd7-b44c6a613e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:26.961565 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-d57dd296-5a13-4402-bfd7-b44c6a613e1b None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:26.962792 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-d57dd296-5a13-4402-bfd7-b44c6a613e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:27.059960 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:27.105551 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29057f95-f4a1-4d1c-a488-80e8b9e82ade None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:27.110687 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 141/270] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:02:27.115146 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f9333-ae60-4b66-8228-0c2f1a7c4637 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:27.115439 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f9333-ae60-4b66-8228-0c2f1a7c4637 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:27.115721 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f9333-ae60-4b66-8228-0c2f1a7c4637 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:27.122337 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 142/271] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:27.124925 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d32d5-8461-4b59-8e23-fe4022ab1188 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:27.125240 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d32d5-8461-4b59-8e23-fe4022ab1188 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:27.125544 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d32d5-8461-4b59-8e23-fe4022ab1188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:27.156068 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-b83d32d5-8461-4b59-8e23-fe4022ab1188 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:27.157201 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-b83d32d5-8461-4b59-8e23-fe4022ab1188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:27.199966 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261cfd8-aab7-4c88-bf68-36afbfd56edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:27.200624 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261cfd8-aab7-4c88-bf68-36afbfd56edd None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:27.201010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261cfd8-aab7-4c88-bf68-36afbfd56edd None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:27.201166 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261cfd8-aab7-4c88-bf68-36afbfd56edd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:27.201976 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261cfd8-aab7-4c88-bf68-36afbfd56edd None admin] RBAC: Adding query filter params (role.id=fef526a7d2e741ce995d107f3ac934ae, scope.project.id=7c49b7e2947f42c096eb6b5a5fca321a, user.id=4a88747d1abd439bb1c225d264d1521b) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:27.202283 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261cfd8-aab7-4c88-bf68-36afbfd56edd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:27.205187 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261cfd8-aab7-4c88-bf68-36afbfd56edd None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:27.213721 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 130/272] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:02:26 2022] GET /identity/v3/role_assignments?user.id=4a88747d1abd439bb1c225d264d1521b&scope.project.id=7c49b7e2947f42c096eb6b5a5fca321a&role.id=fef526a7d2e741ce995d107f3ac934ae => generated 608 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:27.214321 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261cfd8-aab7-4c88-bf68-36afbfd56edd None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:27.247244 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:27.256580 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 143/273] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:02:27.257084 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861c3a9-7610-4e52-b496-1c43b58f5f70 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:27.257370 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861c3a9-7610-4e52-b496-1c43b58f5f70 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:27.257642 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861c3a9-7610-4e52-b496-1c43b58f5f70 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:27.260351 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 144/274] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:27.266113 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7bc46-9e1f-4a79-9819-0ac36613ece7 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:27.267348 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7bc46-9e1f-4a79-9819-0ac36613ece7 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:27.268001 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7bc46-9e1f-4a79-9819-0ac36613ece7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:27.289866 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-2bb7bc46-9e1f-4a79-9819-0ac36613ece7 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:27.291478 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-2bb7bc46-9e1f-4a79-9819-0ac36613ece7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:27.374490 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261cfd8-aab7-4c88-bf68-36afbfd56edd None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:27.381953 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 145/275] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:02:27.387865 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb7bc46-9e1f-4a79-9819-0ac36613ece7 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:27.427766 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3253e-c5eb-4a60-92d9-0c250c14d00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:27.428365 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3253e-c5eb-4a60-92d9-0c250c14d00a None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:27.428647 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3253e-c5eb-4a60-92d9-0c250c14d00a None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:27.428918 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3253e-c5eb-4a60-92d9-0c250c14d00a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:27.430795 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3253e-c5eb-4a60-92d9-0c250c14d00a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:27.432297 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3253e-c5eb-4a60-92d9-0c250c14d00a None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:27.433963 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 131/276] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:02:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:27.434730 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3253e-c5eb-4a60-92d9-0c250c14d00a None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:27.446346 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:27.528723 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb7bc46-9e1f-4a79-9819-0ac36613ece7 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:27.547295 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:27.562151 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3253e-c5eb-4a60-92d9-0c250c14d00a None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:27.571787 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02d2b6-9551-4e4a-b253-bb968d117079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:27.572783 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02d2b6-9551-4e4a-b253-bb968d117079 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:27.573064 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02d2b6-9551-4e4a-b253-bb968d117079 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:27.573640 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02d2b6-9551-4e4a-b253-bb968d117079 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:27.584881 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f02d2b6-9551-4e4a-b253-bb968d117079 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:27.589855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-7f02d2b6-9551-4e4a-b253-bb968d117079 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 01:02:27.589855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:27.589855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:27.589855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:27.589855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:27.589855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:27.589855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:27.589855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:27.589855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:27.589855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:27.589855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:27.589855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:27.589855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:27.589855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:27.589855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:27.589855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:27.590710 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:27.590710 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:27.590710 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:27.590710 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:27.590710 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:27.590710 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:27.590710 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:27.590710 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:27.590710 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:27.590710 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:27.590710 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:27.590710 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:27.590710 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:27.590710 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:27.590710 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:27.590710 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:27.592085 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:27.592085 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:27.592085 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:27.592085 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:27.592085 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:27.592085 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:27.592085 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:27.592085 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:27.592085 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:27.592085 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:27.592085 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 01:02:27.592085 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:02:27.592085 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 146/277] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:02:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:27.592085 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02d2b6-9551-4e4a-b253-bb968d117079 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:27.603151 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75308ad5-3f0f-4847-880c-1f0aa8a195fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:27.603831 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75308ad5-3f0f-4847-880c-1f0aa8a195fc None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:27.604107 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75308ad5-3f0f-4847-880c-1f0aa8a195fc None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:27.604371 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75308ad5-3f0f-4847-880c-1f0aa8a195fc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:27.614720 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75308ad5-3f0f-4847-880c-1f0aa8a195fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:27.620135 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-75308ad5-3f0f-4847-880c-1f0aa8a195fc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:02:27.620135 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:27.620135 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:27.620135 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:27.620135 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:27.620135 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:27.620135 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:27.620135 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:27.620135 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:27.620135 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:27.620135 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:27.620135 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:27.620135 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:27.620135 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:27.620135 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:27.620135 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:27.620984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:27.620984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:27.620984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:27.620984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:27.620984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:27.620984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:27.620984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:27.620984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:27.620984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:27.620984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:27.620984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:27.620984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:27.620984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:27.620984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:27.620984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:27.620984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:27.621796 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:27.621796 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:27.621796 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:27.621796 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:27.621796 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:27.621796 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:27.621796 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:27.621796 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:27.621796 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:27.621796 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:27.621796 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:02:27.621796 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:02:27.621796 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 132/278] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:02:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:27.622471 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75308ad5-3f0f-4847-880c-1f0aa8a195fc None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:27.697351 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:27.704530 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02d2b6-9551-4e4a-b253-bb968d117079 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:27.725261 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75308ad5-3f0f-4847-880c-1f0aa8a195fc None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:27.740319 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a21b26-25c4-47cd-91fe-62978200452f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:27.740933 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a21b26-25c4-47cd-91fe-62978200452f None admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:27.741199 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a21b26-25c4-47cd-91fe-62978200452f None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:27.741457 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a21b26-25c4-47cd-91fe-62978200452f None admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:27.742285 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a21b26-25c4-47cd-91fe-62978200452f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:27.743867 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a21b26-25c4-47cd-91fe-62978200452f None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:27.760488 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad31165-a791-41be-a06f-74f285c70063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:27.761154 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad31165-a791-41be-a06f-74f285c70063 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:27.761430 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad31165-a791-41be-a06f-74f285c70063 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:27.761698 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad31165-a791-41be-a06f-74f285c70063 None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:27.762502 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad31165-a791-41be-a06f-74f285c70063 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:27.762774 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad31165-a791-41be-a06f-74f285c70063 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:27.764262 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad31165-a791-41be-a06f-74f285c70063 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:27.768021 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 147/279] 10.222.0.60 () {60 vars in 1132 bytes} [Sun Jul 31 01:02:27 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:02:27.772634 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a21b26-25c4-47cd-91fe-62978200452f None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:27.773414 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 133/280] 10.222.0.60 () {56 vars in 1101 bytes} [Sun Jul 31 01:02:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:27.793929 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad31165-a791-41be-a06f-74f285c70063 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:27.814028 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:27.921490 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a21b26-25c4-47cd-91fe-62978200452f None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:27.940079 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad31165-a791-41be-a06f-74f285c70063 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:27.974857 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625dc057-0da2-4078-a015-6209cf641dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:27.975625 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625dc057-0da2-4078-a015-6209cf641dcc None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:27.976008 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625dc057-0da2-4078-a015-6209cf641dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:27.976382 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625dc057-0da2-4078-a015-6209cf641dcc None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:27.977455 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625dc057-0da2-4078-a015-6209cf641dcc None admin] RBAC: Adding query filter params (name=member) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:27.977566 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625dc057-0da2-4078-a015-6209cf641dcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:27.979253 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625dc057-0da2-4078-a015-6209cf641dcc None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:27.982005 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9d7e5-3a67-482d-ab61-ba23aca213ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:27.982666 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9d7e5-3a67-482d-ab61-ba23aca213ab None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:27.982943 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9d7e5-3a67-482d-ab61-ba23aca213ab None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:27.983214 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9d7e5-3a67-482d-ab61-ba23aca213ab None admin] PATH_INFO: `/v3/users/fd2884be553947478c4ab65fa34dda7d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:27.985470 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9d7e5-3a67-482d-ab61-ba23aca213ab None admin] RBAC: Authorizing `identity:get_user(user_id=fd2884be553947478c4ab65fa34dda7d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:27.986641 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9d7e5-3a67-482d-ab61-ba23aca213ab None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:27.990034 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 134/281] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:02:27 2022] GET /identity/v3/users/fd2884be553947478c4ab65fa34dda7d => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:27.994393 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 148/282] 10.222.0.60 () {56 vars in 1101 bytes} [Sun Jul 31 01:02:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:27.998569 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9d7e5-3a67-482d-ab61-ba23aca213ab None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:28.001230 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625dc057-0da2-4078-a015-6209cf641dcc None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:28.021491 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:28.111674 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:28.139476 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625dc057-0da2-4078-a015-6209cf641dcc None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:28.143702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9d7e5-3a67-482d-ab61-ba23aca213ab None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:28.179705 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553141e-f297-4ef4-a97e-ba9a687ad7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:28.180368 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553141e-f297-4ef4-a97e-ba9a687ad7ec None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:28.180655 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553141e-f297-4ef4-a97e-ba9a687ad7ec None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:28.181177 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553141e-f297-4ef4-a97e-ba9a687ad7ec None admin] PATH_INFO: `/v3/users/30b5225cc0c04ab9b5b00d2e4273c29e` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:28.186435 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5bd34-a59c-44a9-8728-5bbcbb869b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:28.187155 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5bd34-a59c-44a9-8728-5bbcbb869b49 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:28.187430 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5bd34-a59c-44a9-8728-5bbcbb869b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:28.187742 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5bd34-a59c-44a9-8728-5bbcbb869b49 None admin] PATH_INFO: `/v3/projects/7c49b7e2947f42c096eb6b5a5fca321a` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:28.188956 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed5bd34-a59c-44a9-8728-5bbcbb869b49 None admin] RBAC: Authorizing `identity:get_project(project_id=7c49b7e2947f42c096eb6b5a5fca321a)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:28.190514 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed5bd34-a59c-44a9-8728-5bbcbb869b49 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:28.192775 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 135/283] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:02:27 2022] GET /identity/v3/projects/7c49b7e2947f42c096eb6b5a5fca321a => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:02:28.196657 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9553141e-f297-4ef4-a97e-ba9a687ad7ec None admin] RBAC: Authorizing `identity:get_user(user_id=30b5225cc0c04ab9b5b00d2e4273c29e)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:28.198138 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9553141e-f297-4ef4-a97e-ba9a687ad7ec None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:28.200196 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 149/284] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:02:28 2022] GET /identity/v3/users/30b5225cc0c04ab9b5b00d2e4273c29e => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:02:28.200652 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5bd34-a59c-44a9-8728-5bbcbb869b49 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:28.205614 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553141e-f297-4ef4-a97e-ba9a687ad7ec None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:28.300033 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:28.324427 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5bd34-a59c-44a9-8728-5bbcbb869b49 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:28.330924 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553141e-f297-4ef4-a97e-ba9a687ad7ec None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:28.370324 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02dab1b-50ff-440b-a3b8-4100caba00a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:28.370951 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02dab1b-50ff-440b-a3b8-4100caba00a8 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:28.371223 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02dab1b-50ff-440b-a3b8-4100caba00a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:28.371519 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02dab1b-50ff-440b-a3b8-4100caba00a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:28.373691 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02dab1b-50ff-440b-a3b8-4100caba00a8 None admin] RBAC: Adding query filter params (role.id=12a8e2ae2b6b4d699aac9ba2319cf57d, user.id=30b5225cc0c04ab9b5b00d2e4273c29e, scope.system=all) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:28.373998 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02dab1b-50ff-440b-a3b8-4100caba00a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:28.379329 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02dab1b-50ff-440b-a3b8-4100caba00a8 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:28.389469 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 150/285] 10.222.0.60 () {56 vars in 1308 bytes} [Sun Jul 31 01:02:28 2022] GET /identity/v3/role_assignments?user.id=30b5225cc0c04ab9b5b00d2e4273c29e&scope.system=all&role.id=12a8e2ae2b6b4d699aac9ba2319cf57d => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:02:28.393767 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb59ea62-5010-4d53-9b84-da05d5403046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:28.394475 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59ea62-5010-4d53-9b84-da05d5403046 None admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:28.394758 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59ea62-5010-4d53-9b84-da05d5403046 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:28.395078 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59ea62-5010-4d53-9b84-da05d5403046 None admin] PATH_INFO: `/v3/projects/7c49b7e2947f42c096eb6b5a5fca321a/users/fd2884be553947478c4ab65fa34dda7d/roles/d902e34269cc4d79b49b0d035055c40b` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:28.397232 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb59ea62-5010-4d53-9b84-da05d5403046 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c49b7e2947f42c096eb6b5a5fca321a, user_id=fd2884be553947478c4ab65fa34dda7d, role_id=d902e34269cc4d79b49b0d035055c40b)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:28.398726 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb59ea62-5010-4d53-9b84-da05d5403046 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:28.414950 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 136/286] 10.222.0.60 () {58 vars in 1439 bytes} [Sun Jul 31 01:02:28 2022] PUT /identity/v3/projects/7c49b7e2947f42c096eb6b5a5fca321a/users/fd2884be553947478c4ab65fa34dda7d/roles/d902e34269cc4d79b49b0d035055c40b => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:02:28.653614 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918947ce-5612-4700-8995-4464cf6ed0ea None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:28.653952 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918947ce-5612-4700-8995-4464cf6ed0ea None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:28.654276 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918947ce-5612-4700-8995-4464cf6ed0ea None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:28.655968 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 151/287] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:28.662034 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40c53a-621d-4a6e-9e96-682723bebd24 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:28.662323 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40c53a-621d-4a6e-9e96-682723bebd24 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:28.662602 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40c53a-621d-4a6e-9e96-682723bebd24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:28.676193 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:28.683408 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-6a40c53a-621d-4a6e-9e96-682723bebd24 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:28.684646 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-6a40c53a-621d-4a6e-9e96-682723bebd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:28.754660 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 137/288] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:02:28.776931 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918947ce-5612-4700-8995-4464cf6ed0ea None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:28.882936 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918947ce-5612-4700-8995-4464cf6ed0ea None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:28.917421 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c6e29-3cec-4877-96c9-3992f00bf68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:28.917946 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c6e29-3cec-4877-96c9-3992f00bf68b None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:28.918219 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c6e29-3cec-4877-96c9-3992f00bf68b None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:28.918484 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c6e29-3cec-4877-96c9-3992f00bf68b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:28.920439 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:28.929423 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c6e29-3cec-4877-96c9-3992f00bf68b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:28.934741 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-413c6e29-3cec-4877-96c9-3992f00bf68b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:02:28.934741 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:28.934741 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:28.934741 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:28.934741 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:28.934741 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:28.934741 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:28.934741 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:28.934741 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:28.934741 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:28.934741 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:28.934741 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:28.934741 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:28.934741 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:28.934741 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:28.934741 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:28.937654 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:28.937654 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:28.937654 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:28.937654 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:28.937654 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:28.937654 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:28.937654 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:28.937654 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:28.937654 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:28.937654 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:28.937654 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:28.937654 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:28.937654 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:28.937654 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:28.937654 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:28.937654 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:28.938435 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:28.938435 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:28.938435 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:28.938435 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:28.938435 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:28.938435 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:28.938435 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:28.938435 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:28.938435 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:28.938435 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:28.938435 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:02:28.938435 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:02:28.938435 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 152/289] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:02:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:28.942242 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40c53a-621d-4a6e-9e96-682723bebd24 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:29.043828 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40c53a-621d-4a6e-9e96-682723bebd24 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:29.082940 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4c092-775a-465c-9ad9-195917f45aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:29.083594 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4c092-775a-465c-9ad9-195917f45aab None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:29.083872 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4c092-775a-465c-9ad9-195917f45aab None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:29.084133 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4c092-775a-465c-9ad9-195917f45aab None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:29.084851 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f4c092-775a-465c-9ad9-195917f45aab None admin] RBAC: Adding query filter params (name=member) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:29.085150 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f4c092-775a-465c-9ad9-195917f45aab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:29.086518 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f4c092-775a-465c-9ad9-195917f45aab None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:29.088848 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:29.098345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 138/290] 10.222.0.60 () {56 vars in 1101 bytes} [Sun Jul 31 01:02:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:29.103942 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c6e29-3cec-4877-96c9-3992f00bf68b None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:29.203917 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c6e29-3cec-4877-96c9-3992f00bf68b None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:29.237400 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deffe6f7-e085-4fbf-8bc7-89684de4c66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:29.238044 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deffe6f7-e085-4fbf-8bc7-89684de4c66e None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:29.238314 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deffe6f7-e085-4fbf-8bc7-89684de4c66e None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:29.238578 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deffe6f7-e085-4fbf-8bc7-89684de4c66e None admin] PATH_INFO: `/v3/users/cfedeefa365747b7abad05a53a8fa7e9` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:29.239782 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deffe6f7-e085-4fbf-8bc7-89684de4c66e None admin] RBAC: Authorizing `identity:get_user(user_id=cfedeefa365747b7abad05a53a8fa7e9)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:29.241274 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deffe6f7-e085-4fbf-8bc7-89684de4c66e None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:29.243175 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 153/291] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:02:29 2022] GET /identity/v3/users/cfedeefa365747b7abad05a53a8fa7e9 => generated 297 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:29.250018 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4c092-775a-465c-9ad9-195917f45aab None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:29.371739 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4c092-775a-465c-9ad9-195917f45aab None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:29.412385 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae249e1b-ddea-4b26-ba52-9c07c7cc7d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:29.413019 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae249e1b-ddea-4b26-ba52-9c07c7cc7d0a None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:29.413351 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae249e1b-ddea-4b26-ba52-9c07c7cc7d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:29.413623 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae249e1b-ddea-4b26-ba52-9c07c7cc7d0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:29.482273 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:29.491782 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae249e1b-ddea-4b26-ba52-9c07c7cc7d0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:29.493349 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae249e1b-ddea-4b26-ba52-9c07c7cc7d0a None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:29.598640 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 139/292] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:02:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:02:29.604353 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deffe6f7-e085-4fbf-8bc7-89684de4c66e None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:29.666247 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:29.704905 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deffe6f7-e085-4fbf-8bc7-89684de4c66e None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:29.738891 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ee5cd-ca39-462b-b5fb-02eac0b1f1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:29.739513 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ee5cd-ca39-462b-b5fb-02eac0b1f1b7 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:29.739802 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ee5cd-ca39-462b-b5fb-02eac0b1f1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:29.740067 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ee5cd-ca39-462b-b5fb-02eac0b1f1b7 None admin] PATH_INFO: `/v3/projects/7c49b7e2947f42c096eb6b5a5fca321a` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:29.741220 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ee5cd-ca39-462b-b5fb-02eac0b1f1b7 None admin] RBAC: Authorizing `identity:get_project(project_id=7c49b7e2947f42c096eb6b5a5fca321a)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:29.742661 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ee5cd-ca39-462b-b5fb-02eac0b1f1b7 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:29.744648 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 154/293] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:02:29 2022] GET /identity/v3/projects/7c49b7e2947f42c096eb6b5a5fca321a => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:29.750695 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae249e1b-ddea-4b26-ba52-9c07c7cc7d0a None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:29.848687 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae249e1b-ddea-4b26-ba52-9c07c7cc7d0a None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:29.851682 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:29.885203 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130688a-a909-4c7f-9323-8b733f1dc1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:29.885849 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130688a-a909-4c7f-9323-8b733f1dc1ea None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:29.886122 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130688a-a909-4c7f-9323-8b733f1dc1ea None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:29.886389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130688a-a909-4c7f-9323-8b733f1dc1ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:29.887205 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9130688a-a909-4c7f-9323-8b733f1dc1ea None admin] RBAC: Adding query filter params (role.id=12a8e2ae2b6b4d699aac9ba2319cf57d, scope.project.id=7c49b7e2947f42c096eb6b5a5fca321a, user.id=cfedeefa365747b7abad05a53a8fa7e9) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:29.887535 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9130688a-a909-4c7f-9323-8b733f1dc1ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:29.888987 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9130688a-a909-4c7f-9323-8b733f1dc1ea None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:29.896142 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 140/294] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:02:29 2022] GET /identity/v3/role_assignments?user.id=cfedeefa365747b7abad05a53a8fa7e9&scope.project.id=7c49b7e2947f42c096eb6b5a5fca321a&role.id=12a8e2ae2b6b4d699aac9ba2319cf57d => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:30.402790 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42880618-a7a4-4117-be0c-dcb6c0cb2167 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:30.403305 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42880618-a7a4-4117-be0c-dcb6c0cb2167 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:30.403305 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42880618-a7a4-4117-be0c-dcb6c0cb2167 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:30.405016 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 155/295] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:30.411305 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4d3dc-be4b-4a11-af18-f9e719467e70 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:30.411798 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4d3dc-be4b-4a11-af18-f9e719467e70 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:30.411872 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4d3dc-be4b-4a11-af18-f9e719467e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:30.434230 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-45a4d3dc-be4b-4a11-af18-f9e719467e70 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:30.435413 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-45a4d3dc-be4b-4a11-af18-f9e719467e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:30.523647 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 141/296] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:02:30.543227 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42880618-a7a4-4117-be0c-dcb6c0cb2167 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:30.545933 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd79c62-5861-4b01-9c18-55abf15c17fa None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:30.546413 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd79c62-5861-4b01-9c18-55abf15c17fa None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:30.546757 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd79c62-5861-4b01-9c18-55abf15c17fa None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:30.548607 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 142/297] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:02:30.553797 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6502e0-3a54-48ae-a6b7-7c384ea93ad5 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:30.554153 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6502e0-3a54-48ae-a6b7-7c384ea93ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:30.554499 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6502e0-3a54-48ae-a6b7-7c384ea93ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:30.573890 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-9e6502e0-3a54-48ae-a6b7-7c384ea93ad5 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:30.575297 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-9e6502e0-3a54-48ae-a6b7-7c384ea93ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:30.649056 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 143/298] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:02:30.660534 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42880618-a7a4-4117-be0c-dcb6c0cb2167 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:30.674247 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6502e0-3a54-48ae-a6b7-7c384ea93ad5 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:30.694743 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:30.703813 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7e8c3-67c9-41e7-b662-a36b426f8464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:30.704009 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:30.704822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7e8c3-67c9-41e7-b662-a36b426f8464 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:30.705332 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7e8c3-67c9-41e7-b662-a36b426f8464 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:30.706483 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7e8c3-67c9-41e7-b662-a36b426f8464 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:30.722580 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d7e8c3-67c9-41e7-b662-a36b426f8464 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:30.729135 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-b8d7e8c3-67c9-41e7-b662-a36b426f8464 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 01:02:30.729135 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:30.729135 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:30.729135 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:30.729135 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:30.729135 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:30.729135 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:30.729135 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:30.729135 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:30.729135 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:30.729135 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:30.729135 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:30.729135 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:30.729135 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:30.729135 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:30.729135 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:30.730217 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:30.730217 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:30.730217 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:30.730217 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:30.730217 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:30.730217 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:30.730217 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:30.730217 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:30.730217 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:30.730217 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:30.730217 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:30.730217 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:30.730217 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:30.730217 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:30.730217 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:30.730217 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:30.731927 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:30.731927 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:30.731927 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:30.731927 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:30.731927 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:30.731927 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:30.731927 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:30.731927 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:30.731927 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:30.731927 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:30.731927 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 01:02:30.731927 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:02:30.731927 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 156/299] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:02:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:30.744139 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7e8c3-67c9-41e7-b662-a36b426f8464 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:30.800910 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6502e0-3a54-48ae-a6b7-7c384ea93ad5 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:30.846414 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a927332-34ee-428c-a7b8-1e3dccd37cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:30.847314 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a927332-34ee-428c-a7b8-1e3dccd37cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:30.847768 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a927332-34ee-428c-a7b8-1e3dccd37cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:30.848174 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a927332-34ee-428c-a7b8-1e3dccd37cd4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:30.849479 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a927332-34ee-428c-a7b8-1e3dccd37cd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:30.851069 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a927332-34ee-428c-a7b8-1e3dccd37cd4 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:30.853176 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 144/300] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:02:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:02:30.858450 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a927332-34ee-428c-a7b8-1e3dccd37cd4 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:30.870755 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7e8c3-67c9-41e7-b662-a36b426f8464 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:30.909671 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f7aa2-1f2c-46ae-9494-08ef098fb4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:30.910208 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f7aa2-1f2c-46ae-9494-08ef098fb4e9 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:30.910483 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f7aa2-1f2c-46ae-9494-08ef098fb4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:30.910760 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f7aa2-1f2c-46ae-9494-08ef098fb4e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:30.911498 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f7aa2-1f2c-46ae-9494-08ef098fb4e9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:30.911810 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f7aa2-1f2c-46ae-9494-08ef098fb4e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:30.913188 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f7aa2-1f2c-46ae-9494-08ef098fb4e9 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:30.923527 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 157/301] 10.222.0.60 () {56 vars in 1101 bytes} [Sun Jul 31 01:02:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:30.923527 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27895a7f-9fed-4fd2-8911-f0ad99d4704e None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:30.923527 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27895a7f-9fed-4fd2-8911-f0ad99d4704e None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:30.923527 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27895a7f-9fed-4fd2-8911-f0ad99d4704e None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:30.924762 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 158/302] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:30.928188 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27895a7f-9fed-4fd2-8911-f0ad99d4704e None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:30.961116 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:30.972748 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a927332-34ee-428c-a7b8-1e3dccd37cd4 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:30.981629 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:31.016248 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee2b7b-aa82-4550-a01e-868212f698f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:31.016991 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee2b7b-aa82-4550-a01e-868212f698f7 None admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:31.017253 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee2b7b-aa82-4550-a01e-868212f698f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:31.017608 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee2b7b-aa82-4550-a01e-868212f698f7 None admin] PATH_INFO: `/v3/groups` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:31.018392 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ee2b7b-aa82-4550-a01e-868212f698f7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:31.020099 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ee2b7b-aa82-4550-a01e-868212f698f7 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:31.032511 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27895a7f-9fed-4fd2-8911-f0ad99d4704e None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:31.037240 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 145/303] 10.222.0.60 () {60 vars in 1134 bytes} [Sun Jul 31 01:02:30 2022] POST /identity/v3/groups => generated 229 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:02:31.038346 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb0e36-b597-4298-bea9-5749344e734d None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:31.038636 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb0e36-b597-4298-bea9-5749344e734d None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:31.038908 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb0e36-b597-4298-bea9-5749344e734d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:31.069789 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-6cdb0e36-b597-4298-bea9-5749344e734d None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:31.074237 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-6cdb0e36-b597-4298-bea9-5749344e734d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:31.092458 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625ffad-50f8-4d83-8caa-7647d6226a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:31.093835 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625ffad-50f8-4d83-8caa-7647d6226a3f None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:31.094118 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625ffad-50f8-4d83-8caa-7647d6226a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:31.094393 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625ffad-50f8-4d83-8caa-7647d6226a3f None admin] PATH_INFO: `/v3/users/d8a482812e0f432e927dfeaf8e393d84` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:31.117439 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625ffad-50f8-4d83-8caa-7647d6226a3f None admin] RBAC: Authorizing `identity:get_user(user_id=d8a482812e0f432e927dfeaf8e393d84)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:31.119296 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625ffad-50f8-4d83-8caa-7647d6226a3f None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:31.121630 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 159/304] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:02:30 2022] GET /identity/v3/users/d8a482812e0f432e927dfeaf8e393d84 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:31.123261 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9a388-ba88-48ba-80d1-4e644bbce8c1 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:31.123621 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9a388-ba88-48ba-80d1-4e644bbce8c1 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:31.123957 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9a388-ba88-48ba-80d1-4e644bbce8c1 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:31.125590 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 160/305] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:31.127347 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9a388-ba88-48ba-80d1-4e644bbce8c1 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:31.167085 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 146/306] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:02:31.167085 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e05aab-015e-4e41-9cec-2ec8568a3155 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:31.167085 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e05aab-015e-4e41-9cec-2ec8568a3155 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:31.167085 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e05aab-015e-4e41-9cec-2ec8568a3155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:31.184625 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-19e05aab-015e-4e41-9cec-2ec8568a3155 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:31.185910 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-19e05aab-015e-4e41-9cec-2ec8568a3155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:31.257908 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9a388-ba88-48ba-80d1-4e644bbce8c1 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:31.260818 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 147/307] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:02:31.261293 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e05aab-015e-4e41-9cec-2ec8568a3155 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:31.279508 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:31.280576 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:31.305802 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef62a0a-07de-4c61-b705-c64b6d4490b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:31.306430 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef62a0a-07de-4c61-b705-c64b6d4490b1 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:31.306709 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef62a0a-07de-4c61-b705-c64b6d4490b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:31.306985 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef62a0a-07de-4c61-b705-c64b6d4490b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:31.308388 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef62a0a-07de-4c61-b705-c64b6d4490b1 None admin] RBAC: Adding query filter params (role.id=d902e34269cc4d79b49b0d035055c40b, user.id=d8a482812e0f432e927dfeaf8e393d84, scope.system=all) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:31.308388 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef62a0a-07de-4c61-b705-c64b6d4490b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:31.309557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef62a0a-07de-4c61-b705-c64b6d4490b1 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:31.315800 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 161/308] 10.222.0.60 () {56 vars in 1308 bytes} [Sun Jul 31 01:02:31 2022] GET /identity/v3/role_assignments?user.id=d8a482812e0f432e927dfeaf8e393d84&scope.system=all&role.id=d902e34269cc4d79b49b0d035055c40b => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:31.316441 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef62a0a-07de-4c61-b705-c64b6d4490b1 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:31.406902 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e05aab-015e-4e41-9cec-2ec8568a3155 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:31.451771 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09531e6b-777f-448e-9c93-f41bb93f423b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:31.453246 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09531e6b-777f-448e-9c93-f41bb93f423b None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:31.453694 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09531e6b-777f-448e-9c93-f41bb93f423b None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:31.453794 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef62a0a-07de-4c61-b705-c64b6d4490b1 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:31.454534 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09531e6b-777f-448e-9c93-f41bb93f423b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:31.466867 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09531e6b-777f-448e-9c93-f41bb93f423b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:31.472543 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-09531e6b-777f-448e-9c93-f41bb93f423b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 01:02:31.472543 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:31.472543 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:31.472543 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:31.472543 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:31.472543 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:31.472543 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:31.472543 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:31.472543 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:31.472543 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:31.472543 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:31.472543 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:31.472543 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:31.472543 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:31.472543 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:31.472543 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:31.473467 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:31.473467 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:31.473467 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:31.473467 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:31.473467 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:31.473467 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:31.473467 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:31.473467 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:31.473467 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:31.473467 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:31.473467 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:31.473467 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:31.473467 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:31.473467 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:31.473467 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:31.473467 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:31.474246 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:31.474246 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:31.474246 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:31.474246 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:31.474246 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:31.474246 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:31.474246 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:31.474246 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:31.474246 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:31.474246 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:31.474246 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 01:02:31.474246 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:02:31.476669 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 148/309] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:02:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:31.482768 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09531e6b-777f-448e-9c93-f41bb93f423b None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:31.494584 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b950f24-3db2-49c5-8dc5-837520ae6200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:31.495238 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b950f24-3db2-49c5-8dc5-837520ae6200 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:31.495539 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b950f24-3db2-49c5-8dc5-837520ae6200 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:31.495817 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b950f24-3db2-49c5-8dc5-837520ae6200 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:31.507152 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b950f24-3db2-49c5-8dc5-837520ae6200 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:31.512228 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-9b950f24-3db2-49c5-8dc5-837520ae6200 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:02:31.512228 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:31.512228 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:31.512228 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:31.512228 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:31.512228 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:31.512228 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:31.512228 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:31.512228 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:31.512228 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:31.512228 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:31.512228 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:31.512228 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:31.512228 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:31.512228 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:31.512228 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:31.513099 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:31.513099 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:31.513099 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:31.513099 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:31.513099 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:31.513099 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:31.513099 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:31.513099 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:31.513099 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:31.513099 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:31.513099 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:31.513099 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:31.513099 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:31.513099 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:31.513099 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:31.513099 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:31.513868 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:31.513868 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:31.513868 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:31.513868 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:31.513868 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:31.513868 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:31.513868 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:31.513868 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:31.513868 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:31.513868 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:31.513868 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:02:31.513868 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:02:31.513868 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 162/310] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:02:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:31.520315 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b950f24-3db2-49c5-8dc5-837520ae6200 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:31.564999 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:31.570794 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:31.601085 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09531e6b-777f-448e-9c93-f41bb93f423b None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:31.636956 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b71101-b4d8-4231-8836-2b57d3eedbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:31.637879 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b71101-b4d8-4231-8836-2b57d3eedbe3 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:31.638371 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b71101-b4d8-4231-8836-2b57d3eedbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:31.638832 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b71101-b4d8-4231-8836-2b57d3eedbe3 None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:31.639869 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b71101-b4d8-4231-8836-2b57d3eedbe3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:31.640508 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b71101-b4d8-4231-8836-2b57d3eedbe3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:31.642118 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b71101-b4d8-4231-8836-2b57d3eedbe3 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:31.651158 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 149/311] 10.222.0.60 () {56 vars in 1101 bytes} [Sun Jul 31 01:02:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:02:31.656982 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b71101-b4d8-4231-8836-2b57d3eedbe3 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:31.657313 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b950f24-3db2-49c5-8dc5-837520ae6200 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:31.699471 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff21a1c-e1c5-4d32-85eb-7e9938a596ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:31.700503 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff21a1c-e1c5-4d32-85eb-7e9938a596ce None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:31.700947 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff21a1c-e1c5-4d32-85eb-7e9938a596ce None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:31.701402 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff21a1c-e1c5-4d32-85eb-7e9938a596ce None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:31.702453 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff21a1c-e1c5-4d32-85eb-7e9938a596ce None admin] RBAC: Adding query filter params (name=member) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:31.702926 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff21a1c-e1c5-4d32-85eb-7e9938a596ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:31.704549 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff21a1c-e1c5-4d32-85eb-7e9938a596ce None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:31.713833 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 163/312] 10.222.0.60 () {56 vars in 1101 bytes} [Sun Jul 31 01:02:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:31.719794 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff21a1c-e1c5-4d32-85eb-7e9938a596ce None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:31.768326 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b71101-b4d8-4231-8836-2b57d3eedbe3 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:31.808199 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:31.815749 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce73bd2-1c69-453f-b55a-a2859bbbc317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:31.816406 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce73bd2-1c69-453f-b55a-a2859bbbc317 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:31.816684 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce73bd2-1c69-453f-b55a-a2859bbbc317 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:31.817020 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce73bd2-1c69-453f-b55a-a2859bbbc317 None admin] PATH_INFO: `/v3/users/fd2884be553947478c4ab65fa34dda7d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:31.818759 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce73bd2-1c69-453f-b55a-a2859bbbc317 None admin] RBAC: Authorizing `identity:get_user(user_id=fd2884be553947478c4ab65fa34dda7d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:31.820504 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce73bd2-1c69-453f-b55a-a2859bbbc317 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:31.823525 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 150/313] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:02:31 2022] GET /identity/v3/users/fd2884be553947478c4ab65fa34dda7d => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:02:31.828453 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce73bd2-1c69-453f-b55a-a2859bbbc317 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:31.830361 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:31.837328 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff21a1c-e1c5-4d32-85eb-7e9938a596ce None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:31.878530 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a51c8c-41a6-416d-b015-1df67d884104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:31.879357 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a51c8c-41a6-416d-b015-1df67d884104 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:31.879742 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a51c8c-41a6-416d-b015-1df67d884104 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:31.880106 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a51c8c-41a6-416d-b015-1df67d884104 None admin] PATH_INFO: `/v3/users/30b5225cc0c04ab9b5b00d2e4273c29e` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:31.881881 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a51c8c-41a6-416d-b015-1df67d884104 None admin] RBAC: Authorizing `identity:get_user(user_id=30b5225cc0c04ab9b5b00d2e4273c29e)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:31.882879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a51c8c-41a6-416d-b015-1df67d884104 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:31.884909 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 164/314] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:02:31 2022] GET /identity/v3/users/30b5225cc0c04ab9b5b00d2e4273c29e => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:02:31.892413 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a51c8c-41a6-416d-b015-1df67d884104 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:31.956402 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce73bd2-1c69-453f-b55a-a2859bbbc317 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:31.996008 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c388763-da6e-4d52-9ca7-be64d0bd0943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:31.996906 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c388763-da6e-4d52-9ca7-be64d0bd0943 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:31.997839 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c388763-da6e-4d52-9ca7-be64d0bd0943 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:31.998257 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c388763-da6e-4d52-9ca7-be64d0bd0943 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:32.029772 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a51c8c-41a6-416d-b015-1df67d884104 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:32.064513 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca5459-7329-4397-8a09-c95a7bec7516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:32.065295 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca5459-7329-4397-8a09-c95a7bec7516 None admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:32.065576 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca5459-7329-4397-8a09-c95a7bec7516 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:32.065849 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca5459-7329-4397-8a09-c95a7bec7516 None admin] PATH_INFO: `/v3/system/users/30b5225cc0c04ab9b5b00d2e4273c29e/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:32.067312 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca5459-7329-4397-8a09-c95a7bec7516 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=30b5225cc0c04ab9b5b00d2e4273c29e, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:32.068872 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca5459-7329-4397-8a09-c95a7bec7516 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:32.083583 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 165/315] 10.222.0.60 () {58 vars in 1334 bytes} [Sun Jul 31 01:02:31 2022] PUT /identity/v3/system/users/30b5225cc0c04ab9b5b00d2e4273c29e/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:02:32.100339 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:32.104320 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c388763-da6e-4d52-9ca7-be64d0bd0943 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:32.105754 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c388763-da6e-4d52-9ca7-be64d0bd0943 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:32.230239 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 151/316] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:02:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:02:32.235682 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca5459-7329-4397-8a09-c95a7bec7516 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:32.266229 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:32.340343 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca5459-7329-4397-8a09-c95a7bec7516 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:32.375072 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bdc528-6dd0-4b31-99cc-a9357b791045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:32.375754 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdc528-6dd0-4b31-99cc-a9357b791045 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:32.376032 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdc528-6dd0-4b31-99cc-a9357b791045 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:32.376303 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdc528-6dd0-4b31-99cc-a9357b791045 None admin] PATH_INFO: `/v3/projects/7c49b7e2947f42c096eb6b5a5fca321a` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:32.377870 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bdc528-6dd0-4b31-99cc-a9357b791045 None admin] RBAC: Authorizing `identity:get_project(project_id=7c49b7e2947f42c096eb6b5a5fca321a)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:32.379369 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bdc528-6dd0-4b31-99cc-a9357b791045 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:32.381662 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 166/317] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:02:32 2022] GET /identity/v3/projects/7c49b7e2947f42c096eb6b5a5fca321a => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:32.387772 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c388763-da6e-4d52-9ca7-be64d0bd0943 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:32.496974 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:32.500248 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c388763-da6e-4d52-9ca7-be64d0bd0943 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:32.536391 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3b48e-5255-48c3-a665-e279a6816547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:32.537027 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3b48e-5255-48c3-a665-e279a6816547 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:32.537306 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3b48e-5255-48c3-a665-e279a6816547 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:32.537583 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3b48e-5255-48c3-a665-e279a6816547 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:32.538397 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3b48e-5255-48c3-a665-e279a6816547 None admin] RBAC: Adding query filter params (role.id=d902e34269cc4d79b49b0d035055c40b, scope.project.id=7c49b7e2947f42c096eb6b5a5fca321a, user.id=fd2884be553947478c4ab65fa34dda7d) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:32.538797 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3b48e-5255-48c3-a665-e279a6816547 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:32.540280 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3b48e-5255-48c3-a665-e279a6816547 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:32.547092 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 152/318] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:02:32 2022] GET /identity/v3/role_assignments?user.id=fd2884be553947478c4ab65fa34dda7d&scope.project.id=7c49b7e2947f42c096eb6b5a5fca321a&role.id=d902e34269cc4d79b49b0d035055c40b => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:33.082912 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2dc3df-d708-4016-8869-23c453d6b04a None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:33.083457 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2dc3df-d708-4016-8869-23c453d6b04a None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:33.083457 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2dc3df-d708-4016-8869-23c453d6b04a None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:33.085005 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 167/319] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:33.090076 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32d02a-6ee9-4872-ae98-9ce4401ac692 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:33.090370 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32d02a-6ee9-4872-ae98-9ce4401ac692 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:33.090645 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32d02a-6ee9-4872-ae98-9ce4401ac692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:33.108823 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-3b32d02a-6ee9-4872-ae98-9ce4401ac692 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:33.110007 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-3b32d02a-6ee9-4872-ae98-9ce4401ac692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:33.178579 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 153/320] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:02:33.200715 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2dc3df-d708-4016-8869-23c453d6b04a None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:33.300269 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:33.308171 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2dc3df-d708-4016-8869-23c453d6b04a None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:33.343676 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176fbe94-0c96-4e0d-948b-3090d99f7a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:33.344202 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fbe94-0c96-4e0d-948b-3090d99f7a36 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:33.344481 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fbe94-0c96-4e0d-948b-3090d99f7a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:33.344753 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fbe94-0c96-4e0d-948b-3090d99f7a36 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:33.346012 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176fbe94-0c96-4e0d-948b-3090d99f7a36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:33.347470 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176fbe94-0c96-4e0d-948b-3090d99f7a36 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:33.349274 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 168/321] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:02:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:33.356401 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32d02a-6ee9-4872-ae98-9ce4401ac692 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:33.375107 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d5958-7ba0-4bf1-838b-33b9597f1817 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:33.375545 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d5958-7ba0-4bf1-838b-33b9597f1817 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:33.375864 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d5958-7ba0-4bf1-838b-33b9597f1817 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:33.377886 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 169/322] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:02:33.382779 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657e4aa-766e-4142-b401-fe1cbdcfdefd None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:33.383062 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657e4aa-766e-4142-b401-fe1cbdcfdefd None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:33.383346 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657e4aa-766e-4142-b401-fe1cbdcfdefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:33.402233 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-2657e4aa-766e-4142-b401-fe1cbdcfdefd None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:33.403794 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-2657e4aa-766e-4142-b401-fe1cbdcfdefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:33.456620 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:33.463943 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32d02a-6ee9-4872-ae98-9ce4401ac692 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:33.477774 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 170/323] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:02:33.499350 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657e4aa-766e-4142-b401-fe1cbdcfdefd None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:33.503671 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68fdf7d-15d3-4a27-ac9d-2ab53f2adf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:33.504306 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fdf7d-15d3-4a27-ac9d-2ab53f2adf31 None admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:33.504583 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fdf7d-15d3-4a27-ac9d-2ab53f2adf31 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:33.504853 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fdf7d-15d3-4a27-ac9d-2ab53f2adf31 None admin] PATH_INFO: `/v3/groups` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:33.505529 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68fdf7d-15d3-4a27-ac9d-2ab53f2adf31 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:33.506985 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68fdf7d-15d3-4a27-ac9d-2ab53f2adf31 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:33.527098 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 154/324] 10.222.0.60 () {60 vars in 1134 bytes} [Sun Jul 31 01:02:33 2022] POST /identity/v3/groups => generated 226 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:02:33.602257 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:33.611126 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657e4aa-766e-4142-b401-fe1cbdcfdefd None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:33.648484 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265117d1-b340-450d-8ec2-2e16e54db9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:33.649194 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265117d1-b340-450d-8ec2-2e16e54db9e2 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:33.649473 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265117d1-b340-450d-8ec2-2e16e54db9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:33.649745 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265117d1-b340-450d-8ec2-2e16e54db9e2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:33.661446 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265117d1-b340-450d-8ec2-2e16e54db9e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:33.666511 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-265117d1-b340-450d-8ec2-2e16e54db9e2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 01:02:33.666511 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:33.666511 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:33.666511 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:33.666511 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:33.666511 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:33.666511 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:33.666511 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:33.666511 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:33.666511 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:33.666511 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:33.666511 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:33.666511 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:33.666511 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:33.666511 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:33.666511 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:33.667416 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:33.667416 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:33.667416 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:33.667416 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:33.667416 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:33.667416 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:33.667416 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:33.667416 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:33.667416 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:33.667416 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:33.667416 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:33.667416 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:33.667416 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:33.667416 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:33.667416 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:33.667416 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:33.668895 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:33.668895 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:33.668895 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:33.668895 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:33.668895 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:33.668895 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:33.668895 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:33.668895 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:33.668895 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:33.668895 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:33.668895 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 01:02:33.668895 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:02:33.668895 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 171/325] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:02:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:33.674047 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68fdf7d-15d3-4a27-ac9d-2ab53f2adf31 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:33.785992 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68fdf7d-15d3-4a27-ac9d-2ab53f2adf31 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:33.823407 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f667c1-0604-4d27-9ddc-75ea8cd845d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:33.824074 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f667c1-0604-4d27-9ddc-75ea8cd845d4 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:33.824353 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f667c1-0604-4d27-9ddc-75ea8cd845d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:33.824628 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f667c1-0604-4d27-9ddc-75ea8cd845d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:33.825362 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f667c1-0604-4d27-9ddc-75ea8cd845d4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:33.825669 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f667c1-0604-4d27-9ddc-75ea8cd845d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:33.827048 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f667c1-0604-4d27-9ddc-75ea8cd845d4 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:33.835997 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 155/326] 10.222.0.60 () {56 vars in 1101 bytes} [Sun Jul 31 01:02:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:33.841646 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265117d1-b340-450d-8ec2-2e16e54db9e2 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:33.955098 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265117d1-b340-450d-8ec2-2e16e54db9e2 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:33.991154 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c8a05-a680-4a4e-aa6c-7bb55f1b87d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:33.991831 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c8a05-a680-4a4e-aa6c-7bb55f1b87d2 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:33.992103 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c8a05-a680-4a4e-aa6c-7bb55f1b87d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:33.992371 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c8a05-a680-4a4e-aa6c-7bb55f1b87d2 None admin] PATH_INFO: `/v3/users/d8a482812e0f432e927dfeaf8e393d84` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:33.993533 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c8a05-a680-4a4e-aa6c-7bb55f1b87d2 None admin] RBAC: Authorizing `identity:get_user(user_id=d8a482812e0f432e927dfeaf8e393d84)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:33.994983 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c8a05-a680-4a4e-aa6c-7bb55f1b87d2 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:33.996928 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 172/327] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:02:33 2022] GET /identity/v3/users/d8a482812e0f432e927dfeaf8e393d84 => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:34.003241 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f667c1-0604-4d27-9ddc-75ea8cd845d4 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:34.026742 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:34.118167 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f667c1-0604-4d27-9ddc-75ea8cd845d4 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:34.155716 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24887643-65c7-49c6-9528-833f1e4cf4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:34.156758 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24887643-65c7-49c6-9528-833f1e4cf4ce None admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:34.157237 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24887643-65c7-49c6-9528-833f1e4cf4ce None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:34.157706 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24887643-65c7-49c6-9528-833f1e4cf4ce None admin] PATH_INFO: `/v3/system/users/d8a482812e0f432e927dfeaf8e393d84/roles/d902e34269cc4d79b49b0d035055c40b` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:34.159557 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24887643-65c7-49c6-9528-833f1e4cf4ce None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d8a482812e0f432e927dfeaf8e393d84, role_id=d902e34269cc4d79b49b0d035055c40b)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:34.161176 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24887643-65c7-49c6-9528-833f1e4cf4ce None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:34.173250 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 156/328] 10.222.0.60 () {58 vars in 1334 bytes} [Sun Jul 31 01:02:34 2022] PUT /identity/v3/system/users/d8a482812e0f432e927dfeaf8e393d84/roles/d902e34269cc4d79b49b0d035055c40b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:02:34.177152 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017e971-4513-4db2-831f-7d9b1304d6a8 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:34.177632 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017e971-4513-4db2-831f-7d9b1304d6a8 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:34.177632 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017e971-4513-4db2-831f-7d9b1304d6a8 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:34.179290 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 173/329] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:34.185298 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07be333-72e5-4dce-8577-a906d11b3e11 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:34.185871 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07be333-72e5-4dce-8577-a906d11b3e11 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:34.186152 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07be333-72e5-4dce-8577-a906d11b3e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:34.206714 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-f07be333-72e5-4dce-8577-a906d11b3e11 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:34.207933 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-f07be333-72e5-4dce-8577-a906d11b3e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:34.289126 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 157/330] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:02:34.313024 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017e971-4513-4db2-831f-7d9b1304d6a8 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:34.347962 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:34.443655 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017e971-4513-4db2-831f-7d9b1304d6a8 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:34.497843 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea1060c-75b6-4800-a181-335f8810cd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:34.498425 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1060c-75b6-4800-a181-335f8810cd8d None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:34.498703 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1060c-75b6-4800-a181-335f8810cd8d None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:34.498970 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1060c-75b6-4800-a181-335f8810cd8d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:34.521261 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea1060c-75b6-4800-a181-335f8810cd8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:34.526226 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-9ea1060c-75b6-4800-a181-335f8810cd8d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:02:34.526226 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:34.526226 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:34.526226 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:34.526226 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:34.526226 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:34.526226 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:34.526226 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:34.526226 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:34.526226 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:34.526226 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:34.526226 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:34.526226 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:34.526226 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:34.526226 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:34.526226 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:34.527255 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:34.527255 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:34.527255 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:34.527255 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:34.527255 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:34.527255 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:34.527255 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:34.527255 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:34.527255 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:34.527255 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:34.527255 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:34.527255 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:34.527255 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:34.527255 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:34.527255 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:34.527255 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:34.528473 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:34.528473 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:34.528473 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:34.528473 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:34.528473 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:34.528473 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:34.528473 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:34.528473 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:34.528473 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:34.528473 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:34.528473 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:02:34.528473 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:02:34.528473 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 174/331] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:02:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:34.536900 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07be333-72e5-4dce-8577-a906d11b3e11 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:34.549063 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:34.669734 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07be333-72e5-4dce-8577-a906d11b3e11 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:34.710425 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1ab72-53db-4e6b-84d8-aa74ac24ec8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:34.711356 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1ab72-53db-4e6b-84d8-aa74ac24ec8f None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:34.711816 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1ab72-53db-4e6b-84d8-aa74ac24ec8f None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:34.712286 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1ab72-53db-4e6b-84d8-aa74ac24ec8f None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:34.713201 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec1ab72-53db-4e6b-84d8-aa74ac24ec8f None admin] RBAC: Adding query filter params (name=member) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:34.713839 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec1ab72-53db-4e6b-84d8-aa74ac24ec8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:34.715383 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec1ab72-53db-4e6b-84d8-aa74ac24ec8f None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:34.727403 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 158/332] 10.222.0.60 () {56 vars in 1101 bytes} [Sun Jul 31 01:02:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:34.732928 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea1060c-75b6-4800-a181-335f8810cd8d None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:34.851807 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:34.873870 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea1060c-75b6-4800-a181-335f8810cd8d None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:34.918456 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c83d40-42b0-4c61-96a7-ac4da8be33b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:34.919110 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c83d40-42b0-4c61-96a7-ac4da8be33b8 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:34.919387 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c83d40-42b0-4c61-96a7-ac4da8be33b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:34.919684 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c83d40-42b0-4c61-96a7-ac4da8be33b8 None admin] PATH_INFO: `/v3/users/30b5225cc0c04ab9b5b00d2e4273c29e` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:34.920897 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c83d40-42b0-4c61-96a7-ac4da8be33b8 None admin] RBAC: Authorizing `identity:get_user(user_id=30b5225cc0c04ab9b5b00d2e4273c29e)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:34.922513 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c83d40-42b0-4c61-96a7-ac4da8be33b8 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:34.924914 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 175/333] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:02:34 2022] GET /identity/v3/users/30b5225cc0c04ab9b5b00d2e4273c29e => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:34.931152 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1ab72-53db-4e6b-84d8-aa74ac24ec8f None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:35.020231 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:35.048495 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1ab72-53db-4e6b-84d8-aa74ac24ec8f None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:35.086599 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3c755-533a-4185-9b41-b3a1d204477a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:35.087226 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3c755-533a-4185-9b41-b3a1d204477a None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:35.087504 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3c755-533a-4185-9b41-b3a1d204477a None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:35.087803 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3c755-533a-4185-9b41-b3a1d204477a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:35.088591 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db3c755-533a-4185-9b41-b3a1d204477a None admin] RBAC: Adding query filter params (role.id=12a8e2ae2b6b4d699aac9ba2319cf57d, user.id=30b5225cc0c04ab9b5b00d2e4273c29e, scope.system=all) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:35.088896 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db3c755-533a-4185-9b41-b3a1d204477a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:35.090334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db3c755-533a-4185-9b41-b3a1d204477a None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:35.105513 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 159/334] 10.222.0.60 () {56 vars in 1308 bytes} [Sun Jul 31 01:02:34 2022] GET /identity/v3/role_assignments?user.id=30b5225cc0c04ab9b5b00d2e4273c29e&scope.system=all&role.id=12a8e2ae2b6b4d699aac9ba2319cf57d => generated 510 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:35.874526 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65204ee-c409-45f7-9c61-af1aa26fed6a None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:35.875049 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65204ee-c409-45f7-9c61-af1aa26fed6a None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:35.875049 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65204ee-c409-45f7-9c61-af1aa26fed6a None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:35.876821 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 176/335] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:35.884029 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add91b2-03f1-45bf-8292-72646e14e96e None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:35.884474 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add91b2-03f1-45bf-8292-72646e14e96e None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:35.884558 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add91b2-03f1-45bf-8292-72646e14e96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:35.904154 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-3add91b2-03f1-45bf-8292-72646e14e96e None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:35.905407 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-3add91b2-03f1-45bf-8292-72646e14e96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:35.978648 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 160/336] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:02:36.010693 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65204ee-c409-45f7-9c61-af1aa26fed6a None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:36.142530 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65204ee-c409-45f7-9c61-af1aa26fed6a None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:36.183028 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4feb80b-4bb1-48a5-a0f1-fd6f7b31e4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:36.183704 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4feb80b-4bb1-48a5-a0f1-fd6f7b31e4a4 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:36.183977 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4feb80b-4bb1-48a5-a0f1-fd6f7b31e4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:36.184240 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4feb80b-4bb1-48a5-a0f1-fd6f7b31e4a4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:36.197048 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4feb80b-4bb1-48a5-a0f1-fd6f7b31e4a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:36.202007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-a4feb80b-4bb1-48a5-a0f1-fd6f7b31e4a4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:02:36.202007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:36.202007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:36.202007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:36.202007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:36.202007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:36.202007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:36.202007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:36.202007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:36.202007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:36.202007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:36.202007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:36.202007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:36.202007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:36.202007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:36.202007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:36.202972 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:36.202972 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:36.202972 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:36.202972 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:36.202972 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:36.202972 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:36.202972 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:36.202972 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:36.202972 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:36.202972 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:36.202972 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:36.202972 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:36.202972 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:36.202972 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:36.202972 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:36.202972 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:36.203786 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:36.203786 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:36.203786 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:36.203786 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:36.203786 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:36.203786 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:36.203786 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:36.203786 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:36.203786 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:36.203786 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:36.203786 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:02:36.203786 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:02:36.203786 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 177/337] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:02:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:36.210602 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add91b2-03f1-45bf-8292-72646e14e96e None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:36.279620 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:36.327883 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add91b2-03f1-45bf-8292-72646e14e96e None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:36.364401 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e4a5c-6c22-475a-a095-51c96822e518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:36.365322 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e4a5c-6c22-475a-a095-51c96822e518 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:36.365322 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e4a5c-6c22-475a-a095-51c96822e518 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:36.365636 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e4a5c-6c22-475a-a095-51c96822e518 None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:36.366290 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e4a5c-6c22-475a-a095-51c96822e518 None admin] RBAC: Adding query filter params (name=member) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:36.366592 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e4a5c-6c22-475a-a095-51c96822e518 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:36.368083 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e4a5c-6c22-475a-a095-51c96822e518 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:36.377865 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 161/338] 10.222.0.60 () {56 vars in 1101 bytes} [Sun Jul 31 01:02:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:02:36.383898 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4feb80b-4bb1-48a5-a0f1-fd6f7b31e4a4 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:36.404495 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:36.541629 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4feb80b-4bb1-48a5-a0f1-fd6f7b31e4a4 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:36.577897 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93a8d9-dd77-4e38-9788-1ef4c0fbedff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:36.578527 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93a8d9-dd77-4e38-9788-1ef4c0fbedff None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:36.578804 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93a8d9-dd77-4e38-9788-1ef4c0fbedff None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:36.579073 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93a8d9-dd77-4e38-9788-1ef4c0fbedff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:36.669628 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93a8d9-dd77-4e38-9788-1ef4c0fbedff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:36.671061 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93a8d9-dd77-4e38-9788-1ef4c0fbedff None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:36.688351 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:36.790663 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 178/339] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:02:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:02:36.796525 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e4a5c-6c22-475a-a095-51c96822e518 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:36.927701 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e4a5c-6c22-475a-a095-51c96822e518 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:36.951112 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:36.973477 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78341d8f-e2b8-4991-b4fd-f0003aa5224e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:36.974171 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78341d8f-e2b8-4991-b4fd-f0003aa5224e None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:36.974448 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78341d8f-e2b8-4991-b4fd-f0003aa5224e None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:36.974723 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78341d8f-e2b8-4991-b4fd-f0003aa5224e None admin] PATH_INFO: `/v3/projects/882624ffe602494b95664e06c16d55a2` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:36.975998 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78341d8f-e2b8-4991-b4fd-f0003aa5224e None admin] RBAC: Authorizing `identity:get_project(project_id=882624ffe602494b95664e06c16d55a2)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:36.977462 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78341d8f-e2b8-4991-b4fd-f0003aa5224e None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:36.979233 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 162/340] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:02:36 2022] GET /identity/v3/projects/882624ffe602494b95664e06c16d55a2 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:36.985280 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93a8d9-dd77-4e38-9788-1ef4c0fbedff None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:36.999333 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b342b1-47d0-447c-bd44-9f87a6cedbe5 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:36.999659 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b342b1-47d0-447c-bd44-9f87a6cedbe5 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:36.999915 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b342b1-47d0-447c-bd44-9f87a6cedbe5 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:37.001274 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 163/341] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:37.007643 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665eae11-7fae-4fac-bf89-85f50153c859 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:37.007928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665eae11-7fae-4fac-bf89-85f50153c859 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:37.008375 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665eae11-7fae-4fac-bf89-85f50153c859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:37.040556 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-665eae11-7fae-4fac-bf89-85f50153c859 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:37.041766 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-665eae11-7fae-4fac-bf89-85f50153c859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:37.132863 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93a8d9-dd77-4e38-9788-1ef4c0fbedff None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:37.144337 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:37.153394 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 164/342] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:02:37.176799 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca421865-82d8-4243-9030-c16864087798 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:37.177093 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca421865-82d8-4243-9030-c16864087798 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:37.177459 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca421865-82d8-4243-9030-c16864087798 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:37.177922 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c99ed-1d09-48a5-9f83-ba31353a167e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:37.178526 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c99ed-1d09-48a5-9f83-ba31353a167e None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:37.178801 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c99ed-1d09-48a5-9f83-ba31353a167e None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:37.179065 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 165/343] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:37.179173 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c99ed-1d09-48a5-9f83-ba31353a167e None admin] PATH_INFO: `/v3/groups/a5bf2cfd89604dff83c7fdae945e6b5c` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:37.193985 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c99ed-1d09-48a5-9f83-ba31353a167e None admin] RBAC: Authorizing `identity:get_group(group_id=a5bf2cfd89604dff83c7fdae945e6b5c)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:37.195458 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c99ed-1d09-48a5-9f83-ba31353a167e None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:37.197188 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 179/344] 10.222.0.60 () {56 vars in 1180 bytes} [Sun Jul 31 01:02:36 2022] GET /identity/v3/groups/a5bf2cfd89604dff83c7fdae945e6b5c => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:37.202679 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79952377-21cd-46d3-b0a6-74d69e332bb1 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:37.202959 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79952377-21cd-46d3-b0a6-74d69e332bb1 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:37.203236 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79952377-21cd-46d3-b0a6-74d69e332bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:37.205606 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c99ed-1d09-48a5-9f83-ba31353a167e None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:37.231653 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-79952377-21cd-46d3-b0a6-74d69e332bb1 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:37.232833 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-79952377-21cd-46d3-b0a6-74d69e332bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:37.368566 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c99ed-1d09-48a5-9f83-ba31353a167e None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:37.375021 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 166/345] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:02:37.375920 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79952377-21cd-46d3-b0a6-74d69e332bb1 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:37.432250 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e626990-e32f-4caa-982d-bd36795077b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:37.433273 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e626990-e32f-4caa-982d-bd36795077b0 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:37.433748 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e626990-e32f-4caa-982d-bd36795077b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:37.434300 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e626990-e32f-4caa-982d-bd36795077b0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:37.451977 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e626990-e32f-4caa-982d-bd36795077b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:37.455606 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:37.460286 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-7e626990-e32f-4caa-982d-bd36795077b0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:02:37.460286 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:37.460286 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:37.460286 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:37.460286 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:37.460286 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:37.460286 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:37.460286 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:37.460286 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:37.460286 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:37.460286 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:37.460286 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:37.460286 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:37.460286 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:37.460286 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:37.460286 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:37.463137 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:37.463137 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:37.463137 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:37.463137 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:37.463137 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:37.463137 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:37.463137 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:37.463137 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:37.463137 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:37.463137 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:37.463137 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:37.463137 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:37.463137 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:37.463137 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:37.463137 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:37.463137 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:37.466142 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:37.466142 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:37.466142 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:37.466142 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:37.466142 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:37.466142 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:37.466142 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:37.466142 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:37.466142 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:37.466142 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:37.466142 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:02:37.466142 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:02:37.466142 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 180/346] 10.222.0.60 () {56 vars in 1114 bytes} [Sun Jul 31 01:02:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:02:37.469087 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e626990-e32f-4caa-982d-bd36795077b0 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:37.522971 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:37.550980 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79952377-21cd-46d3-b0a6-74d69e332bb1 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:37.598269 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a717e2-e2d3-473e-bd29-2c3effdb64ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:37.599424 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a717e2-e2d3-473e-bd29-2c3effdb64ed None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:37.603222 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a717e2-e2d3-473e-bd29-2c3effdb64ed None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:37.603732 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a717e2-e2d3-473e-bd29-2c3effdb64ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:37.604761 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a717e2-e2d3-473e-bd29-2c3effdb64ed None admin] RBAC: Adding query filter params (group.id=a5bf2cfd89604dff83c7fdae945e6b5c, role.id=12a8e2ae2b6b4d699aac9ba2319cf57d, scope.project.id=882624ffe602494b95664e06c16d55a2) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:37.605288 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a717e2-e2d3-473e-bd29-2c3effdb64ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:37.606948 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a717e2-e2d3-473e-bd29-2c3effdb64ed None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:37.616170 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e626990-e32f-4caa-982d-bd36795077b0 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:37.616501 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 167/347] 10.222.0.60 () {56 vars in 1376 bytes} [Sun Jul 31 01:02:37 2022] GET /identity/v3/role_assignments?group.id=a5bf2cfd89604dff83c7fdae945e6b5c&scope.project.id=882624ffe602494b95664e06c16d55a2&role.id=12a8e2ae2b6b4d699aac9ba2319cf57d => generated 260 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:37.617517 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a717e2-e2d3-473e-bd29-2c3effdb64ed None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:37.663181 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526bcfa-d7ba-4e6b-b657-027583823627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:37.664003 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526bcfa-d7ba-4e6b-b657-027583823627 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:37.664337 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526bcfa-d7ba-4e6b-b657-027583823627 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:37.664672 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526bcfa-d7ba-4e6b-b657-027583823627 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:37.681864 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c526bcfa-d7ba-4e6b-b657-027583823627 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:37.689187 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-c526bcfa-d7ba-4e6b-b657-027583823627 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 01:02:37.689187 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:37.689187 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:37.689187 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:37.689187 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:37.689187 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:37.689187 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:37.689187 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:37.689187 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:37.689187 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:37.689187 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:37.689187 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:37.689187 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:37.689187 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:37.689187 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:37.689187 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:37.690389 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:37.690389 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:37.690389 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:37.690389 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:37.690389 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:37.690389 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:37.690389 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:37.690389 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:37.690389 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:37.690389 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:37.690389 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:37.690389 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:37.690389 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:37.690389 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:37.690389 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:37.690389 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:37.691217 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:37.691217 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:37.691217 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:37.691217 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:37.691217 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:37.691217 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:37.691217 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:37.691217 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:37.691217 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:37.691217 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:37.691217 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 01:02:37.691217 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:02:37.695673 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 181/348] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:02:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:37.699063 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9356f-8f71-4965-a697-dbc4ed7b02c5 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:37.699063 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9356f-8f71-4965-a697-dbc4ed7b02c5 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:37.699063 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9356f-8f71-4965-a697-dbc4ed7b02c5 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:37.699410 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 182/349] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:37.700876 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9356f-8f71-4965-a697-dbc4ed7b02c5 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:37.801802 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a717e2-e2d3-473e-bd29-2c3effdb64ed None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:37.831131 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:37.833410 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:37.849166 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9356f-8f71-4965-a697-dbc4ed7b02c5 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:37.879776 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2020c58-aaa1-45db-a83a-b173bfd8d54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:37.880419 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2020c58-aaa1-45db-a83a-b173bfd8d54c None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:37.880690 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2020c58-aaa1-45db-a83a-b173bfd8d54c None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:37.880954 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2020c58-aaa1-45db-a83a-b173bfd8d54c None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:37.881689 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2020c58-aaa1-45db-a83a-b173bfd8d54c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:37.881991 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2020c58-aaa1-45db-a83a-b173bfd8d54c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:37.883372 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2020c58-aaa1-45db-a83a-b173bfd8d54c None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:37.903059 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 168/350] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:02:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:37.908010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0b0c9-be73-4104-8927-1f7ee02ecfde None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:37.909013 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0b0c9-be73-4104-8927-1f7ee02ecfde None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:37.909494 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0b0c9-be73-4104-8927-1f7ee02ecfde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:37.921503 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9180dbf8-1cc3-489f-a872-e10b8e536877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:37.922128 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180dbf8-1cc3-489f-a872-e10b8e536877 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:37.922412 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180dbf8-1cc3-489f-a872-e10b8e536877 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:37.922682 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180dbf8-1cc3-489f-a872-e10b8e536877 None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:37.923453 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9180dbf8-1cc3-489f-a872-e10b8e536877 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:37.923817 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9180dbf8-1cc3-489f-a872-e10b8e536877 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:37.925267 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9180dbf8-1cc3-489f-a872-e10b8e536877 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:37.938614 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-b4b0b0c9-be73-4104-8927-1f7ee02ecfde None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:37.939142 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 183/351] 10.222.0.60 () {56 vars in 1101 bytes} [Sun Jul 31 01:02:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:02:37.940856 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-b4b0b0c9-be73-4104-8927-1f7ee02ecfde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:37.945130 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9180dbf8-1cc3-489f-a872-e10b8e536877 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:38.071677 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 169/352] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:02:38.072707 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0b0c9-be73-4104-8927-1f7ee02ecfde None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:38.124941 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9180dbf8-1cc3-489f-a872-e10b8e536877 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:38.172235 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719fd17-0050-46ee-b80f-4ad35eee2cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:38.173311 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719fd17-0050-46ee-b80f-4ad35eee2cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:38.173874 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719fd17-0050-46ee-b80f-4ad35eee2cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:38.174399 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719fd17-0050-46ee-b80f-4ad35eee2cf6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:38.203005 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0b0c9-be73-4104-8927-1f7ee02ecfde None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:38.205312 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:38.210749 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:38.254378 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b89ec-0b74-45dc-b0e9-43ed341aad28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:38.255592 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b89ec-0b74-45dc-b0e9-43ed341aad28 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:38.256067 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b89ec-0b74-45dc-b0e9-43ed341aad28 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:38.256528 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b89ec-0b74-45dc-b0e9-43ed341aad28 None admin] PATH_INFO: `/v3/users/d8a482812e0f432e927dfeaf8e393d84` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:38.258151 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b89ec-0b74-45dc-b0e9-43ed341aad28 None admin] RBAC: Authorizing `identity:get_user(user_id=d8a482812e0f432e927dfeaf8e393d84)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:38.259988 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b89ec-0b74-45dc-b0e9-43ed341aad28 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:38.261216 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4719fd17-0050-46ee-b80f-4ad35eee2cf6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:38.262215 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 170/353] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:02:38 2022] GET /identity/v3/users/d8a482812e0f432e927dfeaf8e393d84 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:38.262991 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4719fd17-0050-46ee-b80f-4ad35eee2cf6 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:38.263668 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b89ec-0b74-45dc-b0e9-43ed341aad28 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:38.368395 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 184/354] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:02:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:02:38.374173 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acbd756-c8f3-414f-8468-0575e800c5c0 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:38.374460 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acbd756-c8f3-414f-8468-0575e800c5c0 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:38.374737 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acbd756-c8f3-414f-8468-0575e800c5c0 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:38.376219 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 185/355] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:38.376783 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acbd756-c8f3-414f-8468-0575e800c5c0 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:38.388782 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b89ec-0b74-45dc-b0e9-43ed341aad28 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:38.426201 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3465f40-1d6d-4143-87e0-3c523092176b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:38.427317 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3465f40-1d6d-4143-87e0-3c523092176b None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:38.427807 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3465f40-1d6d-4143-87e0-3c523092176b None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:38.428343 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3465f40-1d6d-4143-87e0-3c523092176b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:38.439758 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:38.441690 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3465f40-1d6d-4143-87e0-3c523092176b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:38.448889 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-f3465f40-1d6d-4143-87e0-3c523092176b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:02:38.448889 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:38.448889 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:38.448889 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:38.448889 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:38.448889 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:38.448889 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:38.448889 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:38.448889 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:38.448889 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:38.448889 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:38.448889 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:38.448889 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:38.448889 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:38.448889 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:38.448889 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:38.449793 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:38.449793 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:38.449793 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:38.449793 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:38.449793 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:38.449793 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:38.449793 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:38.449793 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:38.449793 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:38.449793 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:38.449793 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:38.449793 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:38.449793 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:38.449793 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:38.449793 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:38.449793 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:38.450555 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:38.450555 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:38.450555 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:38.450555 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:38.450555 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:38.450555 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:38.450555 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:38.450555 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:38.450555 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:38.450555 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:38.450555 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:02:38.450555 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:02:38.453495 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 171/356] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:02:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:38.454555 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3465f40-1d6d-4143-87e0-3c523092176b None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:38.491318 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acbd756-c8f3-414f-8468-0575e800c5c0 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:38.493651 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:38.545351 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69417b6-443b-4862-8550-d5f1bbb08371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:38.546073 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69417b6-443b-4862-8550-d5f1bbb08371 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:38.546349 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69417b6-443b-4862-8550-d5f1bbb08371 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:38.546616 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69417b6-443b-4862-8550-d5f1bbb08371 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:38.547407 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69417b6-443b-4862-8550-d5f1bbb08371 None admin] RBAC: Adding query filter params (role.id=d902e34269cc4d79b49b0d035055c40b, user.id=d8a482812e0f432e927dfeaf8e393d84, scope.system=all) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:38.547783 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69417b6-443b-4862-8550-d5f1bbb08371 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:38.549660 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69417b6-443b-4862-8550-d5f1bbb08371 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:38.563632 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 186/357] 10.222.0.60 () {56 vars in 1308 bytes} [Sun Jul 31 01:02:38 2022] GET /identity/v3/role_assignments?user.id=d8a482812e0f432e927dfeaf8e393d84&scope.system=all&role.id=d902e34269cc4d79b49b0d035055c40b => generated 510 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:38.565106 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eaea21-490f-4e93-9abd-0a1d7be4c4db None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:38.565208 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eaea21-490f-4e93-9abd-0a1d7be4c4db None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:38.566647 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eaea21-490f-4e93-9abd-0a1d7be4c4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:38.584942 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3465f40-1d6d-4143-87e0-3c523092176b None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:38.589978 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-60eaea21-490f-4e93-9abd-0a1d7be4c4db None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:38.591193 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-60eaea21-490f-4e93-9abd-0a1d7be4c4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:38.633914 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063500ad-8e38-4321-8ca4-33983851e387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:38.634597 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063500ad-8e38-4321-8ca4-33983851e387 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:38.634871 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063500ad-8e38-4321-8ca4-33983851e387 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:38.635144 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063500ad-8e38-4321-8ca4-33983851e387 None admin] PATH_INFO: `/v3/projects/882624ffe602494b95664e06c16d55a2` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:38.636507 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063500ad-8e38-4321-8ca4-33983851e387 None admin] RBAC: Authorizing `identity:get_project(project_id=882624ffe602494b95664e06c16d55a2)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:38.638033 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063500ad-8e38-4321-8ca4-33983851e387 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:38.639982 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 172/358] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:02:38 2022] GET /identity/v3/projects/882624ffe602494b95664e06c16d55a2 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:38.640789 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063500ad-8e38-4321-8ca4-33983851e387 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:38.693746 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 187/359] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:02:38.695064 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1294ca1-28fa-4984-ada2-dc5310df1a0d None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:38.695357 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1294ca1-28fa-4984-ada2-dc5310df1a0d None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:38.695664 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1294ca1-28fa-4984-ada2-dc5310df1a0d None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:38.696970 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 188/360] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:38.697647 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1294ca1-28fa-4984-ada2-dc5310df1a0d None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:38.749219 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:38.789573 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063500ad-8e38-4321-8ca4-33983851e387 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:38.791221 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:38.819561 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1294ca1-28fa-4984-ada2-dc5310df1a0d None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:38.835761 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4c7e9-ca6d-4e84-b686-9526a18dbcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:38.836386 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4c7e9-ca6d-4e84-b686-9526a18dbcb1 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:38.836656 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4c7e9-ca6d-4e84-b686-9526a18dbcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:38.836922 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4c7e9-ca6d-4e84-b686-9526a18dbcb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:38.837649 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc4c7e9-ca6d-4e84-b686-9526a18dbcb1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:38.837950 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc4c7e9-ca6d-4e84-b686-9526a18dbcb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:38.839330 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc4c7e9-ca6d-4e84-b686-9526a18dbcb1 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:38.853020 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 173/361] 10.222.0.60 () {56 vars in 1101 bytes} [Sun Jul 31 01:02:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:38.854366 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453240b8-e1ba-41fd-96ff-00b6b8523057 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:38.854657 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453240b8-e1ba-41fd-96ff-00b6b8523057 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:38.854928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453240b8-e1ba-41fd-96ff-00b6b8523057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:38.870482 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13246f2b-72e9-41a1-be09-2ee2ed46d8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:38.871132 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13246f2b-72e9-41a1-be09-2ee2ed46d8b7 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:38.871405 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13246f2b-72e9-41a1-be09-2ee2ed46d8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:38.871706 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13246f2b-72e9-41a1-be09-2ee2ed46d8b7 None admin] PATH_INFO: `/v3/groups/a5bf2cfd89604dff83c7fdae945e6b5c` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:38.872874 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13246f2b-72e9-41a1-be09-2ee2ed46d8b7 None admin] RBAC: Authorizing `identity:get_group(group_id=a5bf2cfd89604dff83c7fdae945e6b5c)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:38.874152 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-453240b8-e1ba-41fd-96ff-00b6b8523057 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:38.874502 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13246f2b-72e9-41a1-be09-2ee2ed46d8b7 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:38.875422 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-453240b8-e1ba-41fd-96ff-00b6b8523057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:38.876429 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 189/362] 10.222.0.60 () {56 vars in 1180 bytes} [Sun Jul 31 01:02:38 2022] GET /identity/v3/groups/a5bf2cfd89604dff83c7fdae945e6b5c => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:38.877196 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13246f2b-72e9-41a1-be09-2ee2ed46d8b7 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:38.959962 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 174/363] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:02:38.961479 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453240b8-e1ba-41fd-96ff-00b6b8523057 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:39.009138 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13246f2b-72e9-41a1-be09-2ee2ed46d8b7 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:39.023054 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:39.050483 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b402ab-cee2-4281-98e1-4391796b3c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:39.051135 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b402ab-cee2-4281-98e1-4391796b3c65 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:39.051400 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b402ab-cee2-4281-98e1-4391796b3c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:39.051712 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b402ab-cee2-4281-98e1-4391796b3c65 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:39.061942 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b402ab-cee2-4281-98e1-4391796b3c65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:39.068461 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-30b402ab-cee2-4281-98e1-4391796b3c65 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:02:39.068461 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:39.068461 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:39.068461 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:39.068461 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:39.068461 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:39.068461 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:39.068461 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:39.068461 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:39.068461 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:39.068461 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:39.068461 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:39.068461 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:39.068461 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:39.068461 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:39.068461 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:39.069363 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:39.069363 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:39.069363 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:39.069363 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:39.069363 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:39.069363 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:39.069363 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:39.069363 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:39.069363 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:39.069363 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:39.069363 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:39.069363 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:39.069363 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:39.069363 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:39.069363 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:39.069363 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:39.070496 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:39.070496 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:39.070496 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:39.070496 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:39.070496 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:39.070496 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:39.070496 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:39.070496 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:39.070496 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:39.070496 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:39.070496 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:02:39.070496 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:02:39.070496 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 190/364] 10.222.0.60 () {56 vars in 1114 bytes} [Sun Jul 31 01:02:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:39.070496 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b402ab-cee2-4281-98e1-4391796b3c65 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:39.071586 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:39.086508 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453240b8-e1ba-41fd-96ff-00b6b8523057 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:39.135158 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870f008-b8da-441f-b3d2-f9aef6446679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:39.136326 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870f008-b8da-441f-b3d2-f9aef6446679 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:39.136815 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870f008-b8da-441f-b3d2-f9aef6446679 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:39.137095 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870f008-b8da-441f-b3d2-f9aef6446679 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:39.188999 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b402ab-cee2-4281-98e1-4391796b3c65 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:39.214562 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e870f008-b8da-441f-b3d2-f9aef6446679 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:39.216095 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e870f008-b8da-441f-b3d2-f9aef6446679 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:39.229967 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d2c05-9041-44bc-b660-afc47245c935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:39.230593 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d2c05-9041-44bc-b660-afc47245c935 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:39.230867 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d2c05-9041-44bc-b660-afc47245c935 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:39.231136 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d2c05-9041-44bc-b660-afc47245c935 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:39.231959 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6d2c05-9041-44bc-b660-afc47245c935 None admin] RBAC: Adding query filter params (group.id=a5bf2cfd89604dff83c7fdae945e6b5c, role.id=8272ca656a1f41379f9acf1ea055fb4d, scope.project.id=882624ffe602494b95664e06c16d55a2) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:39.232273 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6d2c05-9041-44bc-b660-afc47245c935 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:39.233887 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6d2c05-9041-44bc-b660-afc47245c935 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:39.240925 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 191/365] 10.222.0.60 () {56 vars in 1376 bytes} [Sun Jul 31 01:02:39 2022] GET /identity/v3/role_assignments?group.id=a5bf2cfd89604dff83c7fdae945e6b5c&scope.project.id=882624ffe602494b95664e06c16d55a2&role.id=8272ca656a1f41379f9acf1ea055fb4d => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:39.241763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d2c05-9041-44bc-b660-afc47245c935 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:39.292549 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:39.350393 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:39.371633 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 175/366] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:02:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:02:39.372726 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870f008-b8da-441f-b3d2-f9aef6446679 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:39.379531 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d2c05-9041-44bc-b660-afc47245c935 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:39.416508 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f0d8d-b320-4fba-830a-86724cf9fd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:39.416921 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f0d8d-b320-4fba-830a-86724cf9fd34 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:39.417199 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f0d8d-b320-4fba-830a-86724cf9fd34 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:39.417465 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f0d8d-b320-4fba-830a-86724cf9fd34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:39.429219 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1f0d8d-b320-4fba-830a-86724cf9fd34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:39.435293 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-dc1f0d8d-b320-4fba-830a-86724cf9fd34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:02:39.435293 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:39.435293 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:39.435293 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:39.435293 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:39.435293 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:39.435293 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:39.435293 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:39.435293 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:39.435293 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:39.435293 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:39.435293 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:39.435293 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:39.435293 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:39.435293 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:39.435293 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:39.436395 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:39.436395 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:39.436395 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:39.436395 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:39.436395 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:39.436395 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:39.436395 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:39.436395 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:39.436395 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:39.436395 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:39.436395 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:39.436395 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:39.436395 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:39.436395 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:39.436395 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:39.436395 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:39.437445 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:39.437445 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:39.437445 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:39.437445 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:39.437445 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:39.437445 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:39.437445 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:39.437445 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:39.437445 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:39.437445 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:39.437445 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:02:39.437445 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:02:39.437445 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 192/367] 10.222.0.60 () {56 vars in 1096 bytes} [Sun Jul 31 01:02:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:39.438107 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f0d8d-b320-4fba-830a-86724cf9fd34 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:39.488376 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870f008-b8da-441f-b3d2-f9aef6446679 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:39.524117 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71e176-a63b-4b6d-8715-6c2ab284373a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:39.525015 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71e176-a63b-4b6d-8715-6c2ab284373a None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:39.525428 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71e176-a63b-4b6d-8715-6c2ab284373a None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:39.525843 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71e176-a63b-4b6d-8715-6c2ab284373a None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:39.526701 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a71e176-a63b-4b6d-8715-6c2ab284373a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:39.527133 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a71e176-a63b-4b6d-8715-6c2ab284373a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:39.528674 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a71e176-a63b-4b6d-8715-6c2ab284373a None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:39.537535 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 176/368] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:02:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:39.537757 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:39.538702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71e176-a63b-4b6d-8715-6c2ab284373a None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:39.544928 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f0d8d-b320-4fba-830a-86724cf9fd34 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:39.582074 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff97570-4274-40a5-a5d8-5f032108fec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:39.582789 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff97570-4274-40a5-a5d8-5f032108fec4 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:39.583067 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff97570-4274-40a5-a5d8-5f032108fec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:39.583337 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff97570-4274-40a5-a5d8-5f032108fec4 None admin] PATH_INFO: `/v3/projects/7c49b7e2947f42c096eb6b5a5fca321a` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:39.584637 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff97570-4274-40a5-a5d8-5f032108fec4 None admin] RBAC: Authorizing `identity:get_project(project_id=7c49b7e2947f42c096eb6b5a5fca321a)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:39.586136 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff97570-4274-40a5-a5d8-5f032108fec4 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:39.588272 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 193/369] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:02:39 2022] GET /identity/v3/projects/7c49b7e2947f42c096eb6b5a5fca321a => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:39.589054 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff97570-4274-40a5-a5d8-5f032108fec4 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:39.608206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:39.656617 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71e176-a63b-4b6d-8715-6c2ab284373a None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:39.692126 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52246934-2628-4a45-838d-982e40935f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:39.692587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff97570-4274-40a5-a5d8-5f032108fec4 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:39.693158 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52246934-2628-4a45-838d-982e40935f1a None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:39.693600 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52246934-2628-4a45-838d-982e40935f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:39.694001 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52246934-2628-4a45-838d-982e40935f1a None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:39.694852 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52246934-2628-4a45-838d-982e40935f1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:39.695286 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52246934-2628-4a45-838d-982e40935f1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:39.696872 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52246934-2628-4a45-838d-982e40935f1a None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:39.706173 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 177/370] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:02:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:39.707208 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52246934-2628-4a45-838d-982e40935f1a None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:39.729298 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a926ac0-868a-4444-9d30-a4be98895c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:39.730101 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a926ac0-868a-4444-9d30-a4be98895c2a None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:39.730366 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a926ac0-868a-4444-9d30-a4be98895c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:39.730627 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a926ac0-868a-4444-9d30-a4be98895c2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:39.775889 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:39.806700 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a926ac0-868a-4444-9d30-a4be98895c2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:39.807371 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a926ac0-868a-4444-9d30-a4be98895c2a None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:39.819151 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52246934-2628-4a45-838d-982e40935f1a None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:39.837489 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:39.857397 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8319c4-9344-4cd7-80a6-4aa36da28060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:39.858473 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8319c4-9344-4cd7-80a6-4aa36da28060 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:39.858941 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8319c4-9344-4cd7-80a6-4aa36da28060 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:39.859405 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8319c4-9344-4cd7-80a6-4aa36da28060 None admin] PATH_INFO: `/v3/groups/a5bf2cfd89604dff83c7fdae945e6b5c` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:39.860808 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8319c4-9344-4cd7-80a6-4aa36da28060 None admin] RBAC: Authorizing `identity:get_group(group_id=a5bf2cfd89604dff83c7fdae945e6b5c)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:39.862434 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8319c4-9344-4cd7-80a6-4aa36da28060 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:39.865605 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 178/371] 10.222.0.60 () {56 vars in 1180 bytes} [Sun Jul 31 01:02:39 2022] GET /identity/v3/groups/a5bf2cfd89604dff83c7fdae945e6b5c => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:39.866600 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8319c4-9344-4cd7-80a6-4aa36da28060 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:39.916893 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 194/372] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:02:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:02:39.917583 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a926ac0-868a-4444-9d30-a4be98895c2a None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:39.988454 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:39.997689 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8319c4-9344-4cd7-80a6-4aa36da28060 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:40.037073 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a64ab5-08d7-4cf3-9e3b-cdfaea18cd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:40.037708 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a64ab5-08d7-4cf3-9e3b-cdfaea18cd0c None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:40.037982 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a64ab5-08d7-4cf3-9e3b-cdfaea18cd0c None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:40.038327 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a64ab5-08d7-4cf3-9e3b-cdfaea18cd0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:40.045547 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a926ac0-868a-4444-9d30-a4be98895c2a None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:40.090716 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca260d-8f99-45a0-b2d4-b29f9e45cc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:40.092097 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca260d-8f99-45a0-b2d4-b29f9e45cc9a None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:40.092753 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca260d-8f99-45a0-b2d4-b29f9e45cc9a None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:40.093337 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca260d-8f99-45a0-b2d4-b29f9e45cc9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:40.094325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca260d-8f99-45a0-b2d4-b29f9e45cc9a None admin] RBAC: Adding query filter params (group.id=a5bf2cfd89604dff83c7fdae945e6b5c, role.id=12a8e2ae2b6b4d699aac9ba2319cf57d, scope.project.id=7c49b7e2947f42c096eb6b5a5fca321a) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:40.094820 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca260d-8f99-45a0-b2d4-b29f9e45cc9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:40.097287 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca260d-8f99-45a0-b2d4-b29f9e45cc9a None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:40.105790 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:40.106066 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 195/373] 10.222.0.60 () {56 vars in 1376 bytes} [Sun Jul 31 01:02:39 2022] GET /identity/v3/role_assignments?group.id=a5bf2cfd89604dff83c7fdae945e6b5c&scope.project.id=7c49b7e2947f42c096eb6b5a5fca321a&role.id=12a8e2ae2b6b4d699aac9ba2319cf57d => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:40.113548 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca260d-8f99-45a0-b2d4-b29f9e45cc9a None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:40.133717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a64ab5-08d7-4cf3-9e3b-cdfaea18cd0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:40.135273 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a64ab5-08d7-4cf3-9e3b-cdfaea18cd0c None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:40.254752 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca260d-8f99-45a0-b2d4-b29f9e45cc9a None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:40.270285 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 179/374] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:02:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:02:40.271749 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8150c4c-3447-48d6-b1ea-01bb85c96575 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:40.272037 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8150c4c-3447-48d6-b1ea-01bb85c96575 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:40.272398 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8150c4c-3447-48d6-b1ea-01bb85c96575 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:40.277970 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 180/375] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:40.278849 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8150c4c-3447-48d6-b1ea-01bb85c96575 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:40.288143 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:40.300490 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e051f7c-0d69-4060-a5a4-ec600a8f5892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:40.301299 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e051f7c-0d69-4060-a5a4-ec600a8f5892 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:40.301581 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e051f7c-0d69-4060-a5a4-ec600a8f5892 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:40.301852 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e051f7c-0d69-4060-a5a4-ec600a8f5892 None admin] PATH_INFO: `/v3/projects/7c49b7e2947f42c096eb6b5a5fca321a` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:40.303211 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e051f7c-0d69-4060-a5a4-ec600a8f5892 None admin] RBAC: Authorizing `identity:get_project(project_id=7c49b7e2947f42c096eb6b5a5fca321a)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:40.305454 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e051f7c-0d69-4060-a5a4-ec600a8f5892 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:40.307223 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 196/376] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:02:40 2022] GET /identity/v3/projects/7c49b7e2947f42c096eb6b5a5fca321a => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:40.309134 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e661f-9e1b-4a53-b4f1-210f8b8b5ad5 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:40.309698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e661f-9e1b-4a53-b4f1-210f8b8b5ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:40.309974 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e661f-9e1b-4a53-b4f1-210f8b8b5ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:40.333113 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-0a5e661f-9e1b-4a53-b4f1-210f8b8b5ad5 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:40.334466 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-0a5e661f-9e1b-4a53-b4f1-210f8b8b5ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:40.406393 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:40.424977 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8150c4c-3447-48d6-b1ea-01bb85c96575 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:40.450766 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 197/377] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:02:40.452353 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e661f-9e1b-4a53-b4f1-210f8b8b5ad5 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:40.464817 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de0368-d98c-4e57-8f85-1b42683f9a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:40.465558 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de0368-d98c-4e57-8f85-1b42683f9a65 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:40.465893 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de0368-d98c-4e57-8f85-1b42683f9a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:40.466225 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de0368-d98c-4e57-8f85-1b42683f9a65 None admin] PATH_INFO: `/v3/projects/9b95aba7aab1442a9b3944b9e1f7019a` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:40.467444 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de0368-d98c-4e57-8f85-1b42683f9a65 None admin] RBAC: Authorizing `identity:get_project(project_id=9b95aba7aab1442a9b3944b9e1f7019a)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:40.469051 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de0368-d98c-4e57-8f85-1b42683f9a65 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:40.471150 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 181/378] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:02:40 2022] GET /identity/v3/projects/9b95aba7aab1442a9b3944b9e1f7019a => generated 344 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:40.477317 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de0368-d98c-4e57-8f85-1b42683f9a65 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:40.593771 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de0368-d98c-4e57-8f85-1b42683f9a65 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:40.597889 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e661f-9e1b-4a53-b4f1-210f8b8b5ad5 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:40.630446 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:40.634278 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b436b-261c-4ec3-8786-582fd22c232d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:40.635135 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b436b-261c-4ec3-8786-582fd22c232d None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:40.635411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b436b-261c-4ec3-8786-582fd22c232d None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:40.635720 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b436b-261c-4ec3-8786-582fd22c232d None admin] PATH_INFO: `/v3/groups/f47fb0a3cf534ea78d6946e5426cf1ce` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:40.649824 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b436b-261c-4ec3-8786-582fd22c232d None admin] RBAC: Authorizing `identity:get_group(group_id=f47fb0a3cf534ea78d6946e5426cf1ce)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:40.649824 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b436b-261c-4ec3-8786-582fd22c232d None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:40.649824 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 182/379] 10.222.0.60 () {56 vars in 1180 bytes} [Sun Jul 31 01:02:40 2022] GET /identity/v3/groups/f47fb0a3cf534ea78d6946e5426cf1ce => generated 229 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:02:40.649824 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b436b-261c-4ec3-8786-582fd22c232d None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:40.651969 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771fc23-0b9d-49b3-aed1-ace0816c3944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:40.652627 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771fc23-0b9d-49b3-aed1-ace0816c3944 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:40.652900 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771fc23-0b9d-49b3-aed1-ace0816c3944 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:40.653163 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771fc23-0b9d-49b3-aed1-ace0816c3944 None admin] PATH_INFO: `/v3/groups/a5bf2cfd89604dff83c7fdae945e6b5c` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:40.654331 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6771fc23-0b9d-49b3-aed1-ace0816c3944 None admin] RBAC: Authorizing `identity:get_group(group_id=a5bf2cfd89604dff83c7fdae945e6b5c)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:40.655885 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6771fc23-0b9d-49b3-aed1-ace0816c3944 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:40.657473 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 198/380] 10.222.0.60 () {56 vars in 1180 bytes} [Sun Jul 31 01:02:40 2022] GET /identity/v3/groups/a5bf2cfd89604dff83c7fdae945e6b5c => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:40.667719 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771fc23-0b9d-49b3-aed1-ace0816c3944 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:40.679881 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:40.776044 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b436b-261c-4ec3-8786-582fd22c232d None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:40.804140 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771fc23-0b9d-49b3-aed1-ace0816c3944 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:40.813998 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202390c-4437-4fe1-a6d7-bd5138bf1a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:40.814649 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202390c-4437-4fe1-a6d7-bd5138bf1a45 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:40.815320 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202390c-4437-4fe1-a6d7-bd5138bf1a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:40.815320 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202390c-4437-4fe1-a6d7-bd5138bf1a45 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:40.827195 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2202390c-4437-4fe1-a6d7-bd5138bf1a45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:40.832787 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-2202390c-4437-4fe1-a6d7-bd5138bf1a45 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:02:40.832787 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:40.832787 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:40.832787 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:40.832787 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:40.832787 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:40.832787 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:40.832787 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:40.832787 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:40.832787 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:40.832787 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:40.832787 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:40.832787 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:40.832787 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:40.832787 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:40.832787 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:40.833672 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:40.833672 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:40.833672 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:40.833672 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:40.833672 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:40.833672 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:40.833672 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:40.833672 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:40.833672 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:40.833672 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:40.833672 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:40.833672 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:40.833672 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:40.833672 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:40.833672 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:40.833672 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:40.834443 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:40.834443 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:40.834443 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:40.834443 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:40.834443 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:40.834443 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:40.834443 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:40.834443 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:40.834443 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:40.834443 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:40.834443 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:02:40.834443 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:02:40.834443 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 183/381] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:02:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:40.835077 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202390c-4437-4fe1-a6d7-bd5138bf1a45 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:40.857257 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad475a-5459-4910-9f9f-9dc4873a1008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:40.857893 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad475a-5459-4910-9f9f-9dc4873a1008 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:40.858169 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad475a-5459-4910-9f9f-9dc4873a1008 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:40.858501 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad475a-5459-4910-9f9f-9dc4873a1008 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:40.859304 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad475a-5459-4910-9f9f-9dc4873a1008 None admin] RBAC: Adding query filter params (group.id=a5bf2cfd89604dff83c7fdae945e6b5c, role.id=8272ca656a1f41379f9acf1ea055fb4d, scope.project.id=7c49b7e2947f42c096eb6b5a5fca321a) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:40.859641 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad475a-5459-4910-9f9f-9dc4873a1008 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:40.861089 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad475a-5459-4910-9f9f-9dc4873a1008 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:40.867522 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 199/382] 10.222.0.60 () {56 vars in 1376 bytes} [Sun Jul 31 01:02:40 2022] GET /identity/v3/role_assignments?group.id=a5bf2cfd89604dff83c7fdae945e6b5c&scope.project.id=7c49b7e2947f42c096eb6b5a5fca321a&role.id=8272ca656a1f41379f9acf1ea055fb4d => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:40.868248 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad475a-5459-4910-9f9f-9dc4873a1008 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:40.944956 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:40.955580 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:41.012232 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202390c-4437-4fe1-a6d7-bd5138bf1a45 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:41.047647 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad475a-5459-4910-9f9f-9dc4873a1008 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:41.068043 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d103d947-a1ad-4b3f-bd5c-d6bb45a77617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:41.069098 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103d947-a1ad-4b3f-bd5c-d6bb45a77617 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:41.070902 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103d947-a1ad-4b3f-bd5c-d6bb45a77617 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:41.071391 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103d947-a1ad-4b3f-bd5c-d6bb45a77617 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:41.073389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d103d947-a1ad-4b3f-bd5c-d6bb45a77617 None admin] RBAC: Adding query filter params (group.id=f47fb0a3cf534ea78d6946e5426cf1ce, role.id=fef526a7d2e741ce995d107f3ac934ae, scope.project.id=9b95aba7aab1442a9b3944b9e1f7019a) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:41.075642 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d103d947-a1ad-4b3f-bd5c-d6bb45a77617 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:41.077760 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d103d947-a1ad-4b3f-bd5c-d6bb45a77617 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:41.094437 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 184/383] 10.222.0.60 () {56 vars in 1376 bytes} [Sun Jul 31 01:02:40 2022] GET /identity/v3/role_assignments?group.id=f47fb0a3cf534ea78d6946e5426cf1ce&scope.project.id=9b95aba7aab1442a9b3944b9e1f7019a&role.id=fef526a7d2e741ce995d107f3ac934ae => generated 260 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:41.106246 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed4ddc-c05a-4d46-99ef-fb3dba344b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:41.107297 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed4ddc-c05a-4d46-99ef-fb3dba344b19 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:41.107984 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed4ddc-c05a-4d46-99ef-fb3dba344b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:41.108527 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed4ddc-c05a-4d46-99ef-fb3dba344b19 None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:41.109515 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed4ddc-c05a-4d46-99ef-fb3dba344b19 None admin] RBAC: Adding query filter params (name=member) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:41.110036 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed4ddc-c05a-4d46-99ef-fb3dba344b19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:41.111712 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed4ddc-c05a-4d46-99ef-fb3dba344b19 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:41.121537 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 200/384] 10.222.0.60 () {56 vars in 1101 bytes} [Sun Jul 31 01:02:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:41.127945 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d103d947-a1ad-4b3f-bd5c-d6bb45a77617 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:41.285404 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d103d947-a1ad-4b3f-bd5c-d6bb45a77617 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:41.320983 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db966d7-466d-493c-b719-b2e4838bc926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:41.321654 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db966d7-466d-493c-b719-b2e4838bc926 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:41.321933 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db966d7-466d-493c-b719-b2e4838bc926 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:41.322208 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db966d7-466d-493c-b719-b2e4838bc926 None admin] PATH_INFO: `/v3/groups/a5bf2cfd89604dff83c7fdae945e6b5c` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:41.323393 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db966d7-466d-493c-b719-b2e4838bc926 None admin] RBAC: Authorizing `identity:get_group(group_id=a5bf2cfd89604dff83c7fdae945e6b5c)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:41.324889 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db966d7-466d-493c-b719-b2e4838bc926 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:41.331513 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 185/385] 10.222.0.60 () {56 vars in 1180 bytes} [Sun Jul 31 01:02:41 2022] GET /identity/v3/groups/a5bf2cfd89604dff83c7fdae945e6b5c => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:41.333006 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed4ddc-c05a-4d46-99ef-fb3dba344b19 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:41.466618 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed4ddc-c05a-4d46-99ef-fb3dba344b19 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:41.488557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:41.504288 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc03bb0-7cb6-4205-b343-2dc50ab05aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:41.504946 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc03bb0-7cb6-4205-b343-2dc50ab05aeb None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:41.505224 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc03bb0-7cb6-4205-b343-2dc50ab05aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:41.505498 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc03bb0-7cb6-4205-b343-2dc50ab05aeb None admin] PATH_INFO: `/v3/projects/882624ffe602494b95664e06c16d55a2` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:41.506675 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc03bb0-7cb6-4205-b343-2dc50ab05aeb None admin] RBAC: Authorizing `identity:get_project(project_id=882624ffe602494b95664e06c16d55a2)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:41.509066 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc03bb0-7cb6-4205-b343-2dc50ab05aeb None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:41.510446 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 201/386] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:02:41 2022] GET /identity/v3/projects/882624ffe602494b95664e06c16d55a2 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:41.516043 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db966d7-466d-493c-b719-b2e4838bc926 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:41.529451 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:41.628293 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db966d7-466d-493c-b719-b2e4838bc926 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:41.671017 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a750b-6a04-4c74-b1b2-e12cd7164c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:41.673423 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3be25-9b57-41ad-8ef3-9eec40c86398 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:41.673884 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3be25-9b57-41ad-8ef3-9eec40c86398 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:41.674351 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3be25-9b57-41ad-8ef3-9eec40c86398 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:41.675972 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 202/387] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:02:41.676327 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a750b-6a04-4c74-b1b2-e12cd7164c78 None admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:41.676787 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a750b-6a04-4c74-b1b2-e12cd7164c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:41.677254 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a750b-6a04-4c74-b1b2-e12cd7164c78 None admin] PATH_INFO: `/v3/projects/882624ffe602494b95664e06c16d55a2/groups/a5bf2cfd89604dff83c7fdae945e6b5c/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:41.679725 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a750b-6a04-4c74-b1b2-e12cd7164c78 None admin] RBAC: Authorizing `identity:create_grant(project_id=882624ffe602494b95664e06c16d55a2, group_id=a5bf2cfd89604dff83c7fdae945e6b5c, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:41.681079 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652a2d4-bd46-4558-8923-7d99f24ac21f None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:41.681365 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652a2d4-bd46-4558-8923-7d99f24ac21f None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:41.681642 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652a2d4-bd46-4558-8923-7d99f24ac21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:41.681881 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a750b-6a04-4c74-b1b2-e12cd7164c78 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:41.704808 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 186/388] 10.222.0.60 () {58 vars in 1442 bytes} [Sun Jul 31 01:02:41 2022] PUT /identity/v3/projects/882624ffe602494b95664e06c16d55a2/groups/a5bf2cfd89604dff83c7fdae945e6b5c/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:02:41.721923 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-d652a2d4-bd46-4558-8923-7d99f24ac21f None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:41.723151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-d652a2d4-bd46-4558-8923-7d99f24ac21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:41.804622 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 203/389] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:02:41.829529 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a750b-6a04-4c74-b1b2-e12cd7164c78 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:41.915296 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:41.955678 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a750b-6a04-4c74-b1b2-e12cd7164c78 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:41.992492 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502979af-934a-4409-8e0b-ebbf9b57f8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:41.993502 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502979af-934a-4409-8e0b-ebbf9b57f8c6 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:41.993976 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502979af-934a-4409-8e0b-ebbf9b57f8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:41.994521 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502979af-934a-4409-8e0b-ebbf9b57f8c6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:42.006187 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502979af-934a-4409-8e0b-ebbf9b57f8c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:42.012110 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-502979af-934a-4409-8e0b-ebbf9b57f8c6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:02:42.012110 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:42.012110 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:42.012110 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:42.012110 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:42.012110 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:42.012110 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:42.012110 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:42.012110 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:42.012110 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:42.012110 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:42.012110 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:42.012110 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:42.012110 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:42.012110 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:42.012110 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:42.013408 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:42.013408 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:42.013408 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:42.013408 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:42.013408 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:42.013408 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:42.013408 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:42.013408 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:42.013408 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:42.013408 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:42.013408 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:42.013408 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:42.013408 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:42.013408 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:42.013408 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:42.013408 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:42.014178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:42.014178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:42.014178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:42.014178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:42.014178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:42.014178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:42.014178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:42.014178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:42.014178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:42.014178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:42.014178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:02:42.014178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:02:42.016913 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 187/390] 10.222.0.60 () {56 vars in 1114 bytes} [Sun Jul 31 01:02:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:42.022913 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652a2d4-bd46-4558-8923-7d99f24ac21f None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:42.137661 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652a2d4-bd46-4558-8923-7d99f24ac21f None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:42.156862 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:42.180180 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab6c72-b970-477e-94e0-b1fb8d71856a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:42.180723 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab6c72-b970-477e-94e0-b1fb8d71856a None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:42.180997 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab6c72-b970-477e-94e0-b1fb8d71856a None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:42.181264 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab6c72-b970-477e-94e0-b1fb8d71856a None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:42.181989 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab6c72-b970-477e-94e0-b1fb8d71856a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:42.182288 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab6c72-b970-477e-94e0-b1fb8d71856a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:42.183695 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab6c72-b970-477e-94e0-b1fb8d71856a None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:42.192773 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 204/391] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:02:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:42.198505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502979af-934a-4409-8e0b-ebbf9b57f8c6 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:42.329441 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502979af-934a-4409-8e0b-ebbf9b57f8c6 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:42.359400 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:42.367551 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5f70f-25f1-4af8-9974-5a6c0078d9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:42.367551 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5f70f-25f1-4af8-9974-5a6c0078d9fb None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:42.367551 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5f70f-25f1-4af8-9974-5a6c0078d9fb None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:42.367551 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5f70f-25f1-4af8-9974-5a6c0078d9fb None admin] PATH_INFO: `/v3/groups/a5bf2cfd89604dff83c7fdae945e6b5c` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:42.368761 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5f70f-25f1-4af8-9974-5a6c0078d9fb None admin] RBAC: Authorizing `identity:get_group(group_id=a5bf2cfd89604dff83c7fdae945e6b5c)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:42.370234 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5f70f-25f1-4af8-9974-5a6c0078d9fb None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:42.372262 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 188/392] 10.222.0.60 () {56 vars in 1180 bytes} [Sun Jul 31 01:02:42 2022] GET /identity/v3/groups/a5bf2cfd89604dff83c7fdae945e6b5c => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:42.378186 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab6c72-b970-477e-94e0-b1fb8d71856a None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:42.507471 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab6c72-b970-477e-94e0-b1fb8d71856a None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:42.549692 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7c1ff-dd42-40bc-b3c2-378bb174a5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:42.550361 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7c1ff-dd42-40bc-b3c2-378bb174a5d1 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:42.550636 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7c1ff-dd42-40bc-b3c2-378bb174a5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:42.550909 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7c1ff-dd42-40bc-b3c2-378bb174a5d1 None admin] PATH_INFO: `/v3/projects/882624ffe602494b95664e06c16d55a2` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:42.552161 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e7c1ff-dd42-40bc-b3c2-378bb174a5d1 None admin] RBAC: Authorizing `identity:get_project(project_id=882624ffe602494b95664e06c16d55a2)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:42.553691 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e7c1ff-dd42-40bc-b3c2-378bb174a5d1 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:42.555708 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 205/393] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:02:42 2022] GET /identity/v3/projects/882624ffe602494b95664e06c16d55a2 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:42.561640 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5f70f-25f1-4af8-9974-5a6c0078d9fb None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:42.668827 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5f70f-25f1-4af8-9974-5a6c0078d9fb None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:42.703969 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b489475-984a-4120-a775-a9a554658acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:42.704705 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b489475-984a-4120-a775-a9a554658acc None admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:42.704987 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b489475-984a-4120-a775-a9a554658acc None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:42.705297 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b489475-984a-4120-a775-a9a554658acc None admin] PATH_INFO: `/v3/projects/882624ffe602494b95664e06c16d55a2/groups/a5bf2cfd89604dff83c7fdae945e6b5c/roles/8272ca656a1f41379f9acf1ea055fb4d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:42.707646 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b489475-984a-4120-a775-a9a554658acc None admin] RBAC: Authorizing `identity:create_grant(project_id=882624ffe602494b95664e06c16d55a2, group_id=a5bf2cfd89604dff83c7fdae945e6b5c, role_id=8272ca656a1f41379f9acf1ea055fb4d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:42.709092 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b489475-984a-4120-a775-a9a554658acc None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:42.724863 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 189/394] 10.222.0.60 () {58 vars in 1442 bytes} [Sun Jul 31 01:02:42 2022] PUT /identity/v3/projects/882624ffe602494b95664e06c16d55a2/groups/a5bf2cfd89604dff83c7fdae945e6b5c/roles/8272ca656a1f41379f9acf1ea055fb4d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:02:43.007000 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c45082-81c0-4879-a229-ffdd689cb9bd None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:43.007397 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c45082-81c0-4879-a229-ffdd689cb9bd None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:43.007613 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c45082-81c0-4879-a229-ffdd689cb9bd None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:43.009058 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 206/395] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:43.015868 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f7521-97ca-4a0b-8f92-93be6a2bf6d6 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:43.016782 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f7521-97ca-4a0b-8f92-93be6a2bf6d6 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:43.017270 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f7521-97ca-4a0b-8f92-93be6a2bf6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:43.038483 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-b62f7521-97ca-4a0b-8f92-93be6a2bf6d6 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:43.040031 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-b62f7521-97ca-4a0b-8f92-93be6a2bf6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:43.120447 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:43.138196 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 190/396] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:02:43.171608 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c45082-81c0-4879-a229-ffdd689cb9bd None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:43.232760 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:43.296297 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c45082-81c0-4879-a229-ffdd689cb9bd None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:43.339382 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467b6c1-609f-4349-ad8e-b0a38f3f5321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:43.340431 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467b6c1-609f-4349-ad8e-b0a38f3f5321 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:43.340936 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467b6c1-609f-4349-ad8e-b0a38f3f5321 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:43.341397 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467b6c1-609f-4349-ad8e-b0a38f3f5321 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:43.356504 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b467b6c1-609f-4349-ad8e-b0a38f3f5321 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:43.363690 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-b467b6c1-609f-4349-ad8e-b0a38f3f5321 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:02:43.363690 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:43.363690 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:43.363690 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:43.363690 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:43.363690 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:43.363690 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:43.363690 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:43.363690 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:43.363690 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:43.363690 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:43.363690 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:43.363690 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:43.363690 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:43.363690 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:43.363690 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:43.364742 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:43.364742 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:43.364742 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:43.364742 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:43.364742 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:43.364742 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:43.364742 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:43.364742 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:43.364742 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:43.364742 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:43.364742 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:43.364742 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:43.364742 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:43.364742 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:43.364742 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:43.364742 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:43.366061 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:43.366061 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:43.366061 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:43.366061 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:43.366061 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:43.366061 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:43.366061 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:43.366061 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:43.366061 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:43.366061 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:43.366061 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:02:43.366061 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:02:43.368509 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 207/397] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:02:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:43.374903 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f7521-97ca-4a0b-8f92-93be6a2bf6d6 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:43.484716 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f7521-97ca-4a0b-8f92-93be6a2bf6d6 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:43.527421 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ddc13-d15e-4584-9230-b4ef022c1813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:43.528466 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ddc13-d15e-4584-9230-b4ef022c1813 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:43.528947 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ddc13-d15e-4584-9230-b4ef022c1813 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:43.529429 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ddc13-d15e-4584-9230-b4ef022c1813 None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:43.530430 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ddc13-d15e-4584-9230-b4ef022c1813 None admin] RBAC: Adding query filter params (name=member) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:43.530929 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ddc13-d15e-4584-9230-b4ef022c1813 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:43.532548 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ddc13-d15e-4584-9230-b4ef022c1813 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:43.542207 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 191/398] 10.222.0.60 () {56 vars in 1101 bytes} [Sun Jul 31 01:02:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:43.547885 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467b6c1-609f-4349-ad8e-b0a38f3f5321 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:43.672215 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467b6c1-609f-4349-ad8e-b0a38f3f5321 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:43.682105 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:43.715592 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a755190-c621-478f-a40f-fffeabb50ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:43.716260 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a755190-c621-478f-a40f-fffeabb50ceb None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:43.716547 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a755190-c621-478f-a40f-fffeabb50ceb None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:43.716923 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a755190-c621-478f-a40f-fffeabb50ceb None admin] PATH_INFO: `/v3/groups/a5bf2cfd89604dff83c7fdae945e6b5c` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:43.718005 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a755190-c621-478f-a40f-fffeabb50ceb None admin] RBAC: Authorizing `identity:get_group(group_id=a5bf2cfd89604dff83c7fdae945e6b5c)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:43.719455 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a755190-c621-478f-a40f-fffeabb50ceb None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:43.721094 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 208/399] 10.222.0.60 () {56 vars in 1180 bytes} [Sun Jul 31 01:02:43 2022] GET /identity/v3/groups/a5bf2cfd89604dff83c7fdae945e6b5c => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:43.727567 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ddc13-d15e-4584-9230-b4ef022c1813 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:43.787720 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:43.846901 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ddc13-d15e-4584-9230-b4ef022c1813 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:43.893187 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3311b9c0-485a-480a-9047-6a023c6000b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:43.893863 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311b9c0-485a-480a-9047-6a023c6000b3 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:43.894140 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311b9c0-485a-480a-9047-6a023c6000b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:43.894410 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311b9c0-485a-480a-9047-6a023c6000b3 None admin] PATH_INFO: `/v3/projects/7c49b7e2947f42c096eb6b5a5fca321a` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:43.895644 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3311b9c0-485a-480a-9047-6a023c6000b3 None admin] RBAC: Authorizing `identity:get_project(project_id=7c49b7e2947f42c096eb6b5a5fca321a)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:43.897607 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc488092-57bc-4874-ba9f-5315df935942 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:43.897910 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc488092-57bc-4874-ba9f-5315df935942 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:43.898180 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc488092-57bc-4874-ba9f-5315df935942 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:43.899718 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 209/400] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:43.900630 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3311b9c0-485a-480a-9047-6a023c6000b3 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:43.902633 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 192/401] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:02:43 2022] GET /identity/v3/projects/7c49b7e2947f42c096eb6b5a5fca321a => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:43.905058 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f98112-37f2-4995-9115-d9c34327360f None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:43.905418 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f98112-37f2-4995-9115-d9c34327360f None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:43.905695 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f98112-37f2-4995-9115-d9c34327360f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:43.908960 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3311b9c0-485a-480a-9047-6a023c6000b3 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:43.947999 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-96f98112-37f2-4995-9115-d9c34327360f None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:43.949214 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-96f98112-37f2-4995-9115-d9c34327360f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:44.034456 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3311b9c0-485a-480a-9047-6a023c6000b3 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:44.055405 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:44.080734 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f640cb-24e4-457f-b08d-c4b84d659da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:44.081419 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f640cb-24e4-457f-b08d-c4b84d659da6 None admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:44.081699 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f640cb-24e4-457f-b08d-c4b84d659da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:44.081975 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f640cb-24e4-457f-b08d-c4b84d659da6 None admin] PATH_INFO: `/v3/projects/7c49b7e2947f42c096eb6b5a5fca321a/groups/a5bf2cfd89604dff83c7fdae945e6b5c/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:44.084106 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f640cb-24e4-457f-b08d-c4b84d659da6 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c49b7e2947f42c096eb6b5a5fca321a, group_id=a5bf2cfd89604dff83c7fdae945e6b5c, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:44.086220 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f640cb-24e4-457f-b08d-c4b84d659da6 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:44.086498 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 210/402] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:02:44.087908 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a61b7-05da-4112-b0b5-1db376f78e60 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:44.088199 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a61b7-05da-4112-b0b5-1db376f78e60 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:44.088481 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a61b7-05da-4112-b0b5-1db376f78e60 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:44.090075 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 211/403] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:44.096434 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261e3f5-09ea-4ee4-a39d-00815daf72f4 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:44.096893 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261e3f5-09ea-4ee4-a39d-00815daf72f4 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:44.097375 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261e3f5-09ea-4ee4-a39d-00815daf72f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:44.112098 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 193/404] 10.222.0.60 () {58 vars in 1442 bytes} [Sun Jul 31 01:02:43 2022] PUT /identity/v3/projects/7c49b7e2947f42c096eb6b5a5fca321a/groups/a5bf2cfd89604dff83c7fdae945e6b5c/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:02:44.113608 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f640cb-24e4-457f-b08d-c4b84d659da6 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:44.130462 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-4261e3f5-09ea-4ee4-a39d-00815daf72f4 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:44.131834 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-4261e3f5-09ea-4ee4-a39d-00815daf72f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:44.243440 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 212/405] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:02:44.244805 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db4717-d32d-4ffe-bdec-7e3632ed090f None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:44.245095 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db4717-d32d-4ffe-bdec-7e3632ed090f None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:44.245469 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db4717-d32d-4ffe-bdec-7e3632ed090f None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:44.246765 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 213/406] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:44.252879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f60ead-b3eb-4a3d-992a-f4417f36230f None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:44.253196 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f60ead-b3eb-4a3d-992a-f4417f36230f None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:44.253433 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f60ead-b3eb-4a3d-992a-f4417f36230f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:44.265619 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f640cb-24e4-457f-b08d-c4b84d659da6 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:44.274231 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-c7f60ead-b3eb-4a3d-992a-f4417f36230f None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:44.275456 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-c7f60ead-b3eb-4a3d-992a-f4417f36230f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:44.308114 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:44.312800 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dce0ca-9118-4db3-b248-37d4d21f9ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:44.313506 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dce0ca-9118-4db3-b248-37d4d21f9ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:44.313794 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dce0ca-9118-4db3-b248-37d4d21f9ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:44.314066 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dce0ca-9118-4db3-b248-37d4d21f9ef2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:44.331091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dce0ca-9118-4db3-b248-37d4d21f9ef2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:44.339334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-24dce0ca-9118-4db3-b248-37d4d21f9ef2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:02:44.339334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:44.339334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:44.339334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:44.339334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:44.339334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:44.339334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:44.339334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:44.339334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:44.339334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:44.339334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:44.339334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:44.339334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:44.339334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:44.339334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:44.339334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:44.340312 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:44.340312 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:44.340312 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:44.340312 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:44.340312 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:44.340312 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:44.340312 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:44.340312 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:44.340312 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:44.340312 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:44.340312 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:44.340312 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:44.340312 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:44.340312 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:44.340312 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:44.340312 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:44.341116 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:44.341116 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:44.341116 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:44.341116 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:44.341116 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:44.341116 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:44.341116 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:44.341116 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:44.341116 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:44.341116 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:44.341116 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:02:44.341116 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:02:44.341116 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 194/407] 10.222.0.60 () {56 vars in 1096 bytes} [Sun Jul 31 01:02:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:02:44.341116 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dce0ca-9118-4db3-b248-37d4d21f9ef2 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:44.358041 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 214/408] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:02:44.358913 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f60ead-b3eb-4a3d-992a-f4417f36230f None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:44.408491 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:44.472657 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dce0ca-9118-4db3-b248-37d4d21f9ef2 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:44.481188 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f60ead-b3eb-4a3d-992a-f4417f36230f None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:44.509680 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7bae8-6a46-4d05-a756-c0e165e08203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:44.510455 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7bae8-6a46-4d05-a756-c0e165e08203 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:44.510712 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7bae8-6a46-4d05-a756-c0e165e08203 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:44.510995 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7bae8-6a46-4d05-a756-c0e165e08203 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:44.519849 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25c66f-891e-43eb-9b4e-49d630177b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:44.520768 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25c66f-891e-43eb-9b4e-49d630177b0c None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:44.521293 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25c66f-891e-43eb-9b4e-49d630177b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:44.521830 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25c66f-891e-43eb-9b4e-49d630177b0c None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:44.522285 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7bae8-6a46-4d05-a756-c0e165e08203 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:44.522950 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25c66f-891e-43eb-9b4e-49d630177b0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:44.523437 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25c66f-891e-43eb-9b4e-49d630177b0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:44.525011 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25c66f-891e-43eb-9b4e-49d630177b0c None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:44.528062 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-0de7bae8-6a46-4d05-a756-c0e165e08203 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:02:44.528062 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:44.528062 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:44.528062 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:44.528062 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:44.528062 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:44.528062 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:44.528062 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:44.528062 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:44.528062 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:44.528062 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:44.528062 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:44.528062 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:44.528062 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:44.528062 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:44.528062 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:44.528928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:44.528928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:44.528928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:44.528928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:44.528928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:44.528928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:44.528928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:44.528928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:44.528928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:44.528928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:44.528928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:44.528928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:44.528928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:44.528928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:44.528928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:44.528928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:44.529718 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:44.529718 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:44.529718 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:44.529718 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:44.529718 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:44.529718 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:44.529718 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:44.529718 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:44.529718 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:44.529718 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:44.529718 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:02:44.529718 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:02:44.529718 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 195/409] 10.222.0.60 () {56 vars in 1114 bytes} [Sun Jul 31 01:02:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:44.530435 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7bae8-6a46-4d05-a756-c0e165e08203 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:44.537545 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 215/410] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:02:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:44.538616 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25c66f-891e-43eb-9b4e-49d630177b0c None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:44.578007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:44.651695 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7bae8-6a46-4d05-a756-c0e165e08203 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:44.653462 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:44.669486 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25c66f-891e-43eb-9b4e-49d630177b0c None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:44.690518 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c7319d-c831-4d39-ab85-d28b4ad1829e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:44.691312 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7319d-c831-4d39-ab85-d28b4ad1829e None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:44.691841 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7319d-c831-4d39-ab85-d28b4ad1829e None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:44.692223 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7319d-c831-4d39-ab85-d28b4ad1829e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:44.703925 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c7319d-c831-4d39-ab85-d28b4ad1829e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:44.710178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-77c7319d-c831-4d39-ab85-d28b4ad1829e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:02:44.710178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:44.710178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:44.710178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:44.710178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:44.710178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:44.710178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:44.710178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:44.710178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:44.710178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:44.710178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:44.710178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:44.710178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:44.710178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:44.710178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:44.710178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:44.711190 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:44.711190 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:44.711190 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:44.711190 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:44.711190 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:44.711190 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:44.711190 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:44.711190 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:44.711190 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:44.711190 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:44.711190 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:44.711190 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:44.711190 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:44.711190 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:44.711190 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:44.711190 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:44.712048 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:44.712048 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:44.712048 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:44.712048 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:44.712048 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:44.712048 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:44.712048 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:44.712048 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:44.712048 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:44.712048 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:44.712048 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:02:44.712048 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:02:44.712640 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 196/411] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:02:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:44.713490 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c7319d-c831-4d39-ab85-d28b4ad1829e None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:44.715000 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeac560-ff61-404f-9664-bdaf5d86d6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:44.715823 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeac560-ff61-404f-9664-bdaf5d86d6ec None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:44.716278 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeac560-ff61-404f-9664-bdaf5d86d6ec None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:44.716935 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeac560-ff61-404f-9664-bdaf5d86d6ec None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:44.718858 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeac560-ff61-404f-9664-bdaf5d86d6ec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:44.719314 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeac560-ff61-404f-9664-bdaf5d86d6ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:44.720865 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeac560-ff61-404f-9664-bdaf5d86d6ec None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:44.732112 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 216/412] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:02:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:44.733151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeac560-ff61-404f-9664-bdaf5d86d6ec None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:44.830292 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:44.832109 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c7319d-c831-4d39-ab85-d28b4ad1829e None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:44.839561 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeac560-ff61-404f-9664-bdaf5d86d6ec None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:44.869612 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd99b02-49bc-4abe-b8ed-94f457eab57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:44.870591 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd99b02-49bc-4abe-b8ed-94f457eab57e None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:44.871157 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd99b02-49bc-4abe-b8ed-94f457eab57e None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:44.871647 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd99b02-49bc-4abe-b8ed-94f457eab57e None admin] PATH_INFO: `/v3/groups/f47fb0a3cf534ea78d6946e5426cf1ce` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:44.873194 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd99b02-49bc-4abe-b8ed-94f457eab57e None admin] RBAC: Authorizing `identity:get_group(group_id=f47fb0a3cf534ea78d6946e5426cf1ce)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:44.874477 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b9d65-a8d0-4c6c-8d2d-cf15d9e8d973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:44.875173 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b9d65-a8d0-4c6c-8d2d-cf15d9e8d973 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:44.875425 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd99b02-49bc-4abe-b8ed-94f457eab57e None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:44.875595 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b9d65-a8d0-4c6c-8d2d-cf15d9e8d973 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:44.875981 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b9d65-a8d0-4c6c-8d2d-cf15d9e8d973 None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:44.876767 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b9d65-a8d0-4c6c-8d2d-cf15d9e8d973 None admin] RBAC: Adding query filter params (name=member) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:44.877143 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b9d65-a8d0-4c6c-8d2d-cf15d9e8d973 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:44.882940 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b9d65-a8d0-4c6c-8d2d-cf15d9e8d973 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:44.883226 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 197/413] 10.222.0.60 () {56 vars in 1180 bytes} [Sun Jul 31 01:02:44 2022] GET /identity/v3/groups/f47fb0a3cf534ea78d6946e5426cf1ce => generated 229 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:44.884312 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd99b02-49bc-4abe-b8ed-94f457eab57e None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:44.888990 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 217/414] 10.222.0.60 () {56 vars in 1101 bytes} [Sun Jul 31 01:02:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:44.889159 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b9d65-a8d0-4c6c-8d2d-cf15d9e8d973 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:44.914975 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:44.993837 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd99b02-49bc-4abe-b8ed-94f457eab57e None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:44.997565 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b9d65-a8d0-4c6c-8d2d-cf15d9e8d973 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:45.033070 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea48d3-a427-4126-8252-894f8412af57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:45.034128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea48d3-a427-4126-8252-894f8412af57 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:45.034651 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea48d3-a427-4126-8252-894f8412af57 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:45.035198 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763ee94-e522-4641-9d6f-7044368adfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:45.035359 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763ee94-e522-4641-9d6f-7044368adfcd None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:45.035833 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763ee94-e522-4641-9d6f-7044368adfcd None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:45.036007 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea48d3-a427-4126-8252-894f8412af57 None admin] PATH_INFO: `/v3/groups/a5bf2cfd89604dff83c7fdae945e6b5c` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:45.036133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763ee94-e522-4641-9d6f-7044368adfcd None admin] PATH_INFO: `/v3/projects/9b95aba7aab1442a9b3944b9e1f7019a` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:45.037325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6763ee94-e522-4641-9d6f-7044368adfcd None admin] RBAC: Authorizing `identity:get_project(project_id=9b95aba7aab1442a9b3944b9e1f7019a)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:45.037781 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea48d3-a427-4126-8252-894f8412af57 None admin] RBAC: Authorizing `identity:get_group(group_id=a5bf2cfd89604dff83c7fdae945e6b5c)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:45.038977 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6763ee94-e522-4641-9d6f-7044368adfcd None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:45.039622 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea48d3-a427-4126-8252-894f8412af57 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:45.040818 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 218/415] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:02:44 2022] GET /identity/v3/projects/9b95aba7aab1442a9b3944b9e1f7019a => generated 344 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:45.041661 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763ee94-e522-4641-9d6f-7044368adfcd None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:45.042100 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 198/416] 10.222.0.60 () {56 vars in 1180 bytes} [Sun Jul 31 01:02:44 2022] GET /identity/v3/groups/a5bf2cfd89604dff83c7fdae945e6b5c => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:45.052170 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea48d3-a427-4126-8252-894f8412af57 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:45.064788 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:45.146243 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763ee94-e522-4641-9d6f-7044368adfcd None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:45.156928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:45.164316 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea48d3-a427-4126-8252-894f8412af57 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:45.183873 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735e61a-87fd-493b-90fb-aa4b7ff2c07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:45.184732 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735e61a-87fd-493b-90fb-aa4b7ff2c07b None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:45.185160 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735e61a-87fd-493b-90fb-aa4b7ff2c07b None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:45.185571 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735e61a-87fd-493b-90fb-aa4b7ff2c07b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:45.201381 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb820d-7234-482b-9710-0d4afe6d3813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:45.202337 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb820d-7234-482b-9710-0d4afe6d3813 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:45.202712 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb820d-7234-482b-9710-0d4afe6d3813 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:45.203113 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb820d-7234-482b-9710-0d4afe6d3813 None admin] PATH_INFO: `/v3/projects/7c49b7e2947f42c096eb6b5a5fca321a` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:45.204516 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb820d-7234-482b-9710-0d4afe6d3813 None admin] RBAC: Authorizing `identity:get_project(project_id=7c49b7e2947f42c096eb6b5a5fca321a)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:45.206162 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb820d-7234-482b-9710-0d4afe6d3813 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:45.208088 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 199/417] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:02:45 2022] GET /identity/v3/projects/7c49b7e2947f42c096eb6b5a5fca321a => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:45.208914 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb820d-7234-482b-9710-0d4afe6d3813 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:45.258790 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735e61a-87fd-493b-90fb-aa4b7ff2c07b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:45.260671 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735e61a-87fd-493b-90fb-aa4b7ff2c07b None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:45.282591 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:45.318524 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb820d-7234-482b-9710-0d4afe6d3813 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:45.358201 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ed270-0304-4320-a5c0-9bb75fa668a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:45.359011 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ed270-0304-4320-a5c0-9bb75fa668a1 None admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:45.359288 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ed270-0304-4320-a5c0-9bb75fa668a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:45.359608 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ed270-0304-4320-a5c0-9bb75fa668a1 None admin] PATH_INFO: `/v3/projects/9b95aba7aab1442a9b3944b9e1f7019a/groups/f47fb0a3cf534ea78d6946e5426cf1ce/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:45.362894 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ed270-0304-4320-a5c0-9bb75fa668a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=9b95aba7aab1442a9b3944b9e1f7019a, group_id=f47fb0a3cf534ea78d6946e5426cf1ce, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:45.363028 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ed270-0304-4320-a5c0-9bb75fa668a1 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:45.376273 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 200/418] 10.222.0.60 () {58 vars in 1442 bytes} [Sun Jul 31 01:02:45 2022] PUT /identity/v3/projects/9b95aba7aab1442a9b3944b9e1f7019a/groups/f47fb0a3cf534ea78d6946e5426cf1ce/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:02:45.377159 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ed270-0304-4320-a5c0-9bb75fa668a1 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:45.397449 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 219/419] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:02:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:02:45.399469 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3b4c1-589c-4a1d-93f1-9d5251b6c859 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:45.400254 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3b4c1-589c-4a1d-93f1-9d5251b6c859 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:45.401291 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3b4c1-589c-4a1d-93f1-9d5251b6c859 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:45.407881 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 220/420] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:45 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:45.409734 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3b4c1-589c-4a1d-93f1-9d5251b6c859 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:45.416373 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:45.512800 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ed270-0304-4320-a5c0-9bb75fa668a1 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:45.525463 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3b4c1-589c-4a1d-93f1-9d5251b6c859 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:45.547938 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:45.552167 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793bd724-bc64-4406-ba7a-e893e2c5413f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:45.552955 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793bd724-bc64-4406-ba7a-e893e2c5413f None admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:45.553245 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793bd724-bc64-4406-ba7a-e893e2c5413f None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:45.553508 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793bd724-bc64-4406-ba7a-e893e2c5413f None admin] PATH_INFO: `/v3/projects/7c49b7e2947f42c096eb6b5a5fca321a/groups/a5bf2cfd89604dff83c7fdae945e6b5c/roles/8272ca656a1f41379f9acf1ea055fb4d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:45.555772 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793bd724-bc64-4406-ba7a-e893e2c5413f None admin] RBAC: Authorizing `identity:create_grant(project_id=7c49b7e2947f42c096eb6b5a5fca321a, group_id=a5bf2cfd89604dff83c7fdae945e6b5c, role_id=8272ca656a1f41379f9acf1ea055fb4d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:45.557217 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793bd724-bc64-4406-ba7a-e893e2c5413f None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:45.564750 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff77e0af-e2c2-4721-878b-feab4d2b1b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:45.565426 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77e0af-e2c2-4721-878b-feab4d2b1b61 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:45.565704 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77e0af-e2c2-4721-878b-feab4d2b1b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:45.565977 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77e0af-e2c2-4721-878b-feab4d2b1b61 None admin] PATH_INFO: `/v3/projects/882624ffe602494b95664e06c16d55a2` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:45.567152 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff77e0af-e2c2-4721-878b-feab4d2b1b61 None admin] RBAC: Authorizing `identity:get_project(project_id=882624ffe602494b95664e06c16d55a2)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:45.568801 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff77e0af-e2c2-4721-878b-feab4d2b1b61 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:45.571382 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 221/421] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:02:45 2022] GET /identity/v3/projects/882624ffe602494b95664e06c16d55a2 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:45.572468 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6950635-b830-4250-a23a-04256f1e2f47 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:45.572468 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6950635-b830-4250-a23a-04256f1e2f47 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:45.572631 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6950635-b830-4250-a23a-04256f1e2f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:45.578686 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 201/422] 10.222.0.60 () {58 vars in 1442 bytes} [Sun Jul 31 01:02:45 2022] PUT /identity/v3/projects/7c49b7e2947f42c096eb6b5a5fca321a/groups/a5bf2cfd89604dff83c7fdae945e6b5c/roles/8272ca656a1f41379f9acf1ea055fb4d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:02:45.580151 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793bd724-bc64-4406-ba7a-e893e2c5413f None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:45.593789 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-b6950635-b830-4250-a23a-04256f1e2f47 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:45.594555 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-b6950635-b830-4250-a23a-04256f1e2f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:45.741293 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 222/423] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:02:45.764189 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6950635-b830-4250-a23a-04256f1e2f47 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:45.767442 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:45.794937 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793bd724-bc64-4406-ba7a-e893e2c5413f None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:45.842800 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2df91-8550-4d4f-a968-bdd6bbd5d09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:45.844032 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2df91-8550-4d4f-a968-bdd6bbd5d09f None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:45.844872 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2df91-8550-4d4f-a968-bdd6bbd5d09f None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:45.845651 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2df91-8550-4d4f-a968-bdd6bbd5d09f None admin] PATH_INFO: `/v3/groups/a5bf2cfd89604dff83c7fdae945e6b5c` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:45.847088 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e2df91-8550-4d4f-a968-bdd6bbd5d09f None admin] RBAC: Authorizing `identity:get_group(group_id=a5bf2cfd89604dff83c7fdae945e6b5c)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:45.849635 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e2df91-8550-4d4f-a968-bdd6bbd5d09f None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:45.852357 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 202/424] 10.222.0.60 () {56 vars in 1180 bytes} [Sun Jul 31 01:02:45 2022] GET /identity/v3/groups/a5bf2cfd89604dff83c7fdae945e6b5c => generated 226 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:02:45.862161 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2df91-8550-4d4f-a968-bdd6bbd5d09f None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:45.900189 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6950635-b830-4250-a23a-04256f1e2f47 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:45.937302 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:45.965403 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c302e-f7b0-48fb-9e48-e081c8fe161e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:45.966063 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c302e-f7b0-48fb-9e48-e081c8fe161e None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:45.966345 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c302e-f7b0-48fb-9e48-e081c8fe161e None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:45.966621 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c302e-f7b0-48fb-9e48-e081c8fe161e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:45.987071 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c302e-f7b0-48fb-9e48-e081c8fe161e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:46.000030 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-309c302e-f7b0-48fb-9e48-e081c8fe161e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:02:46.000030 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:46.000030 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:46.000030 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:46.000030 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:46.000030 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:46.000030 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:46.000030 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:46.000030 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:46.000030 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:46.000030 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:46.000030 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:46.000030 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:46.000030 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:46.000030 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:46.000030 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:46.001010 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:46.001010 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:46.001010 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:46.001010 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:46.001010 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:46.001010 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:46.001010 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:46.001010 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:46.001010 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:46.001010 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:46.001010 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:46.001010 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:46.001010 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:46.001010 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:46.001010 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:46.001010 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:46.002748 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:46.002748 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:46.002748 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:46.002748 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:46.002748 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:46.002748 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:46.002748 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:46.002748 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:46.002748 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:46.002748 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:46.002748 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:02:46.002748 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:02:46.002748 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 223/425] 10.222.0.60 () {56 vars in 1114 bytes} [Sun Jul 31 01:02:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:02:46.008464 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c302e-f7b0-48fb-9e48-e081c8fe161e None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:46.037358 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2df91-8550-4d4f-a968-bdd6bbd5d09f None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:46.092020 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ddf64a-f5f2-4014-8842-670069e14ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:46.092702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ddf64a-f5f2-4014-8842-670069e14ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:46.093927 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ddf64a-f5f2-4014-8842-670069e14ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:46.094208 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ddf64a-f5f2-4014-8842-670069e14ea4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:46.095014 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ddf64a-f5f2-4014-8842-670069e14ea4 None admin] RBAC: Adding query filter params (group.id=a5bf2cfd89604dff83c7fdae945e6b5c, role.id=12a8e2ae2b6b4d699aac9ba2319cf57d, scope.project.id=882624ffe602494b95664e06c16d55a2) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:46.095323 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ddf64a-f5f2-4014-8842-670069e14ea4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:46.096800 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ddf64a-f5f2-4014-8842-670069e14ea4 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:46.114453 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 203/426] 10.222.0.60 () {56 vars in 1376 bytes} [Sun Jul 31 01:02:45 2022] GET /identity/v3/role_assignments?group.id=a5bf2cfd89604dff83c7fdae945e6b5c&scope.project.id=882624ffe602494b95664e06c16d55a2&role.id=12a8e2ae2b6b4d699aac9ba2319cf57d => generated 611 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:46.173613 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c302e-f7b0-48fb-9e48-e081c8fe161e None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:46.214280 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f0e0d-b21c-4ee9-ba1f-2bbaed66823a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:46.214972 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f0e0d-b21c-4ee9-ba1f-2bbaed66823a None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:46.215254 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f0e0d-b21c-4ee9-ba1f-2bbaed66823a None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:46.215541 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f0e0d-b21c-4ee9-ba1f-2bbaed66823a None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:46.216363 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f0e0d-b21c-4ee9-ba1f-2bbaed66823a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:46.216710 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f0e0d-b21c-4ee9-ba1f-2bbaed66823a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:46.218259 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f0e0d-b21c-4ee9-ba1f-2bbaed66823a None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:46.228634 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 224/427] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:02:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:46.234382 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ddf64a-f5f2-4014-8842-670069e14ea4 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:46.253426 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:46.296408 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b017d-a69d-4083-8362-65babd6c550e None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:46.296584 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b017d-a69d-4083-8362-65babd6c550e None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:46.296866 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b017d-a69d-4083-8362-65babd6c550e None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:46.298482 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 225/428] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:46.303791 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09b2d8-00fe-4f27-b256-976ad489982c None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:46.304072 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09b2d8-00fe-4f27-b256-976ad489982c None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:46.304349 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09b2d8-00fe-4f27-b256-976ad489982c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:46.325051 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-6c09b2d8-00fe-4f27-b256-976ad489982c None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:46.326287 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-6c09b2d8-00fe-4f27-b256-976ad489982c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:46.371805 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:46.379265 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ddf64a-f5f2-4014-8842-670069e14ea4 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:46.421104 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 226/429] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:02:46.424591 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb6e26-6cf3-4e97-8781-cfb15367df9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:46.425519 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb6e26-6cf3-4e97-8781-cfb15367df9e None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:46.426081 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb6e26-6cf3-4e97-8781-cfb15367df9e None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:46.426577 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb6e26-6cf3-4e97-8781-cfb15367df9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:46.446428 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09b2d8-00fe-4f27-b256-976ad489982c None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:46.552873 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb6e26-6cf3-4e97-8781-cfb15367df9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:46.554793 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb6e26-6cf3-4e97-8781-cfb15367df9e None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:46.575170 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:46.589178 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09b2d8-00fe-4f27-b256-976ad489982c None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:46.642952 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0cd02-6900-49be-ac0d-920ab1cbe19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:46.643807 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0cd02-6900-49be-ac0d-920ab1cbe19a None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:46.644082 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0cd02-6900-49be-ac0d-920ab1cbe19a None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:46.644641 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0cd02-6900-49be-ac0d-920ab1cbe19a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:46.659154 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c0cd02-6900-49be-ac0d-920ab1cbe19a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:46.665449 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-e3c0cd02-6900-49be-ac0d-920ab1cbe19a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:02:46.665449 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:46.665449 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:46.665449 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:46.665449 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:46.665449 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:46.665449 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:46.665449 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:46.665449 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:46.665449 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:46.665449 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:46.665449 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:46.665449 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:46.665449 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:46.665449 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:46.665449 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:46.666530 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:46.666530 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:46.666530 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:46.666530 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:46.666530 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:46.666530 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:46.666530 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:46.666530 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:46.666530 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:46.666530 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:46.666530 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:46.666530 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:46.666530 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:46.666530 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:46.666530 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:46.666530 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:46.667539 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:46.667539 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:46.667539 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:46.667539 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:46.667539 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:46.667539 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:46.667539 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:46.667539 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:46.667539 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:46.667539 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:46.667539 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:02:46.667539 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:02:46.669367 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 227/430] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:02:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:02:46.675196 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0cd02-6900-49be-ac0d-920ab1cbe19a None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:46.703818 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 204/431] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:02:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:02:46.707771 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb6e26-6cf3-4e97-8781-cfb15367df9e None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:46.717750 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:46.796561 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0cd02-6900-49be-ac0d-920ab1cbe19a None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:46.819716 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb6e26-6cf3-4e97-8781-cfb15367df9e None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:46.835460 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:46.840506 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d4d8f-57a4-4dc6-b6e9-8ad3c9e414fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:46.841142 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d4d8f-57a4-4dc6-b6e9-8ad3c9e414fa None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:46.841425 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d4d8f-57a4-4dc6-b6e9-8ad3c9e414fa None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:46.841829 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d4d8f-57a4-4dc6-b6e9-8ad3c9e414fa None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:46.842601 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d4d8f-57a4-4dc6-b6e9-8ad3c9e414fa None admin] RBAC: Adding query filter params (name=member) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:46.842913 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d4d8f-57a4-4dc6-b6e9-8ad3c9e414fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:46.844332 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d4d8f-57a4-4dc6-b6e9-8ad3c9e414fa None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:46.853672 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 228/432] 10.222.0.60 () {56 vars in 1101 bytes} [Sun Jul 31 01:02:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:02:46.859449 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d4d8f-57a4-4dc6-b6e9-8ad3c9e414fa None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:46.859874 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b0d7a-79a3-4bdd-a360-ab8014e546ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:46.860540 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b0d7a-79a3-4bdd-a360-ab8014e546ac None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:46.860818 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b0d7a-79a3-4bdd-a360-ab8014e546ac None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:46.861088 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b0d7a-79a3-4bdd-a360-ab8014e546ac None admin] PATH_INFO: `/v3/projects/882624ffe602494b95664e06c16d55a2` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:46.864149 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b0d7a-79a3-4bdd-a360-ab8014e546ac None admin] RBAC: Authorizing `identity:get_project(project_id=882624ffe602494b95664e06c16d55a2)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:46.865626 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b0d7a-79a3-4bdd-a360-ab8014e546ac None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:46.867646 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 205/433] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:02:46 2022] GET /identity/v3/projects/882624ffe602494b95664e06c16d55a2 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:46.873409 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b0d7a-79a3-4bdd-a360-ab8014e546ac None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:46.957259 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:46.969319 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d4d8f-57a4-4dc6-b6e9-8ad3c9e414fa None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:46.994816 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b0d7a-79a3-4bdd-a360-ab8014e546ac None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:47.011068 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2e6eb-9bcb-4d73-a317-2f3202791311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:47.012068 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2e6eb-9bcb-4d73-a317-2f3202791311 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:47.012527 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2e6eb-9bcb-4d73-a317-2f3202791311 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:47.012976 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2e6eb-9bcb-4d73-a317-2f3202791311 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:47.033416 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a25e42a-b978-48f2-8c3c-012da3f47307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:47.034198 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25e42a-b978-48f2-8c3c-012da3f47307 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:47.034681 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25e42a-b978-48f2-8c3c-012da3f47307 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:47.034788 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25e42a-b978-48f2-8c3c-012da3f47307 None admin] PATH_INFO: `/v3/groups/a5bf2cfd89604dff83c7fdae945e6b5c` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:47.036104 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a25e42a-b978-48f2-8c3c-012da3f47307 None admin] RBAC: Authorizing `identity:get_group(group_id=a5bf2cfd89604dff83c7fdae945e6b5c)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:47.038257 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a25e42a-b978-48f2-8c3c-012da3f47307 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:47.040594 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 206/434] 10.222.0.60 () {56 vars in 1180 bytes} [Sun Jul 31 01:02:46 2022] GET /identity/v3/groups/a5bf2cfd89604dff83c7fdae945e6b5c => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:47.045229 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a25e42a-b978-48f2-8c3c-012da3f47307 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:47.089608 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef2e6eb-9bcb-4d73-a317-2f3202791311 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:47.092010 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef2e6eb-9bcb-4d73-a317-2f3202791311 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:47.098311 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:47.149337 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a25e42a-b978-48f2-8c3c-012da3f47307 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:47.185659 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436bd55-e69e-4a1b-af8a-337c1b1cc6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:47.186590 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436bd55-e69e-4a1b-af8a-337c1b1cc6c2 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:47.186966 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436bd55-e69e-4a1b-af8a-337c1b1cc6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:47.187304 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436bd55-e69e-4a1b-af8a-337c1b1cc6c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:47.188202 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7436bd55-e69e-4a1b-af8a-337c1b1cc6c2 None admin] RBAC: Adding query filter params (group.id=a5bf2cfd89604dff83c7fdae945e6b5c, role.id=8272ca656a1f41379f9acf1ea055fb4d, scope.project.id=882624ffe602494b95664e06c16d55a2) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:47.188577 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7436bd55-e69e-4a1b-af8a-337c1b1cc6c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:47.190187 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7436bd55-e69e-4a1b-af8a-337c1b1cc6c2 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:47.193718 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:47.197276 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 207/435] 10.222.0.60 () {56 vars in 1376 bytes} [Sun Jul 31 01:02:47 2022] GET /identity/v3/role_assignments?group.id=a5bf2cfd89604dff83c7fdae945e6b5c&scope.project.id=882624ffe602494b95664e06c16d55a2&role.id=8272ca656a1f41379f9acf1ea055fb4d => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:47.208682 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 229/436] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:02:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:02:47.210080 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436bd55-e69e-4a1b-af8a-337c1b1cc6c2 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:47.324792 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436bd55-e69e-4a1b-af8a-337c1b1cc6c2 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:47.340511 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:47.371772 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a8fc6-4feb-47d9-b962-7a097b5418f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:47.372457 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a8fc6-4feb-47d9-b962-7a097b5418f6 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:47.372729 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a8fc6-4feb-47d9-b962-7a097b5418f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:47.373002 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a8fc6-4feb-47d9-b962-7a097b5418f6 None admin] PATH_INFO: `/v3/projects/7c49b7e2947f42c096eb6b5a5fca321a` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:47.374303 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a8fc6-4feb-47d9-b962-7a097b5418f6 None admin] RBAC: Authorizing `identity:get_project(project_id=7c49b7e2947f42c096eb6b5a5fca321a)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:47.375818 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a8fc6-4feb-47d9-b962-7a097b5418f6 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:47.378360 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 208/437] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:02:47 2022] GET /identity/v3/projects/7c49b7e2947f42c096eb6b5a5fca321a => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:02:47.384032 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2e6eb-9bcb-4d73-a317-2f3202791311 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:47.494198 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2e6eb-9bcb-4d73-a317-2f3202791311 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:47.531117 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1203dea-1c89-4278-a937-91b8dab01bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:47.532181 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1203dea-1c89-4278-a937-91b8dab01bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:47.532679 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1203dea-1c89-4278-a937-91b8dab01bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:47.533149 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1203dea-1c89-4278-a937-91b8dab01bc2 None admin] PATH_INFO: `/v3/groups/a5bf2cfd89604dff83c7fdae945e6b5c` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:47.534530 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1203dea-1c89-4278-a937-91b8dab01bc2 None admin] RBAC: Authorizing `identity:get_group(group_id=a5bf2cfd89604dff83c7fdae945e6b5c)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:47.536283 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1203dea-1c89-4278-a937-91b8dab01bc2 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:47.538470 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 230/438] 10.222.0.60 () {56 vars in 1180 bytes} [Sun Jul 31 01:02:47 2022] GET /identity/v3/groups/a5bf2cfd89604dff83c7fdae945e6b5c => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:47.544387 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a8fc6-4feb-47d9-b962-7a097b5418f6 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:47.658110 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a8fc6-4feb-47d9-b962-7a097b5418f6 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:47.692736 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f3b7a-ec8c-4165-b890-b79986af417d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:47.693426 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f3b7a-ec8c-4165-b890-b79986af417d None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:47.693709 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f3b7a-ec8c-4165-b890-b79986af417d None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:47.694023 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f3b7a-ec8c-4165-b890-b79986af417d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:47.694828 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f3b7a-ec8c-4165-b890-b79986af417d None admin] RBAC: Adding query filter params (group.id=a5bf2cfd89604dff83c7fdae945e6b5c, role.id=12a8e2ae2b6b4d699aac9ba2319cf57d, scope.project.id=7c49b7e2947f42c096eb6b5a5fca321a) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:47.695137 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f3b7a-ec8c-4165-b890-b79986af417d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:47.696603 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f3b7a-ec8c-4165-b890-b79986af417d None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:47.700874 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc08b70-4a35-4489-a1d3-9d8d5c0a6cec None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:47.701355 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc08b70-4a35-4489-a1d3-9d8d5c0a6cec None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:47.701444 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc08b70-4a35-4489-a1d3-9d8d5c0a6cec None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:47.702983 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 231/439] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:47.708482 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 209/440] 10.222.0.60 () {56 vars in 1376 bytes} [Sun Jul 31 01:02:47 2022] GET /identity/v3/role_assignments?group.id=a5bf2cfd89604dff83c7fdae945e6b5c&scope.project.id=7c49b7e2947f42c096eb6b5a5fca321a&role.id=12a8e2ae2b6b4d699aac9ba2319cf57d => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:47.708649 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3239b-9acf-4c67-9c2a-37768603a3d7 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:47.708760 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3239b-9acf-4c67-9c2a-37768603a3d7 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:47.708963 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3239b-9acf-4c67-9c2a-37768603a3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:47.728470 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-07e3239b-9acf-4c67-9c2a-37768603a3d7 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:47.729727 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-07e3239b-9acf-4c67-9c2a-37768603a3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:47.796254 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:47.809703 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 232/441] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:02:47.833276 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f3b7a-ec8c-4165-b890-b79986af417d None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:47.885430 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:47.908736 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f8d92-5a3a-4bf1-885f-d3617dde25c9 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:47.908935 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f8d92-5a3a-4bf1-885f-d3617dde25c9 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:47.909209 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f8d92-5a3a-4bf1-885f-d3617dde25c9 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:47.910583 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 233/442] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:47.915730 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f6242-5468-4daa-951d-86a13aef7ea9 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:47.916670 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f6242-5468-4daa-951d-86a13aef7ea9 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:47.917118 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f6242-5468-4daa-951d-86a13aef7ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:47.941555 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-5f8f6242-5468-4daa-951d-86a13aef7ea9 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:47.941779 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f3b7a-ec8c-4165-b890-b79986af417d None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:47.942736 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-5f8f6242-5468-4daa-951d-86a13aef7ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:47.983696 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6b2d7-3951-4406-a210-a580d54a5a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:47.984353 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6b2d7-3951-4406-a210-a580d54a5a8f None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:47.984631 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6b2d7-3951-4406-a210-a580d54a5a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:47.984961 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6b2d7-3951-4406-a210-a580d54a5a8f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:47.997294 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec6b2d7-3951-4406-a210-a580d54a5a8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:48.003471 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-aec6b2d7-3951-4406-a210-a580d54a5a8f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:02:48.003471 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:48.003471 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:48.003471 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:48.003471 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:48.003471 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:48.003471 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:48.003471 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:48.003471 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:48.003471 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:48.003471 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:48.003471 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:48.003471 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:48.003471 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:48.003471 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:48.003471 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:48.004455 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:48.004455 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:48.004455 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:48.004455 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:48.004455 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:48.004455 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:48.004455 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:48.004455 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:48.004455 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:48.004455 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:48.004455 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:48.004455 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:48.004455 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:48.004455 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:48.004455 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:48.004455 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:48.005349 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:48.005349 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:48.005349 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:48.005349 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:48.005349 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:48.005349 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:48.005349 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:48.005349 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:48.005349 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:48.005349 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:48.005349 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:02:48.005349 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:02:48.005349 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 210/443] 10.222.0.60 () {56 vars in 1096 bytes} [Sun Jul 31 01:02:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:48.010592 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6b2d7-3951-4406-a210-a580d54a5a8f None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:48.039851 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 234/444] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:02:48.057054 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f6242-5468-4daa-951d-86a13aef7ea9 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:48.119219 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6b2d7-3951-4406-a210-a580d54a5a8f None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:48.126024 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:48.152772 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff6ef5-1607-48f4-b3ec-168a52fa888a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:48.153397 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff6ef5-1607-48f4-b3ec-168a52fa888a None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:48.153673 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff6ef5-1607-48f4-b3ec-168a52fa888a None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:48.153943 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff6ef5-1607-48f4-b3ec-168a52fa888a None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:48.154665 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff6ef5-1607-48f4-b3ec-168a52fa888a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:48.154984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff6ef5-1607-48f4-b3ec-168a52fa888a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:48.156388 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff6ef5-1607-48f4-b3ec-168a52fa888a None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:48.156913 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f6242-5468-4daa-951d-86a13aef7ea9 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:48.165571 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 211/445] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:02:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:02:48.172234 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff6ef5-1607-48f4-b3ec-168a52fa888a None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:48.177941 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:48.193317 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e47a6-9fe0-4aad-ae5b-3af9e7ad2136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:48.193967 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e47a6-9fe0-4aad-ae5b-3af9e7ad2136 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:48.194247 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e47a6-9fe0-4aad-ae5b-3af9e7ad2136 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:48.194519 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e47a6-9fe0-4aad-ae5b-3af9e7ad2136 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:48.205567 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e47a6-9fe0-4aad-ae5b-3af9e7ad2136 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:48.210529 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-469e47a6-9fe0-4aad-ae5b-3af9e7ad2136 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:02:48.210529 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:48.210529 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:48.210529 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:48.210529 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:48.210529 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:48.210529 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:48.210529 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:48.210529 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:48.210529 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:48.210529 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:48.210529 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:48.210529 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:48.210529 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:48.210529 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:48.210529 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:48.211444 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:48.211444 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:48.211444 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:48.211444 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:48.211444 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:48.211444 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:48.211444 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:48.211444 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:48.211444 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:48.211444 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:48.211444 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:48.211444 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:48.211444 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:48.211444 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:48.211444 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:48.211444 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:48.212284 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:48.212284 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:48.212284 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:48.212284 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:48.212284 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:48.212284 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:48.212284 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:48.212284 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:48.212284 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:48.212284 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:48.212284 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:02:48.212284 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:02:48.212284 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 235/446] 10.222.0.60 () {56 vars in 1114 bytes} [Sun Jul 31 01:02:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:02:48.218146 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e47a6-9fe0-4aad-ae5b-3af9e7ad2136 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:48.275214 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff6ef5-1607-48f4-b3ec-168a52fa888a None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:48.307410 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52319fb2-1ab8-4a54-9acc-ccf011301c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:48.308078 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52319fb2-1ab8-4a54-9acc-ccf011301c89 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:48.308365 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52319fb2-1ab8-4a54-9acc-ccf011301c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:48.308640 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52319fb2-1ab8-4a54-9acc-ccf011301c89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:48.314906 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e47a6-9fe0-4aad-ae5b-3af9e7ad2136 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:48.342223 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:48.348076 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eda718-c100-4c68-8cbb-e4d1927c3907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:48.348693 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eda718-c100-4c68-8cbb-e4d1927c3907 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:48.348969 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eda718-c100-4c68-8cbb-e4d1927c3907 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:48.349247 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eda718-c100-4c68-8cbb-e4d1927c3907 None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:48.349968 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eda718-c100-4c68-8cbb-e4d1927c3907 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:48.350265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eda718-c100-4c68-8cbb-e4d1927c3907 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:48.351674 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eda718-c100-4c68-8cbb-e4d1927c3907 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:48.361455 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 236/447] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:02:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:48.367192 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eda718-c100-4c68-8cbb-e4d1927c3907 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:48.379132 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52319fb2-1ab8-4a54-9acc-ccf011301c89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:48.380655 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52319fb2-1ab8-4a54-9acc-ccf011301c89 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:48.410413 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:48.467803 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eda718-c100-4c68-8cbb-e4d1927c3907 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:48.480159 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 212/448] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:02:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:02:48.486118 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52319fb2-1ab8-4a54-9acc-ccf011301c89 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:48.501107 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf5b0a-4745-49f9-b840-54dfe560a98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:48.501731 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf5b0a-4745-49f9-b840-54dfe560a98a None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:48.502005 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf5b0a-4745-49f9-b840-54dfe560a98a None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:48.502278 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf5b0a-4745-49f9-b840-54dfe560a98a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:48.553236 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:48.569078 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf5b0a-4745-49f9-b840-54dfe560a98a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:48.570537 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf5b0a-4745-49f9-b840-54dfe560a98a None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:48.587621 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52319fb2-1ab8-4a54-9acc-ccf011301c89 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:48.610058 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:48.622206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf88d5-49f2-4de7-83ae-4dd63254b1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:48.622873 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf88d5-49f2-4de7-83ae-4dd63254b1d7 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:48.623138 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf88d5-49f2-4de7-83ae-4dd63254b1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:48.623412 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf88d5-49f2-4de7-83ae-4dd63254b1d7 None admin] PATH_INFO: `/v3/projects/9b95aba7aab1442a9b3944b9e1f7019a` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:48.624700 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebf88d5-49f2-4de7-83ae-4dd63254b1d7 None admin] RBAC: Authorizing `identity:get_project(project_id=9b95aba7aab1442a9b3944b9e1f7019a)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:48.626147 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebf88d5-49f2-4de7-83ae-4dd63254b1d7 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:48.628214 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 213/449] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:02:48 2022] GET /identity/v3/projects/9b95aba7aab1442a9b3944b9e1f7019a => generated 344 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:02:48.633682 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf88d5-49f2-4de7-83ae-4dd63254b1d7 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:48.665677 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 237/450] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:02:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:02:48.671474 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf5b0a-4745-49f9-b840-54dfe560a98a None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:48.745823 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf88d5-49f2-4de7-83ae-4dd63254b1d7 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:48.779904 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf5b0a-4745-49f9-b840-54dfe560a98a None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:48.781182 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60edb0cb-74ee-41fe-9a1c-b76921cb80df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:48.781843 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edb0cb-74ee-41fe-9a1c-b76921cb80df None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:48.782117 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edb0cb-74ee-41fe-9a1c-b76921cb80df None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:48.782400 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edb0cb-74ee-41fe-9a1c-b76921cb80df None admin] PATH_INFO: `/v3/groups/f47fb0a3cf534ea78d6946e5426cf1ce` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:48.783614 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60edb0cb-74ee-41fe-9a1c-b76921cb80df None admin] RBAC: Authorizing `identity:get_group(group_id=f47fb0a3cf534ea78d6946e5426cf1ce)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:48.785050 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60edb0cb-74ee-41fe-9a1c-b76921cb80df None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:48.786805 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 214/451] 10.222.0.60 () {56 vars in 1180 bytes} [Sun Jul 31 01:02:48 2022] GET /identity/v3/groups/f47fb0a3cf534ea78d6946e5426cf1ce => generated 229 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:02:48.792470 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60edb0cb-74ee-41fe-9a1c-b76921cb80df None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:48.795995 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:48.815716 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953fc57-ed1c-497d-979e-0bae2073b476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:48.816364 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953fc57-ed1c-497d-979e-0bae2073b476 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:48.816671 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953fc57-ed1c-497d-979e-0bae2073b476 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:48.816933 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953fc57-ed1c-497d-979e-0bae2073b476 None admin] PATH_INFO: `/v3/projects/7c49b7e2947f42c096eb6b5a5fca321a` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:48.818172 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5953fc57-ed1c-497d-979e-0bae2073b476 None admin] RBAC: Authorizing `identity:get_project(project_id=7c49b7e2947f42c096eb6b5a5fca321a)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:48.819690 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5953fc57-ed1c-497d-979e-0bae2073b476 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:48.821445 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 238/452] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:02:48 2022] GET /identity/v3/projects/7c49b7e2947f42c096eb6b5a5fca321a => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:02:48.826819 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953fc57-ed1c-497d-979e-0bae2073b476 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:48.838320 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:48.893005 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60edb0cb-74ee-41fe-9a1c-b76921cb80df None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:48.922655 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953fc57-ed1c-497d-979e-0bae2073b476 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:48.926755 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7460f-2abe-499a-8376-9cc23d85f7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:48.927375 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7460f-2abe-499a-8376-9cc23d85f7ed None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:48.927691 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7460f-2abe-499a-8376-9cc23d85f7ed None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:48.927958 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7460f-2abe-499a-8376-9cc23d85f7ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:48.928755 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd7460f-2abe-499a-8376-9cc23d85f7ed None admin] RBAC: Adding query filter params (group.id=f47fb0a3cf534ea78d6946e5426cf1ce, role.id=fef526a7d2e741ce995d107f3ac934ae, scope.project.id=9b95aba7aab1442a9b3944b9e1f7019a) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:48.929063 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd7460f-2abe-499a-8376-9cc23d85f7ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:48.930487 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd7460f-2abe-499a-8376-9cc23d85f7ed None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:48.941551 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 215/453] 10.222.0.60 () {56 vars in 1376 bytes} [Sun Jul 31 01:02:48 2022] GET /identity/v3/role_assignments?group.id=f47fb0a3cf534ea78d6946e5426cf1ce&scope.project.id=9b95aba7aab1442a9b3944b9e1f7019a&role.id=fef526a7d2e741ce995d107f3ac934ae => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:02:48.956431 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f9f94-009f-40a7-90d7-af7413885bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:48.957219 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f9f94-009f-40a7-90d7-af7413885bf1 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:48.957557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f9f94-009f-40a7-90d7-af7413885bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:48.957887 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f9f94-009f-40a7-90d7-af7413885bf1 None admin] PATH_INFO: `/v3/groups/a5bf2cfd89604dff83c7fdae945e6b5c` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:48.959195 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f9f94-009f-40a7-90d7-af7413885bf1 None admin] RBAC: Authorizing `identity:get_group(group_id=a5bf2cfd89604dff83c7fdae945e6b5c)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:48.960744 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f9f94-009f-40a7-90d7-af7413885bf1 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:48.962409 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 239/454] 10.222.0.60 () {56 vars in 1180 bytes} [Sun Jul 31 01:02:48 2022] GET /identity/v3/groups/a5bf2cfd89604dff83c7fdae945e6b5c => generated 226 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:48.968721 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7460f-2abe-499a-8376-9cc23d85f7ed None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:49.042362 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:49.077608 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7460f-2abe-499a-8376-9cc23d85f7ed None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:49.113375 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258280d3-c4b7-4f51-a7a7-7cf61ba8c332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:49.114000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258280d3-c4b7-4f51-a7a7-7cf61ba8c332 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:49.114281 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258280d3-c4b7-4f51-a7a7-7cf61ba8c332 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:49.114546 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258280d3-c4b7-4f51-a7a7-7cf61ba8c332 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:49.115335 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258280d3-c4b7-4f51-a7a7-7cf61ba8c332 None admin] RBAC: Adding query filter params (group.id=a5bf2cfd89604dff83c7fdae945e6b5c, role.id=8272ca656a1f41379f9acf1ea055fb4d, scope.project.id=7c49b7e2947f42c096eb6b5a5fca321a) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:49.115665 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258280d3-c4b7-4f51-a7a7-7cf61ba8c332 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:49.117091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258280d3-c4b7-4f51-a7a7-7cf61ba8c332 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:49.123080 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 216/455] 10.222.0.60 () {56 vars in 1376 bytes} [Sun Jul 31 01:02:48 2022] GET /identity/v3/role_assignments?group.id=a5bf2cfd89604dff83c7fdae945e6b5c&scope.project.id=7c49b7e2947f42c096eb6b5a5fca321a&role.id=8272ca656a1f41379f9acf1ea055fb4d => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:51.593122 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe636b7a-3252-4ed4-9abc-140f111da774 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:51.593649 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe636b7a-3252-4ed4-9abc-140f111da774 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:51.593649 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe636b7a-3252-4ed4-9abc-140f111da774 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:51.595251 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 240/456] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:51.600704 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befcdd3-fb7e-4d5b-94d3-cc450cf2d2c6 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:51.601091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befcdd3-fb7e-4d5b-94d3-cc450cf2d2c6 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:51.601250 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befcdd3-fb7e-4d5b-94d3-cc450cf2d2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:51.627028 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-3befcdd3-fb7e-4d5b-94d3-cc450cf2d2c6 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:51.628658 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-3befcdd3-fb7e-4d5b-94d3-cc450cf2d2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:51.714863 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 217/457] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:02:51.751659 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe636b7a-3252-4ed4-9abc-140f111da774 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:51.859060 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:51.887255 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe636b7a-3252-4ed4-9abc-140f111da774 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:51.890061 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfabb1-132e-46b0-b7f4-b065a4dc96b7 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:51.890353 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfabb1-132e-46b0-b7f4-b065a4dc96b7 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:51.890630 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfabb1-132e-46b0-b7f4-b065a4dc96b7 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:51.892290 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 218/458] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:51.896939 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7722f1e-f625-4d06-9aea-8cc60f3b4fc0 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:51.899255 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7722f1e-f625-4d06-9aea-8cc60f3b4fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:51.899733 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7722f1e-f625-4d06-9aea-8cc60f3b4fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:51.917914 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-e7722f1e-f625-4d06-9aea-8cc60f3b4fc0 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:51.919446 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-e7722f1e-f625-4d06-9aea-8cc60f3b4fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:51.935278 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e3bea-c3b5-45de-b3db-7cb14152cf63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:51.935771 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e3bea-c3b5-45de-b3db-7cb14152cf63 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:51.936049 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e3bea-c3b5-45de-b3db-7cb14152cf63 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:51.936363 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e3bea-c3b5-45de-b3db-7cb14152cf63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:51.949653 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e3bea-c3b5-45de-b3db-7cb14152cf63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:51.951084 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e3bea-c3b5-45de-b3db-7cb14152cf63 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:51.980422 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:51.982076 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-394e3bea-c3b5-45de-b3db-7cb14152cf63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:02:51.982076 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:51.982076 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:51.982076 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:51.982076 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:51.982076 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:51.982076 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:51.982076 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:51.982076 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:51.982076 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:51.982076 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:51.982076 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:51.982076 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:02:51.982076 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:02:51.982076 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:02:51.982906 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:02:51.982906 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:51.982906 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:51.982906 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:51.982906 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:51.982906 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:51.982906 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:51.982906 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:51.982906 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:51.982906 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:51.982906 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:51.982906 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:51.982906 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:51.982906 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:51.982906 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:51.982906 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:51.982906 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:51.984312 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:02:51.984312 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:02:51.984312 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:02:51.984312 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:02:51.987895 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 241/459] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:02:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:51.992707 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e3bea-c3b5-45de-b3db-7cb14152cf63 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:51.996221 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 219/460] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:02:52.020191 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7722f1e-f625-4d06-9aea-8cc60f3b4fc0 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:52.160437 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e3bea-c3b5-45de-b3db-7cb14152cf63 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:52.176694 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7722f1e-f625-4d06-9aea-8cc60f3b4fc0 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:52.201220 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:52.211534 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741210b3-00cc-418a-ac94-2c6da593a552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:52.212161 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741210b3-00cc-418a-ac94-2c6da593a552 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:52.212437 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741210b3-00cc-418a-ac94-2c6da593a552 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:52.212720 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741210b3-00cc-418a-ac94-2c6da593a552 None admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:52.213396 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741210b3-00cc-418a-ac94-2c6da593a552 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:52.213697 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741210b3-00cc-418a-ac94-2c6da593a552 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:52.215089 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741210b3-00cc-418a-ac94-2c6da593a552 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:52.216798 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc19c2af-52ad-4d7e-abf1-54dac06869db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:52.218187 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19c2af-52ad-4d7e-abf1-54dac06869db None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:52.218623 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19c2af-52ad-4d7e-abf1-54dac06869db None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:52.219027 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19c2af-52ad-4d7e-abf1-54dac06869db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:52.227851 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 242/461] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:02:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:02:52.229041 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe2b59-8143-4166-96f3-bf83674f1397 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:52.229330 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe2b59-8143-4166-96f3-bf83674f1397 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:52.229603 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe2b59-8143-4166-96f3-bf83674f1397 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:52.232265 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc19c2af-52ad-4d7e-abf1-54dac06869db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:52.234157 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc19c2af-52ad-4d7e-abf1-54dac06869db None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:52.234983 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 243/462] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:52.236189 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe2b59-8143-4166-96f3-bf83674f1397 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:52.254556 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-fc19c2af-52ad-4d7e-abf1-54dac06869db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:02:52.254556 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:52.254556 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:52.254556 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:52.254556 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:52.254556 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:52.254556 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:52.254556 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:52.254556 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:52.254556 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:52.254556 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:52.254556 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:52.254556 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:02:52.254556 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:02:52.254556 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:02:52.255669 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:02:52.255669 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:52.255669 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:52.255669 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:52.255669 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:52.255669 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:52.255669 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:52.255669 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:52.255669 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:52.255669 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:52.255669 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:52.255669 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:52.255669 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:52.255669 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:52.255669 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:52.255669 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:52.255669 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:52.256555 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:02:52.256555 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:02:52.256555 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:02:52.256555 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:02:52.259206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 220/463] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:02:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:52.260613 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eede213-5d17-4ef3-8a1b-4facd7f89f8c None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:52.261027 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eede213-5d17-4ef3-8a1b-4facd7f89f8c None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:52.261448 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eede213-5d17-4ef3-8a1b-4facd7f89f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:52.282088 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-3eede213-5d17-4ef3-8a1b-4facd7f89f8c None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:52.283296 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-3eede213-5d17-4ef3-8a1b-4facd7f89f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:52.331676 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:52.363522 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 221/464] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:02:52.363522 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eede213-5d17-4ef3-8a1b-4facd7f89f8c None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:52.375099 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe2b59-8143-4166-96f3-bf83674f1397 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:52.416739 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7459853-ae88-46de-89e6-632a8c2f56b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:52.417398 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7459853-ae88-46de-89e6-632a8c2f56b0 None admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:52.417676 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7459853-ae88-46de-89e6-632a8c2f56b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:52.417961 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7459853-ae88-46de-89e6-632a8c2f56b0 None admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:52.418638 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7459853-ae88-46de-89e6-632a8c2f56b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:52.420275 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7459853-ae88-46de-89e6-632a8c2f56b0 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:52.449956 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 244/465] 10.222.0.60 () {60 vars in 1132 bytes} [Sun Jul 31 01:02:52 2022] POST /identity/v3/users => generated 246 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:02:52.449956 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e77848-5546-440e-a6e8-dec208ad5014 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:52.449956 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e77848-5546-440e-a6e8-dec208ad5014 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:52.449956 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e77848-5546-440e-a6e8-dec208ad5014 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:52.449956 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 245/466] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:52.449956 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e77848-5546-440e-a6e8-dec208ad5014 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:52.492411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eede213-5d17-4ef3-8a1b-4facd7f89f8c None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:52.522667 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:52.532269 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4259e-1298-4ad5-aff8-0a8f8e1a9198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:52.532969 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4259e-1298-4ad5-aff8-0a8f8e1a9198 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:52.533250 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4259e-1298-4ad5-aff8-0a8f8e1a9198 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:52.533568 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4259e-1298-4ad5-aff8-0a8f8e1a9198 None admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:52.534285 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4259e-1298-4ad5-aff8-0a8f8e1a9198 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:52.534595 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4259e-1298-4ad5-aff8-0a8f8e1a9198 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:52.536104 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4259e-1298-4ad5-aff8-0a8f8e1a9198 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:52.558469 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 222/467] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:52.564618 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e46b8f-5400-4e94-b730-5346b7455bcd None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:52.564943 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e46b8f-5400-4e94-b730-5346b7455bcd None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:52.565189 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e46b8f-5400-4e94-b730-5346b7455bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:52.585142 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-85e46b8f-5400-4e94-b730-5346b7455bcd None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:52.586209 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-85e46b8f-5400-4e94-b730-5346b7455bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:52.597931 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e77848-5546-440e-a6e8-dec208ad5014 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:52.617139 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:52.645436 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ec3a3-2513-4415-9a93-64b30c9c8d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:52.646296 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ec3a3-2513-4415-9a93-64b30c9c8d9b None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:52.646475 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ec3a3-2513-4415-9a93-64b30c9c8d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:52.646708 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ec3a3-2513-4415-9a93-64b30c9c8d9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:52.657532 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ec3a3-2513-4415-9a93-64b30c9c8d9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:52.658987 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ec3a3-2513-4415-9a93-64b30c9c8d9b None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:52.670521 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 223/468] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:02:52.671152 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e46b8f-5400-4e94-b730-5346b7455bcd None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:52.674463 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-d33ec3a3-2513-4415-9a93-64b30c9c8d9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:02:52.674463 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:52.674463 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:52.674463 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:52.674463 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:52.674463 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:52.674463 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:52.674463 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:52.674463 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:52.674463 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:52.674463 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:52.674463 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:52.674463 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:02:52.674463 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:02:52.674463 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:02:52.675318 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:02:52.675318 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:52.675318 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:52.675318 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:52.675318 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:52.675318 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:52.675318 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:52.675318 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:52.675318 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:52.675318 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:52.675318 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:52.675318 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:52.675318 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:52.675318 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:52.675318 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:52.675318 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:52.675318 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:52.676191 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:02:52.676191 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:02:52.676191 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:02:52.676191 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:02:52.676191 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 246/469] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:02:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:52.683906 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ec3a3-2513-4415-9a93-64b30c9c8d9b None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:52.800478 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e46b8f-5400-4e94-b730-5346b7455bcd None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:52.814684 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:52.819252 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ec3a3-2513-4415-9a93-64b30c9c8d9b None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:52.838100 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b731a-73bb-479b-ac33-7e81a2710918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:52.838891 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b731a-73bb-479b-ac33-7e81a2710918 None admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:52.839302 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b731a-73bb-479b-ac33-7e81a2710918 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:52.839751 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b731a-73bb-479b-ac33-7e81a2710918 None admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:52.840551 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b731a-73bb-479b-ac33-7e81a2710918 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:52.842155 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b731a-73bb-479b-ac33-7e81a2710918 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:52.860093 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243aad2b-01a5-4f9e-b772-0f760ff81e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:52.861044 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243aad2b-01a5-4f9e-b772-0f760ff81e65 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:52.861494 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243aad2b-01a5-4f9e-b772-0f760ff81e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:52.862050 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243aad2b-01a5-4f9e-b772-0f760ff81e65 None admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:52.863149 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243aad2b-01a5-4f9e-b772-0f760ff81e65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:52.863694 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243aad2b-01a5-4f9e-b772-0f760ff81e65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:52.865245 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243aad2b-01a5-4f9e-b772-0f760ff81e65 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:52.869423 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 224/470] 10.222.0.60 () {60 vars in 1132 bytes} [Sun Jul 31 01:02:52 2022] POST /identity/v3/users => generated 248 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:02:52.870495 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b731a-73bb-479b-ac33-7e81a2710918 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:52.880110 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 247/471] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:52.885227 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243aad2b-01a5-4f9e-b772-0f760ff81e65 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:52.901505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:52.995944 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b731a-73bb-479b-ac33-7e81a2710918 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:53.004094 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243aad2b-01a5-4f9e-b772-0f760ff81e65 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:53.034753 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714abbd2-011a-420e-9930-7ea841b58f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:53.035768 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714abbd2-011a-420e-9930-7ea841b58f75 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:53.036062 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714abbd2-011a-420e-9930-7ea841b58f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:53.036341 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714abbd2-011a-420e-9930-7ea841b58f75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:53.043066 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530d919-5070-4728-b24b-80e9944db974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:53.044107 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530d919-5070-4728-b24b-80e9944db974 None admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:53.044629 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530d919-5070-4728-b24b-80e9944db974 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:53.045096 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530d919-5070-4728-b24b-80e9944db974 None admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:53.046234 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b530d919-5070-4728-b24b-80e9944db974 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:53.049282 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b530d919-5070-4728-b24b-80e9944db974 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:53.049440 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714abbd2-011a-420e-9930-7ea841b58f75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:53.050932 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714abbd2-011a-420e-9930-7ea841b58f75 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:53.069540 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-714abbd2-011a-420e-9930-7ea841b58f75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:02:53.069540 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:53.069540 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:53.069540 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:53.069540 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:53.069540 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:53.069540 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:53.069540 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:53.069540 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:53.069540 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:53.069540 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:53.069540 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:53.069540 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:02:53.069540 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:02:53.069540 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:02:53.070510 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:02:53.070510 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:53.070510 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:53.070510 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:53.070510 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:53.070510 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:53.070510 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:53.070510 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:53.070510 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:53.070510 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:53.070510 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:53.070510 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:53.070510 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:53.070510 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:53.070510 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:53.070510 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:53.070510 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:53.071346 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:02:53.071346 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:02:53.071346 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:02:53.071346 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:02:53.071346 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 225/472] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:02:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:53.077879 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714abbd2-011a-420e-9930-7ea841b58f75 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:53.079216 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 248/473] 10.222.0.60 () {60 vars in 1132 bytes} [Sun Jul 31 01:02:52 2022] POST /identity/v3/users => generated 248 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:02:53.175402 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:53.212399 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714abbd2-011a-420e-9930-7ea841b58f75 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:53.252220 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cdb8bb-f491-4d16-b053-b7d178f878db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:53.253609 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cdb8bb-f491-4d16-b053-b7d178f878db None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:53.254136 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cdb8bb-f491-4d16-b053-b7d178f878db None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:53.254619 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cdb8bb-f491-4d16-b053-b7d178f878db None admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:53.255582 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cdb8bb-f491-4d16-b053-b7d178f878db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:53.256088 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cdb8bb-f491-4d16-b053-b7d178f878db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:53.257708 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cdb8bb-f491-4d16-b053-b7d178f878db None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:53.272475 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 226/474] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:53.277771 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530d919-5070-4728-b24b-80e9944db974 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:53.295969 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:53.320533 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2b167-556f-4b0d-a517-a40e3fe8bb1e None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:53.320968 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2b167-556f-4b0d-a517-a40e3fe8bb1e None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:53.321339 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2b167-556f-4b0d-a517-a40e3fe8bb1e None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:53.323059 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 227/475] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:02:53.328955 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c693d9-0d6d-448a-ac6e-97b52f2644d4 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:53.329238 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c693d9-0d6d-448a-ac6e-97b52f2644d4 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:53.329504 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c693d9-0d6d-448a-ac6e-97b52f2644d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:53.351376 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-35c693d9-0d6d-448a-ac6e-97b52f2644d4 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:53.352800 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-35c693d9-0d6d-448a-ac6e-97b52f2644d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:53.408440 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530d919-5070-4728-b24b-80e9944db974 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:53.440814 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 228/476] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:02:53.445538 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ac8a3-8afa-4280-87f9-0fc99103b7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:53.446186 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ac8a3-8afa-4280-87f9-0fc99103b7da None admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:53.446467 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ac8a3-8afa-4280-87f9-0fc99103b7da None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:53.446739 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ac8a3-8afa-4280-87f9-0fc99103b7da None admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:53.447431 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ac8a3-8afa-4280-87f9-0fc99103b7da None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:53.448959 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ac8a3-8afa-4280-87f9-0fc99103b7da None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:53.467621 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c693d9-0d6d-448a-ac6e-97b52f2644d4 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:53.491876 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 249/477] 10.222.0.60 () {60 vars in 1132 bytes} [Sun Jul 31 01:02:53 2022] POST /identity/v3/users => generated 249 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:02:53.547882 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:53.617534 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c693d9-0d6d-448a-ac6e-97b52f2644d4 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:53.666792 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd321b9c-1fc9-434a-b70a-87331794bf4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:53.667440 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd321b9c-1fc9-434a-b70a-87331794bf4f None admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:53.667784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd321b9c-1fc9-434a-b70a-87331794bf4f None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:53.668063 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd321b9c-1fc9-434a-b70a-87331794bf4f None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:53.668800 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd321b9c-1fc9-434a-b70a-87331794bf4f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:53.670210 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd321b9c-1fc9-434a-b70a-87331794bf4f None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:53.679656 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.sql.core [None req-dd321b9c-1fc9-434a-b70a-87331794bf4f None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 31 01:02:53.679656 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 31 01:02:53.679656 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [parameters: {'id': '6ac32dcf06324ea5856fb3e76d805188', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 31 01:02:53.679656 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80703) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 31 01:02:53.696710 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-dd321b9c-1fc9-434a-b70a-87331794bf4f None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 31 01:02:53.696710 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:53.696710 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 31 01:02:53.696710 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 31 01:02:53.696710 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 31 01:02:53.696710 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 31 01:02:53.696710 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 31 01:02:53.696710 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application result = self._query(query) Jul 31 01:02:53.696710 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 31 01:02:53.696710 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application conn.query(q) Jul 31 01:02:53.696710 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 31 01:02:53.696710 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 31 01:02:53.696710 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 31 01:02:53.696710 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application result.read() Jul 31 01:02:53.696710 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 31 01:02:53.697609 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 31 01:02:53.697609 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 31 01:02:53.697609 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 31 01:02:53.697609 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 31 01:02:53.697609 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 31 01:02:53.697609 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 31 01:02:53.697609 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 31 01:02:53.697609 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 31 01:02:53.697609 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:02:53.697609 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 31 01:02:53.697609 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:02:53.697609 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:53.697609 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 31 01:02:53.697609 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 31 01:02:53.697609 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 31 01:02:53.697609 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return ref.to_dict() Jul 31 01:02:53.697609 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 31 01:02:53.697609 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application next(self.gen) Jul 31 01:02:53.698505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 31 01:02:53.698505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application yield resource Jul 31 01:02:53.698505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 31 01:02:53.698505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application next(self.gen) Jul 31 01:02:53.698505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 31 01:02:53.698505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application self.session.rollback() Jul 31 01:02:53.698505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:02:53.698505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application self.force_reraise() Jul 31 01:02:53.698505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:02:53.698505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise self.value Jul 31 01:02:53.698505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 31 01:02:53.698505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 31 01:02:53.698505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 31 01:02:53.698505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application session.commit() Jul 31 01:02:53.698505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 31 01:02:53.698505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 31 01:02:53.698505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 31 01:02:53.699369 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application self._prepare_impl() Jul 31 01:02:53.699369 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 31 01:02:53.699369 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application self.session.flush() Jul 31 01:02:53.699369 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 31 01:02:53.699369 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application self._flush(objects) Jul 31 01:02:53.699369 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 31 01:02:53.699369 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 31 01:02:53.699369 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 31 01:02:53.699369 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application compat.raise_( Jul 31 01:02:53.699369 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 31 01:02:53.699369 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception Jul 31 01:02:53.699369 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 31 01:02:53.699369 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application flush_context.execute() Jul 31 01:02:53.699369 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 31 01:02:53.699369 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rec.execute(self) Jul 31 01:02:53.699369 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 31 01:02:53.699369 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 31 01:02:53.700306 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 31 01:02:53.700306 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 31 01:02:53.700306 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 31 01:02:53.700306 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 31 01:02:53.700306 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 31 01:02:53.700306 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 31 01:02:53.700306 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 31 01:02:53.700306 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 31 01:02:53.700306 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 31 01:02:53.700306 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 31 01:02:53.700306 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 31 01:02:53.700306 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 31 01:02:53.700306 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 31 01:02:53.700306 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 31 01:02:53.700306 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 31 01:02:53.700306 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception Jul 31 01:02:53.701128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 31 01:02:53.701128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 31 01:02:53.701128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 31 01:02:53.701128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 31 01:02:53.701128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 31 01:02:53.701128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application result = self._query(query) Jul 31 01:02:53.701128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 31 01:02:53.701128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application conn.query(q) Jul 31 01:02:53.701128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 31 01:02:53.701128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 31 01:02:53.701128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 31 01:02:53.701128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application result.read() Jul 31 01:02:53.701128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 31 01:02:53.701128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 31 01:02:53.701128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 31 01:02:53.701128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 31 01:02:53.702118 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 31 01:02:53.702118 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 31 01:02:53.702118 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 31 01:02:53.702118 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 31 01:02:53.702118 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 31 01:02:53.702118 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 31 01:02:53.702118 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [parameters: {'id': '6ac32dcf06324ea5856fb3e76d805188', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 31 01:02:53.702118 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 31 01:02:53.702118 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:02:53.702118 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:02:53.702118 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:02:53.702118 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:53.702118 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:53.702118 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:53.702118 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:53.702118 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:53.706885 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:53.706885 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:53.706885 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:53.706885 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:53.706885 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:53.706885 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:53.706885 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 31 01:02:53.706885 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 31 01:02:53.706885 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:53.706885 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:53.706885 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 31 01:02:53.706885 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 31 01:02:53.706885 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 31 01:02:53.706885 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 31 01:02:53.706885 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 31 01:02:53.706885 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:02:53.709160 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 229/478] 10.222.0.60 () {60 vars in 1131 bytes} [Sun Jul 31 01:02:53 2022] POST /identity/v3/roles => generated 144 bytes in 231 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:02:53.709321 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ac8a3-8afa-4280-87f9-0fc99103b7da None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:53.800000 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:53.833165 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ac8a3-8afa-4280-87f9-0fc99103b7da None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:53.868072 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e5372-bfdc-47eb-a60f-7e0cf7ae7ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:53.869269 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e5372-bfdc-47eb-a60f-7e0cf7ae7ffb None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:53.869508 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e5372-bfdc-47eb-a60f-7e0cf7ae7ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:53.869785 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e5372-bfdc-47eb-a60f-7e0cf7ae7ffb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:53.881269 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290e5372-bfdc-47eb-a60f-7e0cf7ae7ffb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:53.886801 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-290e5372-bfdc-47eb-a60f-7e0cf7ae7ffb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:02:53.886801 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:53.886801 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:53.886801 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:53.886801 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:53.886801 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:53.886801 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:53.886801 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:53.886801 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:53.886801 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:53.886801 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:53.886801 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:53.886801 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:53.886801 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:53.886801 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:53.886801 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:53.888817 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:53.888817 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:53.888817 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:53.888817 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:53.888817 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:53.888817 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:53.888817 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:53.888817 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:53.888817 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:53.888817 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:53.888817 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:53.888817 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:53.888817 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:53.888817 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:53.888817 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:53.888817 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:53.890699 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:53.890699 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:53.890699 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:53.890699 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:53.890699 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:53.890699 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:53.890699 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:53.890699 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:53.890699 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:53.890699 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:53.890699 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:02:53.890699 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:02:53.890699 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 250/479] 10.222.0.60 () {56 vars in 1114 bytes} [Sun Jul 31 01:02:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:02:53.896595 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd321b9c-1fc9-434a-b70a-87331794bf4f None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:54.019264 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd321b9c-1fc9-434a-b70a-87331794bf4f None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:54.049032 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:54.062967 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168e712-0e69-484d-a2c8-1c535c68760b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:54.063676 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168e712-0e69-484d-a2c8-1c535c68760b None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:54.064020 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168e712-0e69-484d-a2c8-1c535c68760b None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:54.064290 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168e712-0e69-484d-a2c8-1c535c68760b None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:54.065157 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a168e712-0e69-484d-a2c8-1c535c68760b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:54.065846 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a168e712-0e69-484d-a2c8-1c535c68760b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:54.067646 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a168e712-0e69-484d-a2c8-1c535c68760b None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:54.078406 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 230/480] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:02:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:55.231099 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188d4bc-8b0a-45ee-9427-5d4e66ee37d8 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:55.231689 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188d4bc-8b0a-45ee-9427-5d4e66ee37d8 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:55.231689 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188d4bc-8b0a-45ee-9427-5d4e66ee37d8 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:55.233328 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 251/481] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:55.238277 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980598a3-b956-44ae-a145-8aae65cf21c7 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:55.238725 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980598a3-b956-44ae-a145-8aae65cf21c7 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:55.238809 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980598a3-b956-44ae-a145-8aae65cf21c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:55.264540 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-980598a3-b956-44ae-a145-8aae65cf21c7 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:55.265752 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-980598a3-b956-44ae-a145-8aae65cf21c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:55.356272 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 231/482] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:02:55.389136 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a188d4bc-8b0a-45ee-9427-5d4e66ee37d8 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:55.508101 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a188d4bc-8b0a-45ee-9427-5d4e66ee37d8 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:55.542708 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd2d15-e99a-4aa0-9001-f747a9892a1e None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:55.543030 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd2d15-e99a-4aa0-9001-f747a9892a1e None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:55.543263 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd2d15-e99a-4aa0-9001-f747a9892a1e None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:55.544965 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 232/483] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:55.550433 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59fa24-d21c-40a2-ac9b-c434fa72bbb2 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:55.550715 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59fa24-d21c-40a2-ac9b-c434fa72bbb2 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:55.550993 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59fa24-d21c-40a2-ac9b-c434fa72bbb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:55.553099 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:55.561534 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f3457-e4a2-46ee-9a9f-e6af1e07c682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:55.562200 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f3457-e4a2-46ee-9a9f-e6af1e07c682 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:55.562904 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f3457-e4a2-46ee-9a9f-e6af1e07c682 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:55.563179 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f3457-e4a2-46ee-9a9f-e6af1e07c682 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:55.572432 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-4d59fa24-d21c-40a2-ac9b-c434fa72bbb2 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:55.573973 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-4d59fa24-d21c-40a2-ac9b-c434fa72bbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:55.579695 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f3457-e4a2-46ee-9a9f-e6af1e07c682 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:55.587113 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-c58f3457-e4a2-46ee-9a9f-e6af1e07c682 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:02:55.587113 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:55.587113 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:55.587113 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:55.587113 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:55.587113 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:55.587113 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:55.587113 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:55.587113 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:55.587113 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:55.587113 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:55.587113 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:55.587113 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:55.587113 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:55.587113 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:55.587113 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:55.588031 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:55.588031 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:55.588031 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:55.588031 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:55.588031 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:55.588031 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:55.588031 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:55.588031 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:55.588031 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:55.588031 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:55.588031 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:55.588031 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:55.588031 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:55.588031 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:55.588031 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:55.588031 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:55.588830 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:55.588830 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:55.588830 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:55.588830 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:55.588830 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:55.588830 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:55.588830 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:55.588830 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:55.588830 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:55.588830 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:55.588830 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:02:55.588830 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:02:55.591597 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 252/484] 10.222.0.60 () {56 vars in 1102 bytes} [Sun Jul 31 01:02:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:55.597063 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f3457-e4a2-46ee-9a9f-e6af1e07c682 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:55.655542 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 233/485] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:02:55.659883 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082284c-f9e1-40a8-a4bc-c904ded7f107 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:55.660400 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082284c-f9e1-40a8-a4bc-c904ded7f107 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:55.660924 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082284c-f9e1-40a8-a4bc-c904ded7f107 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:55.662426 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 234/486] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:55.679613 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a205818-1ae5-41a2-a902-a21d17c167c6 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:55.679613 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a205818-1ae5-41a2-a902-a21d17c167c6 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:55.679613 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a205818-1ae5-41a2-a902-a21d17c167c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:55.692195 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-9a205818-1ae5-41a2-a902-a21d17c167c6 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:55.693381 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-9a205818-1ae5-41a2-a902-a21d17c167c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:55.728792 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f3457-e4a2-46ee-9a9f-e6af1e07c682 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:55.751510 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:55.765633 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030ecf8-5fcc-4b5a-88a0-3a5834f5b860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:55.766235 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030ecf8-5fcc-4b5a-88a0-3a5834f5b860 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:55.766510 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030ecf8-5fcc-4b5a-88a0-3a5834f5b860 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:55.766775 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030ecf8-5fcc-4b5a-88a0-3a5834f5b860 None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:55.767772 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a030ecf8-5fcc-4b5a-88a0-3a5834f5b860 None admin] RBAC: Adding query filter params (name=service) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:55.767879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a030ecf8-5fcc-4b5a-88a0-3a5834f5b860 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:55.769288 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a030ecf8-5fcc-4b5a-88a0-3a5834f5b860 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:55.777944 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 253/487] 10.222.0.60 () {56 vars in 1103 bytes} [Sun Jul 31 01:02:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:02:55.779069 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030ecf8-5fcc-4b5a-88a0-3a5834f5b860 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:55.785451 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 235/488] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:02:55.786553 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a205818-1ae5-41a2-a902-a21d17c167c6 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:55.867714 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:55.901103 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a205818-1ae5-41a2-a902-a21d17c167c6 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:55.921188 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030ecf8-5fcc-4b5a-88a0-3a5834f5b860 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:55.940334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb539a5-b0b2-4287-94c5-e7754848e829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:55.941749 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb539a5-b0b2-4287-94c5-e7754848e829 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:55.942235 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb539a5-b0b2-4287-94c5-e7754848e829 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:55.943008 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb539a5-b0b2-4287-94c5-e7754848e829 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:55.955583 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986a5fd-f825-44f0-8c61-439026b4b793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:55.956269 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986a5fd-f825-44f0-8c61-439026b4b793 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:55.956524 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986a5fd-f825-44f0-8c61-439026b4b793 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:55.956788 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986a5fd-f825-44f0-8c61-439026b4b793 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:55.957738 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb539a5-b0b2-4287-94c5-e7754848e829 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:55.959784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb539a5-b0b2-4287-94c5-e7754848e829 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:55.969988 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986a5fd-f825-44f0-8c61-439026b4b793 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:55.976391 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-9986a5fd-f825-44f0-8c61-439026b4b793 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:02:55.976391 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:55.976391 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:55.976391 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:55.976391 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:55.976391 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:55.976391 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:55.976391 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:55.976391 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:55.976391 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:55.976391 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:55.976391 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:55.976391 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:55.976391 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:55.976391 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:55.976391 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:55.977282 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:55.977282 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:55.977282 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:55.977282 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:55.977282 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:55.977282 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:55.977282 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:55.977282 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:55.977282 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:55.977282 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:55.977282 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:55.977282 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:55.977282 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:55.977282 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:55.977282 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:55.977282 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:55.978069 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:55.978069 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:55.978069 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:55.978069 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:55.978069 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:55.978069 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:55.978069 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:55.978069 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:55.978069 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:55.978069 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:55.978069 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:02:55.978069 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:02:55.978069 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 254/489] 10.222.0.60 () {56 vars in 1102 bytes} [Sun Jul 31 01:02:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:55.978801 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986a5fd-f825-44f0-8c61-439026b4b793 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:55.982000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-2cb539a5-b0b2-4287-94c5-e7754848e829 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:02:55.982000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:55.982000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:55.982000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:55.982000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:55.982000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:55.982000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:55.982000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:55.982000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:55.982000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:55.982000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:55.982000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:55.982000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:02:55.982000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:02:55.982000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:02:55.982811 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:02:55.982811 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:55.982811 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:55.982811 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:55.982811 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:55.982811 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:55.982811 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:55.982811 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:55.982811 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:55.982811 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:55.982811 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:55.982811 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:55.982811 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:55.982811 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:55.982811 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:55.982811 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:55.982811 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:55.984949 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:02:55.984949 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:02:55.984949 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:02:55.984949 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:02:55.985156 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 236/490] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:02:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:55.985824 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb539a5-b0b2-4287-94c5-e7754848e829 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:56.029061 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:56.089836 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986a5fd-f825-44f0-8c61-439026b4b793 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:56.100179 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb539a5-b0b2-4287-94c5-e7754848e829 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:56.103288 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:56.125002 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3e15f-80db-4077-adaa-9396de6bd1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:56.125734 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3e15f-80db-4077-adaa-9396de6bd1e2 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:56.125923 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3e15f-80db-4077-adaa-9396de6bd1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:56.126202 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3e15f-80db-4077-adaa-9396de6bd1e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:56.136736 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd3e15f-80db-4077-adaa-9396de6bd1e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:56.137031 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453de01-0f8e-4e17-abf8-fa93ec947d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:56.137660 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453de01-0f8e-4e17-abf8-fa93ec947d0e None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:56.137941 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453de01-0f8e-4e17-abf8-fa93ec947d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:56.138217 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453de01-0f8e-4e17-abf8-fa93ec947d0e None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:56.138945 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c453de01-0f8e-4e17-abf8-fa93ec947d0e None admin] RBAC: Adding query filter params (name=service) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:56.139284 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c453de01-0f8e-4e17-abf8-fa93ec947d0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:56.140725 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c453de01-0f8e-4e17-abf8-fa93ec947d0e None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:56.142183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-edd3e15f-80db-4077-adaa-9396de6bd1e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:02:56.142183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:56.142183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:56.142183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:56.142183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:56.142183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:56.142183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:56.142183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:56.142183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:56.142183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:56.142183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:56.142183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:56.142183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:56.142183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:56.142183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:56.142183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:56.143024 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:56.143024 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:56.143024 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:56.143024 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:56.143024 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:56.143024 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:56.143024 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:56.143024 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:56.143024 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:56.143024 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:56.143024 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:56.143024 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:56.143024 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:56.143024 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:56.143024 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:56.143024 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:56.143838 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:56.143838 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:56.143838 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:56.143838 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:56.143838 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:56.143838 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:56.143838 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:56.143838 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:56.143838 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:56.143838 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:56.143838 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:02:56.143838 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:02:56.143838 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 255/491] 10.222.0.60 () {56 vars in 1102 bytes} [Sun Jul 31 01:02:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:56.145220 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3e15f-80db-4077-adaa-9396de6bd1e2 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:56.155799 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 237/492] 10.222.0.60 () {56 vars in 1103 bytes} [Sun Jul 31 01:02:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:56.161443 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94735b96-411c-44b3-a762-ac23b31803eb None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:56.161739 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94735b96-411c-44b3-a762-ac23b31803eb None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:56.162019 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94735b96-411c-44b3-a762-ac23b31803eb None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:56.163259 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 238/493] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:56.167966 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94735b96-411c-44b3-a762-ac23b31803eb None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:56.245515 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3e15f-80db-4077-adaa-9396de6bd1e2 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:56.261364 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:56.272510 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94735b96-411c-44b3-a762-ac23b31803eb None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:56.286107 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91f359-97d0-42a3-bc18-27443054f7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:56.287048 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91f359-97d0-42a3-bc18-27443054f7d1 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:56.287478 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91f359-97d0-42a3-bc18-27443054f7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:56.287939 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91f359-97d0-42a3-bc18-27443054f7d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:56.288774 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f91f359-97d0-42a3-bc18-27443054f7d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:56.289343 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f91f359-97d0-42a3-bc18-27443054f7d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:56.290854 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f91f359-97d0-42a3-bc18-27443054f7d1 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:56.308495 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 256/494] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:02:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:56.308495 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91f359-97d0-42a3-bc18-27443054f7d1 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:56.313151 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd5757-fea4-4a76-966f-36c29f5ce199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:56.313791 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd5757-fea4-4a76-966f-36c29f5ce199 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:56.314164 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd5757-fea4-4a76-966f-36c29f5ce199 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:56.314473 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd5757-fea4-4a76-966f-36c29f5ce199 None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:56.315203 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd5757-fea4-4a76-966f-36c29f5ce199 None admin] RBAC: Adding query filter params (name=service) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:56.315509 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd5757-fea4-4a76-966f-36c29f5ce199 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:56.316979 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd5757-fea4-4a76-966f-36c29f5ce199 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:56.325605 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 239/495] 10.222.0.60 () {56 vars in 1103 bytes} [Sun Jul 31 01:02:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:56.331456 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b187fa-c7b1-4e35-b0d1-b1764e081ca5 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:56.331789 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b187fa-c7b1-4e35-b0d1-b1764e081ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:56.332070 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b187fa-c7b1-4e35-b0d1-b1764e081ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:56.339802 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:56.351821 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-90b187fa-c7b1-4e35-b0d1-b1764e081ca5 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:56.353017 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-90b187fa-c7b1-4e35-b0d1-b1764e081ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:56.428373 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91f359-97d0-42a3-bc18-27443054f7d1 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:56.434303 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 240/496] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:02:56.435390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b187fa-c7b1-4e35-b0d1-b1764e081ca5 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:56.487717 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9cef7a-9f76-4d40-a49f-15ff20a9aaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:56.488365 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cef7a-9f76-4d40-a49f-15ff20a9aaa7 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:56.488652 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cef7a-9f76-4d40-a49f-15ff20a9aaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:56.488907 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cef7a-9f76-4d40-a49f-15ff20a9aaa7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:56.499244 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9cef7a-9f76-4d40-a49f-15ff20a9aaa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:56.500751 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9cef7a-9f76-4d40-a49f-15ff20a9aaa7 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:56.516248 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-8b9cef7a-9f76-4d40-a49f-15ff20a9aaa7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:02:56.516248 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:56.516248 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:56.516248 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:56.516248 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:56.516248 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:56.516248 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:56.516248 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:56.516248 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:56.516248 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:56.516248 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:56.516248 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:56.516248 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:02:56.516248 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:02:56.516248 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:02:56.517151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:02:56.517151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:56.517151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:56.517151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:56.517151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:56.517151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:56.517151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:56.517151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:56.517151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:56.517151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:56.517151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:56.517151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:56.517151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:56.517151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:56.517151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:56.517151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:56.517151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:56.517997 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:02:56.517997 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:02:56.517997 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:02:56.517997 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:02:56.517997 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 257/497] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:02:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:56.518258 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9cef7a-9f76-4d40-a49f-15ff20a9aaa7 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:56.527651 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:56.545394 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b187fa-c7b1-4e35-b0d1-b1764e081ca5 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:56.580178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6d2a1-494e-40b8-b0ec-3ce47e58ca39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:56.580876 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6d2a1-494e-40b8-b0ec-3ce47e58ca39 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:56.581160 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6d2a1-494e-40b8-b0ec-3ce47e58ca39 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:56.581482 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6d2a1-494e-40b8-b0ec-3ce47e58ca39 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:56.589119 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e6d2a1-494e-40b8-b0ec-3ce47e58ca39 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:56.590582 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e6d2a1-494e-40b8-b0ec-3ce47e58ca39 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:56.605404 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-70e6d2a1-494e-40b8-b0ec-3ce47e58ca39 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:02:56.605404 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:56.605404 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:56.605404 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:56.605404 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:56.605404 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:56.605404 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:56.605404 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:56.605404 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:56.605404 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:56.605404 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:56.605404 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:56.605404 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:02:56.605404 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:02:56.605404 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:02:56.605404 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:02:56.606345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:56.606345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:56.606345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:02:56.606345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:02:56.606345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:02:56.606345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:02:56.606345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:56.606345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:56.606345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:56.606345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:56.606345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:56.606345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:56.606345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:56.606345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:56.606345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:56.606345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:56.606345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:56.606345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:56.607235 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:56.607235 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:56.607235 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:02:56.607235 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:02:56.607235 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:02:56.607235 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:02:56.607235 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:02:56.607235 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:02:56.607235 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:02:56.607235 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:02:56.607235 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 241/498] 10.222.0.60 () {56 vars in 1093 bytes} [Sun Jul 31 01:02:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:56.608942 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6d2a1-494e-40b8-b0ec-3ce47e58ca39 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:56.614205 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:56.636768 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9cef7a-9f76-4d40-a49f-15ff20a9aaa7 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:56.673174 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b2b9d2-1390-42bc-8685-daa284f1ca1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:56.673836 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2b9d2-1390-42bc-8685-daa284f1ca1a None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:56.674087 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2b9d2-1390-42bc-8685-daa284f1ca1a None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:56.674401 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2b9d2-1390-42bc-8685-daa284f1ca1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:56.687000 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b2b9d2-1390-42bc-8685-daa284f1ca1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:56.688496 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b2b9d2-1390-42bc-8685-daa284f1ca1a None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:56.702435 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-c5b2b9d2-1390-42bc-8685-daa284f1ca1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:02:56.702435 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:56.702435 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:56.702435 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:56.702435 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:56.702435 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:56.702435 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:56.702435 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:56.702435 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:56.702435 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:56.702435 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:56.702435 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:56.702435 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:02:56.702435 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:02:56.702435 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:02:56.703290 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:02:56.703290 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:56.703290 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:56.703290 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:56.703290 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:56.703290 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:56.703290 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:56.703290 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:56.703290 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:56.703290 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:56.703290 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:56.703290 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:56.703290 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:56.703290 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:56.703290 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:56.703290 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:56.703290 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:56.704171 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:02:56.704171 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:02:56.704171 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:02:56.704171 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:02:56.704171 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 258/499] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:02:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:56.708761 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b2b9d2-1390-42bc-8685-daa284f1ca1a None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:56.715959 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6d2a1-494e-40b8-b0ec-3ce47e58ca39 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:56.753043 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c496da7-2daa-4f7f-b3ac-47816425f346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:56.753560 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c496da7-2daa-4f7f-b3ac-47816425f346 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:56.753834 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c496da7-2daa-4f7f-b3ac-47816425f346 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:56.754102 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c496da7-2daa-4f7f-b3ac-47816425f346 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:56.764946 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c496da7-2daa-4f7f-b3ac-47816425f346 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:02:56.770291 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-2c496da7-2daa-4f7f-b3ac-47816425f346 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:02:56.770291 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:56.770291 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:56.770291 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:56.770291 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:56.770291 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:56.770291 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:56.770291 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:56.770291 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:56.770291 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:56.770291 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:56.770291 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:56.770291 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:02:56.770291 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:02:56.770291 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:02:56.770291 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:02:56.771181 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:02:56.771181 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:02:56.771181 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:02:56.771181 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:02:56.771181 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:56.771181 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:56.771181 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:56.771181 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:56.771181 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:56.771181 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:56.771181 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:56.771181 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:56.771181 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:56.771181 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:56.771181 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:56.771181 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:56.772040 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:56.772040 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:56.772040 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:56.772040 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:56.772040 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:02:56.772040 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:02:56.772040 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:02:56.772040 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:02:56.772040 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:02:56.772040 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:02:56.772040 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:02:56.772040 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:02:56.772040 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 242/500] 10.222.0.60 () {56 vars in 1102 bytes} [Sun Jul 31 01:02:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:56.772690 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c496da7-2daa-4f7f-b3ac-47816425f346 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:56.776979 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:56.828239 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b2b9d2-1390-42bc-8685-daa284f1ca1a None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:56.862055 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c5e0b-7a64-41c0-a7bb-803b3d540d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:56.862621 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c5e0b-7a64-41c0-a7bb-803b3d540d38 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:56.862895 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c5e0b-7a64-41c0-a7bb-803b3d540d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:56.863159 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c5e0b-7a64-41c0-a7bb-803b3d540d38 None admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:56.863875 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c5e0b-7a64-41c0-a7bb-803b3d540d38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:56.864182 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c5e0b-7a64-41c0-a7bb-803b3d540d38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:56.865528 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c5e0b-7a64-41c0-a7bb-803b3d540d38 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:56.867873 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:56.878749 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 259/501] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:02:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:56.879564 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c5e0b-7a64-41c0-a7bb-803b3d540d38 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:56.892858 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c496da7-2daa-4f7f-b3ac-47816425f346 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:56.925392 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce567f-1df8-4d79-b77a-71522ced8c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:56.926022 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce567f-1df8-4d79-b77a-71522ced8c09 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:56.926304 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce567f-1df8-4d79-b77a-71522ced8c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:56.926585 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce567f-1df8-4d79-b77a-71522ced8c09 None admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:56.927394 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce567f-1df8-4d79-b77a-71522ced8c09 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:56.927805 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce567f-1df8-4d79-b77a-71522ced8c09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:56.929264 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce567f-1df8-4d79-b77a-71522ced8c09 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:56.967054 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 243/502] 10.222.0.60 () {56 vars in 1133 bytes} [Sun Jul 31 01:02:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:56.968008 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce567f-1df8-4d79-b77a-71522ced8c09 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:56.977872 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c5e0b-7a64-41c0-a7bb-803b3d540d38 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:57.010653 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9da29-13d2-4a20-bab5-1840618eb688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:57.011273 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9da29-13d2-4a20-bab5-1840618eb688 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:57.011589 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9da29-13d2-4a20-bab5-1840618eb688 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:57.011851 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9da29-13d2-4a20-bab5-1840618eb688 None admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:57.012537 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9da29-13d2-4a20-bab5-1840618eb688 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:57.012832 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9da29-13d2-4a20-bab5-1840618eb688 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:57.014234 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9da29-13d2-4a20-bab5-1840618eb688 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:57.026748 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 260/503] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:02:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:57.027953 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9522b-a2ae-4d1b-96b6-d61d783c2015 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:57.028235 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9522b-a2ae-4d1b-96b6-d61d783c2015 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:57.028576 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9522b-a2ae-4d1b-96b6-d61d783c2015 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:57.031635 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 261/504] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:02:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:02:57.031635 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e9522b-a2ae-4d1b-96b6-d61d783c2015 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:57.031874 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:57.071006 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce567f-1df8-4d79-b77a-71522ced8c09 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:57.090940 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:57.109745 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa487096-9008-4b4c-a422-54d0dc4c4549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:57.110381 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa487096-9008-4b4c-a422-54d0dc4c4549 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:57.110667 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa487096-9008-4b4c-a422-54d0dc4c4549 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:57.110945 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa487096-9008-4b4c-a422-54d0dc4c4549 None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:57.111707 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa487096-9008-4b4c-a422-54d0dc4c4549 None admin] RBAC: Adding query filter params (name=service) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:57.112012 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa487096-9008-4b4c-a422-54d0dc4c4549 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:57.113411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa487096-9008-4b4c-a422-54d0dc4c4549 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:57.121910 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 244/505] 10.222.0.60 () {56 vars in 1103 bytes} [Sun Jul 31 01:02:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:57.122731 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa487096-9008-4b4c-a422-54d0dc4c4549 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:57.147886 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e9522b-a2ae-4d1b-96b6-d61d783c2015 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:57.180749 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11305ee-e4ea-496f-8a3b-2e261853a2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:57.181377 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11305ee-e4ea-496f-8a3b-2e261853a2b9 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:57.181659 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11305ee-e4ea-496f-8a3b-2e261853a2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:57.181934 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11305ee-e4ea-496f-8a3b-2e261853a2b9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:57.189454 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11305ee-e4ea-496f-8a3b-2e261853a2b9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:57.190928 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11305ee-e4ea-496f-8a3b-2e261853a2b9 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:57.203813 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-f11305ee-e4ea-496f-8a3b-2e261853a2b9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 31 01:02:57.203813 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:57.203813 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:57.203813 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:57.203813 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:57.203813 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:57.203813 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:57.203813 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:57.203813 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:57.203813 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:57.203813 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:57.203813 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:57.203813 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:02:57.203813 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:02:57.203813 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:02:57.203813 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:02:57.204879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:57.204879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:57.204879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:02:57.204879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:02:57.204879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:02:57.204879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:02:57.204879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:57.204879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:57.204879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:57.204879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:57.204879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:57.204879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:57.204879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:57.204879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:57.204879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:57.204879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:57.204879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:57.204879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:57.205820 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:57.205820 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:57.205820 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:02:57.205820 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:02:57.205820 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:02:57.205820 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:02:57.205820 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:02:57.205820 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:02:57.205820 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 31 01:02:57.205820 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:02:57.205820 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 262/506] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:02:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:57.206370 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11305ee-e4ea-496f-8a3b-2e261853a2b9 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:57.234749 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa487096-9008-4b4c-a422-54d0dc4c4549 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:57.257634 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:57.268633 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df049fe1-c46f-443b-bdea-73278a9bb900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:57.269253 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df049fe1-c46f-443b-bdea-73278a9bb900 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:57.269529 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df049fe1-c46f-443b-bdea-73278a9bb900 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:57.269798 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df049fe1-c46f-443b-bdea-73278a9bb900 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:57.305105 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11305ee-e4ea-496f-8a3b-2e261853a2b9 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:57.320514 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:57.335109 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df049fe1-c46f-443b-bdea-73278a9bb900 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:57.336644 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df049fe1-c46f-443b-bdea-73278a9bb900 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:57.338001 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49f59b-a5f9-4ee0-9930-d781ddfa1a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:57.338642 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49f59b-a5f9-4ee0-9930-d781ddfa1a32 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:57.338916 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49f59b-a5f9-4ee0-9930-d781ddfa1a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:57.339192 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49f59b-a5f9-4ee0-9930-d781ddfa1a32 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:57.346720 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f49f59b-a5f9-4ee0-9930-d781ddfa1a32 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:57.348150 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f49f59b-a5f9-4ee0-9930-d781ddfa1a32 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:57.361347 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-8f49f59b-a5f9-4ee0-9930-d781ddfa1a32 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 31 01:02:57.361347 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:57.361347 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:57.361347 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:57.361347 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:57.361347 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:57.361347 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:57.361347 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:57.361347 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:57.361347 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:57.361347 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:57.361347 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:57.361347 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:02:57.361347 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:02:57.361347 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:02:57.361347 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:02:57.362325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:57.362325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:57.362325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:02:57.362325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:02:57.362325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:02:57.362325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:02:57.362325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:57.362325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:57.362325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:57.362325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:57.362325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:57.362325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:57.362325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:57.362325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:57.362325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:57.362325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:57.362325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:57.362325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:57.363232 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:57.363232 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:57.363232 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:02:57.363232 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:02:57.363232 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:02:57.363232 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:02:57.363232 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:02:57.363232 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:02:57.363232 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 31 01:02:57.363232 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:02:57.363232 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 263/507] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:02:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:57.364283 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca640cce-c8cc-40d3-b770-06a6e09fdca7 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:57.364283 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca640cce-c8cc-40d3-b770-06a6e09fdca7 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:57.364405 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca640cce-c8cc-40d3-b770-06a6e09fdca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:57.385078 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-ca640cce-c8cc-40d3-b770-06a6e09fdca7 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:02:57.386444 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-ca640cce-c8cc-40d3-b770-06a6e09fdca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:02:57.440883 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 245/508] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:02:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:02:57.442103 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df049fe1-c46f-443b-bdea-73278a9bb900 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:57.453385 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 264/509] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:02:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:02:57.454510 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca640cce-c8cc-40d3-b770-06a6e09fdca7 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:57.478148 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:57.542736 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df049fe1-c46f-443b-bdea-73278a9bb900 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:57.552435 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca640cce-c8cc-40d3-b770-06a6e09fdca7 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:57.559562 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:57.578326 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a3434-81a4-4c63-b414-480203b26732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:57.579183 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a3434-81a4-4c63-b414-480203b26732 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:57.579445 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a3434-81a4-4c63-b414-480203b26732 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:57.579745 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a3434-81a4-4c63-b414-480203b26732 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:57.586762 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b0957-552c-440d-97e0-7482a7d59bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:57.587385 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b0957-552c-440d-97e0-7482a7d59bed None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:57.587708 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b0957-552c-440d-97e0-7482a7d59bed None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:57.587966 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b0957-552c-440d-97e0-7482a7d59bed None admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:57.588762 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b0957-552c-440d-97e0-7482a7d59bed None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:57.589067 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b0957-552c-440d-97e0-7482a7d59bed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:57.589838 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a3434-81a4-4c63-b414-480203b26732 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:57.590512 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b0957-552c-440d-97e0-7482a7d59bed None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:57.591274 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a3434-81a4-4c63-b414-480203b26732 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:57.606103 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-817a3434-81a4-4c63-b414-480203b26732 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:02:57.606103 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:57.606103 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:57.606103 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:57.606103 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:57.606103 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:57.606103 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:57.606103 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:57.606103 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:57.606103 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:57.606103 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:57.606103 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:57.606103 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:02:57.606103 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:02:57.606103 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:02:57.606964 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:02:57.606964 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:57.606964 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:57.606964 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:57.606964 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:57.606964 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:57.606964 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:57.606964 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:57.606964 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:57.606964 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:57.606964 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:57.606964 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:57.606964 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:57.606964 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:57.606964 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:57.606964 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:57.606964 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:57.607835 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:02:57.607835 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:02:57.607835 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:02:57.607835 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:02:57.607835 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 246/510] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:02:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:57.608099 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a3434-81a4-4c63-b414-480203b26732 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:57.632597 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 265/511] 10.222.0.60 () {56 vars in 1137 bytes} [Sun Jul 31 01:02:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:57.633438 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b0957-552c-440d-97e0-7482a7d59bed None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:57.689121 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:57.713133 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a3434-81a4-4c63-b414-480203b26732 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:57.732668 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b0957-552c-440d-97e0-7482a7d59bed None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:57.747040 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e825b-4f0f-4459-8d4d-0c83e9ce69b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:57.747703 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e825b-4f0f-4459-8d4d-0c83e9ce69b2 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:57.747985 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e825b-4f0f-4459-8d4d-0c83e9ce69b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:57.748258 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e825b-4f0f-4459-8d4d-0c83e9ce69b2 None admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:57.749160 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10e825b-4f0f-4459-8d4d-0c83e9ce69b2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:57.749472 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10e825b-4f0f-4459-8d4d-0c83e9ce69b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:57.750920 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10e825b-4f0f-4459-8d4d-0c83e9ce69b2 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:57.767764 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc0cec-d814-4916-83c6-c65762c747f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:57.768418 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc0cec-d814-4916-83c6-c65762c747f7 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:57.768541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 247/512] 10.222.0.60 () {56 vars in 1137 bytes} [Sun Jul 31 01:02:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:57.768719 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc0cec-d814-4916-83c6-c65762c747f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:57.768952 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc0cec-d814-4916-83c6-c65762c747f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:57.769263 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e825b-4f0f-4459-8d4d-0c83e9ce69b2 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:57.781606 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc0cec-d814-4916-83c6-c65762c747f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:57.783133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc0cec-d814-4916-83c6-c65762c747f7 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:57.797512 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-87fc0cec-d814-4916-83c6-c65762c747f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:02:57.797512 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:57.797512 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:57.797512 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:57.797512 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:57.797512 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:57.797512 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:57.797512 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:57.797512 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:57.797512 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:57.797512 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:57.797512 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:57.797512 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:02:57.797512 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:02:57.797512 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:02:57.798351 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:02:57.798351 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:57.798351 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:57.798351 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:57.798351 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:57.798351 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:57.798351 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:57.798351 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:57.798351 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:57.798351 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:57.798351 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:57.798351 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:57.798351 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:57.798351 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:57.798351 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:57.798351 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:57.798351 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:57.799175 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:02:57.799175 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:02:57.799175 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:02:57.799175 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:02:57.799175 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 266/513] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:02:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:57.799428 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc0cec-d814-4916-83c6-c65762c747f7 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:57.818027 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:57.871554 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e825b-4f0f-4459-8d4d-0c83e9ce69b2 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:57.898357 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc0cec-d814-4916-83c6-c65762c747f7 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:57.906121 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144f0aa-24cc-49b5-a15a-c983756d82dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:57.906760 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144f0aa-24cc-49b5-a15a-c983756d82dc None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:57.907036 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144f0aa-24cc-49b5-a15a-c983756d82dc None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:57.907304 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144f0aa-24cc-49b5-a15a-c983756d82dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:57.909190 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:57.917968 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1144f0aa-24cc-49b5-a15a-c983756d82dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:57.919432 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1144f0aa-24cc-49b5-a15a-c983756d82dc None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:57.931618 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d8d826-43c4-4601-a7f2-03d9db8052e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:57.932235 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8d826-43c4-4601-a7f2-03d9db8052e0 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:57.932513 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8d826-43c4-4601-a7f2-03d9db8052e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:57.932785 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8d826-43c4-4601-a7f2-03d9db8052e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:57.933478 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d8d826-43c4-4601-a7f2-03d9db8052e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:57.933779 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d8d826-43c4-4601-a7f2-03d9db8052e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:57.933988 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-1144f0aa-24cc-49b5-a15a-c983756d82dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:02:57.933988 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:57.933988 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:57.933988 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:57.933988 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:57.933988 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:57.933988 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:57.933988 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:57.933988 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:57.933988 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:57.933988 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:57.933988 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:57.933988 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:02:57.933988 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:02:57.933988 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:02:57.934868 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:02:57.934868 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:57.934868 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:57.934868 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:57.934868 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:57.934868 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:57.934868 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:57.934868 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:57.934868 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:57.934868 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:57.934868 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:57.934868 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:57.934868 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:57.934868 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:57.934868 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:57.934868 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:57.934868 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:57.936019 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:02:57.936019 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:02:57.936019 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:02:57.936019 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:02:57.936349 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d8d826-43c4-4601-a7f2-03d9db8052e0 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:57.936418 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 248/514] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:02:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:57.936418 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144f0aa-24cc-49b5-a15a-c983756d82dc None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:57.955939 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 267/515] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:57.955939 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d8d826-43c4-4601-a7f2-03d9db8052e0 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:58.028987 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:58.042503 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144f0aa-24cc-49b5-a15a-c983756d82dc None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:58.051722 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d8d826-43c4-4601-a7f2-03d9db8052e0 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:58.075177 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f906b-b3cc-4418-80e5-632a8816be1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:58.075839 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f906b-b3cc-4418-80e5-632a8816be1c None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:58.076111 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f906b-b3cc-4418-80e5-632a8816be1c None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:58.076389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f906b-b3cc-4418-80e5-632a8816be1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:58.084882 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d69583-b085-46c5-b510-9b24f85bddc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:58.085508 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d69583-b085-46c5-b510-9b24f85bddc8 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:58.085788 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d69583-b085-46c5-b510-9b24f85bddc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:58.086060 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d69583-b085-46c5-b510-9b24f85bddc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:58.130254 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:58.144962 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30f906b-b3cc-4418-80e5-632a8816be1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:58.146566 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30f906b-b3cc-4418-80e5-632a8816be1c None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:58.152249 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d69583-b085-46c5-b510-9b24f85bddc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:58.153697 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d69583-b085-46c5-b510-9b24f85bddc8 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:58.226975 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:58.241623 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 249/516] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:02:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:02:58.246565 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f906b-b3cc-4418-80e5-632a8816be1c None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:58.250226 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 268/517] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:02:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:02:58.251049 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d69583-b085-46c5-b510-9b24f85bddc8 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:58.326154 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:58.341650 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f906b-b3cc-4418-80e5-632a8816be1c None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:58.352048 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d69583-b085-46c5-b510-9b24f85bddc8 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:58.376424 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710aec15-f1f3-4844-bc7c-92ae258ecb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:58.377079 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710aec15-f1f3-4844-bc7c-92ae258ecb48 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:58.377689 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710aec15-f1f3-4844-bc7c-92ae258ecb48 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:58.377984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710aec15-f1f3-4844-bc7c-92ae258ecb48 None admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:58.378677 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710aec15-f1f3-4844-bc7c-92ae258ecb48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:58.378978 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710aec15-f1f3-4844-bc7c-92ae258ecb48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:58.380565 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710aec15-f1f3-4844-bc7c-92ae258ecb48 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:58.388028 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a94dd35-697c-4be2-bbc0-b0c59c1b75c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:58.388651 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94dd35-697c-4be2-bbc0-b0c59c1b75c4 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:58.388928 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94dd35-697c-4be2-bbc0-b0c59c1b75c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:58.389202 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94dd35-697c-4be2-bbc0-b0c59c1b75c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:58.389897 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a94dd35-697c-4be2-bbc0-b0c59c1b75c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:58.390201 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a94dd35-697c-4be2-bbc0-b0c59c1b75c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:58.391322 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 250/518] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:02:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:58.391620 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a94dd35-697c-4be2-bbc0-b0c59c1b75c4 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:58.392136 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710aec15-f1f3-4844-bc7c-92ae258ecb48 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:58.406886 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 269/519] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:02:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:58.407743 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a94dd35-697c-4be2-bbc0-b0c59c1b75c4 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:58.443529 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:58.494270 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710aec15-f1f3-4844-bc7c-92ae258ecb48 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:58.506642 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a94dd35-697c-4be2-bbc0-b0c59c1b75c4 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:58.529282 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704601d8-7f3c-46ef-9005-c4eb8bb79a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:58.530029 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704601d8-7f3c-46ef-9005-c4eb8bb79a53 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:58.530309 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704601d8-7f3c-46ef-9005-c4eb8bb79a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:58.530578 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704601d8-7f3c-46ef-9005-c4eb8bb79a53 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:58.538200 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704601d8-7f3c-46ef-9005-c4eb8bb79a53 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:58.538655 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aaafb3-509e-43bc-803e-60529c941fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:58.539367 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aaafb3-509e-43bc-803e-60529c941fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:58.539671 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704601d8-7f3c-46ef-9005-c4eb8bb79a53 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:58.539785 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aaafb3-509e-43bc-803e-60529c941fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:58.539984 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aaafb3-509e-43bc-803e-60529c941fc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:58.550792 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aaafb3-509e-43bc-803e-60529c941fc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:58.550984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-704601d8-7f3c-46ef-9005-c4eb8bb79a53 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 31 01:02:58.550984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:58.550984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:58.550984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:58.550984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:58.550984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:58.550984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:58.550984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:58.550984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:58.550984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:58.550984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:58.550984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:58.550984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:02:58.550984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:02:58.550984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:02:58.550984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:02:58.551979 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:58.551979 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:58.551979 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:02:58.551979 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:02:58.551979 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:02:58.551979 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:02:58.551979 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:58.551979 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:58.551979 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:58.551979 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:58.551979 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:58.551979 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:58.551979 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:58.551979 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:58.551979 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:58.551979 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:58.551979 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:58.551979 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:58.552857 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:58.552857 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:58.552857 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:02:58.552857 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:02:58.552857 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:02:58.552857 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:02:58.552857 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:02:58.552857 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:02:58.552857 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 31 01:02:58.552857 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:02:58.552857 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 251/520] 10.222.0.60 () {56 vars in 1102 bytes} [Sun Jul 31 01:02:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:58.553394 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aaafb3-509e-43bc-803e-60529c941fc9 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:58.553460 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704601d8-7f3c-46ef-9005-c4eb8bb79a53 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:58.566925 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:58.572879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-22aaafb3-509e-43bc-803e-60529c941fc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:02:58.572879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:58.572879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:58.572879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:58.572879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:58.572879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:58.572879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:58.572879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:58.572879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:58.572879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:58.572879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:58.572879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:58.572879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:02:58.572879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:02:58.572879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:02:58.573738 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:02:58.573738 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:58.573738 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:58.573738 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:58.573738 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:58.573738 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:58.573738 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:58.573738 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:58.573738 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:58.573738 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:58.573738 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:58.573738 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:58.573738 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:58.573738 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:58.573738 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:58.573738 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:58.573738 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:58.574565 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:02:58.574565 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:02:58.574565 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:02:58.574565 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:02:58.574565 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 270/521] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:02:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:58.575184 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aaafb3-509e-43bc-803e-60529c941fc9 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:58.660855 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704601d8-7f3c-46ef-9005-c4eb8bb79a53 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:58.663619 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:58.678854 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aaafb3-509e-43bc-803e-60529c941fc9 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:58.693795 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d411c91-e5d5-447e-852c-8890c4f1951a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:58.694439 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d411c91-e5d5-447e-852c-8890c4f1951a None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:58.694723 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d411c91-e5d5-447e-852c-8890c4f1951a None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:58.694993 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d411c91-e5d5-447e-852c-8890c4f1951a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:58.705420 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d411c91-e5d5-447e-852c-8890c4f1951a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:58.706870 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d411c91-e5d5-447e-852c-8890c4f1951a None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:58.712256 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee97826-571f-4b8a-b261-d68aa2e3012d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:58.712894 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee97826-571f-4b8a-b261-d68aa2e3012d None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:58.713173 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee97826-571f-4b8a-b261-d68aa2e3012d None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:58.713455 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee97826-571f-4b8a-b261-d68aa2e3012d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:58.720118 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee97826-571f-4b8a-b261-d68aa2e3012d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:58.720913 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-5d411c91-e5d5-447e-852c-8890c4f1951a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:02:58.720913 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:58.720913 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:58.720913 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:58.720913 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:58.720913 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:58.720913 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:58.720913 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:58.720913 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:58.720913 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:58.720913 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:58.720913 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:58.720913 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:02:58.720913 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:02:58.720913 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:02:58.721723 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:02:58.721723 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:58.721723 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:58.721723 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:58.721723 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:58.721723 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:58.721723 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:58.721723 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:58.721723 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:58.721723 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:58.721723 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:58.721723 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:58.721723 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:58.721723 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:58.721723 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:58.721723 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:58.721723 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:58.722562 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:02:58.722562 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:02:58.722562 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:02:58.722562 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:02:58.722770 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee97826-571f-4b8a-b261-d68aa2e3012d None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:58.722845 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 252/522] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:02:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:58.722845 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d411c91-e5d5-447e-852c-8890c4f1951a None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:58.736094 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-6ee97826-571f-4b8a-b261-d68aa2e3012d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:02:58.736094 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:58.736094 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:58.736094 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:58.736094 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:58.736094 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:58.736094 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:58.736094 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:58.736094 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:58.736094 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:58.736094 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:58.736094 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:58.736094 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:02:58.736094 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:02:58.736094 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:02:58.737110 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:02:58.737110 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:58.737110 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:58.737110 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:58.737110 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:58.737110 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:58.737110 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:58.737110 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:58.737110 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:58.737110 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:58.737110 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:58.737110 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:58.737110 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:58.737110 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:58.737110 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:58.737110 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:58.737110 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:58.737954 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:02:58.737954 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:02:58.737954 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:02:58.737954 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:02:58.737954 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:02:58.737954 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:02:58.737954 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:02:58.737954 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:02:58.737954 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 271/523] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:02:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:58.738415 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee97826-571f-4b8a-b261-d68aa2e3012d None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:58.783661 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:58.824863 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d411c91-e5d5-447e-852c-8890c4f1951a None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:58.836821 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee97826-571f-4b8a-b261-d68aa2e3012d None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:58.857139 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389fa607-99de-4159-a4e8-134cff3fda52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:58.857769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389fa607-99de-4159-a4e8-134cff3fda52 None admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:58.858103 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389fa607-99de-4159-a4e8-134cff3fda52 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:58.858380 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389fa607-99de-4159-a4e8-134cff3fda52 None admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:58.859060 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389fa607-99de-4159-a4e8-134cff3fda52 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:58.860527 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389fa607-99de-4159-a4e8-134cff3fda52 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:58.869355 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6f59c-1728-4c83-b626-8ef361fbeb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:58.869971 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6f59c-1728-4c83-b626-8ef361fbeb2e None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:58.870254 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6f59c-1728-4c83-b626-8ef361fbeb2e None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:58.870513 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6f59c-1728-4c83-b626-8ef361fbeb2e None admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:58.871296 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc6f59c-1728-4c83-b626-8ef361fbeb2e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:58.871631 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc6f59c-1728-4c83-b626-8ef361fbeb2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:58.873065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc6f59c-1728-4c83-b626-8ef361fbeb2e None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:58.882410 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 253/524] 10.222.0.60 () {60 vars in 1132 bytes} [Sun Jul 31 01:02:58 2022] POST /identity/v3/users => generated 247 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:02:58.883212 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389fa607-99de-4159-a4e8-134cff3fda52 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:58.898894 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 272/525] 10.222.0.60 () {56 vars in 1139 bytes} [Sun Jul 31 01:02:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:58.899799 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6f59c-1728-4c83-b626-8ef361fbeb2e None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:58.914033 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:59.015339 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389fa607-99de-4159-a4e8-134cff3fda52 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:59.016622 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6f59c-1728-4c83-b626-8ef361fbeb2e None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:59.031149 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:59.055163 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a5dbc-dc4d-421d-8fab-1e8ba826a44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:59.055832 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a5dbc-dc4d-421d-8fab-1e8ba826a44d None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:59.056116 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a5dbc-dc4d-421d-8fab-1e8ba826a44d None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:59.056386 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a5dbc-dc4d-421d-8fab-1e8ba826a44d None admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:59.057095 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a5dbc-dc4d-421d-8fab-1e8ba826a44d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:59.057397 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a5dbc-dc4d-421d-8fab-1e8ba826a44d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:59.058776 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a5dbc-dc4d-421d-8fab-1e8ba826a44d None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:59.060457 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88e065-ea88-465c-80b1-f8ff677771cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:59.061140 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88e065-ea88-465c-80b1-f8ff677771cb None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:59.061416 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88e065-ea88-465c-80b1-f8ff677771cb None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:59.061683 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88e065-ea88-465c-80b1-f8ff677771cb None admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:59.062373 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88e065-ea88-465c-80b1-f8ff677771cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:59.062668 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88e065-ea88-465c-80b1-f8ff677771cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:59.064074 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88e065-ea88-465c-80b1-f8ff677771cb None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:59.074105 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 254/526] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:02:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:59.074840 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a5dbc-dc4d-421d-8fab-1e8ba826a44d None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:59.081930 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 273/527] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:02:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:59.082870 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88e065-ea88-465c-80b1-f8ff677771cb None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:59.156834 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:59.179881 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a5dbc-dc4d-421d-8fab-1e8ba826a44d None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:59.195393 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88e065-ea88-465c-80b1-f8ff677771cb None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:59.214792 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c307930b-693d-477a-91cb-f1e46e207388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:59.215433 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c307930b-693d-477a-91cb-f1e46e207388 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:59.215724 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c307930b-693d-477a-91cb-f1e46e207388 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:59.215983 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c307930b-693d-477a-91cb-f1e46e207388 None admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:59.216755 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c307930b-693d-477a-91cb-f1e46e207388 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:59.217057 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c307930b-693d-477a-91cb-f1e46e207388 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:59.218655 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c307930b-693d-477a-91cb-f1e46e207388 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:59.230439 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e94fe-62b8-4bc0-a863-84b249d7390c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:59.231307 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e94fe-62b8-4bc0-a863-84b249d7390c None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:59.231785 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e94fe-62b8-4bc0-a863-84b249d7390c None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:59.232241 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e94fe-62b8-4bc0-a863-84b249d7390c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:59.236714 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 255/528] 10.222.0.60 () {56 vars in 1148 bytes} [Sun Jul 31 01:02:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:59.237357 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c307930b-693d-477a-91cb-f1e46e207388 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:59.278627 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:59.303755 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e94fe-62b8-4bc0-a863-84b249d7390c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:59.305984 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e94fe-62b8-4bc0-a863-84b249d7390c None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:59.356559 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c307930b-693d-477a-91cb-f1e46e207388 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:59.380393 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:59.393893 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf39a69-b546-4337-8d46-cebaa8d2b35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:59.394552 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf39a69-b546-4337-8d46-cebaa8d2b35e None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:59.394836 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf39a69-b546-4337-8d46-cebaa8d2b35e None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:59.395110 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf39a69-b546-4337-8d46-cebaa8d2b35e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:59.402948 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf39a69-b546-4337-8d46-cebaa8d2b35e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:59.404719 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf39a69-b546-4337-8d46-cebaa8d2b35e None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:59.419378 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-7cf39a69-b546-4337-8d46-cebaa8d2b35e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:02:59.419378 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:59.419378 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:59.419378 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:59.419378 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:59.419378 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:59.419378 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:59.419378 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:59.419378 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:59.419378 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:59.419378 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:59.419378 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:59.419378 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:02:59.419378 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:02:59.419378 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:02:59.420252 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:02:59.420252 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:59.420252 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:59.420252 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:59.420252 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:59.420252 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:59.420252 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:59.420252 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:59.420252 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:59.420252 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:59.420252 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:59.420252 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:59.420252 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:59.420252 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:59.420252 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:59.420252 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:59.420252 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:59.421148 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:02:59.421148 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:02:59.421148 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:02:59.421148 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:02:59.421148 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:02:59.421148 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:02:59.421148 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:02:59.421148 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:02:59.423625 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 256/529] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:02:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:59.424704 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf39a69-b546-4337-8d46-cebaa8d2b35e None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:59.425709 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 274/530] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:02:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:02:59.426561 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e94fe-62b8-4bc0-a863-84b249d7390c None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:59.527982 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:59.536264 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf39a69-b546-4337-8d46-cebaa8d2b35e None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:59.536870 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e94fe-62b8-4bc0-a863-84b249d7390c None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:59.571764 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8534314-e539-44d5-abc2-db46e99c7d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:59.572012 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3ab64-230a-4a45-b4bb-47bebc0c7c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:59.572381 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8534314-e539-44d5-abc2-db46e99c7d1d None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:59.572482 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3ab64-230a-4a45-b4bb-47bebc0c7c9c None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:59.572653 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8534314-e539-44d5-abc2-db46e99c7d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:59.572757 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3ab64-230a-4a45-b4bb-47bebc0c7c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:59.572918 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8534314-e539-44d5-abc2-db46e99c7d1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:59.573007 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3ab64-230a-4a45-b4bb-47bebc0c7c9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:59.573694 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8534314-e539-44d5-abc2-db46e99c7d1d None admin] RBAC: Adding query filter params (role.id=a5d1b78d4ec146848dfa667303603262, scope.project.id=b931b81a237949aa845891d4bb5aa1c0, user.id=04591cd035ef4961b8b7a93e294eb881) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:59.573992 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8534314-e539-44d5-abc2-db46e99c7d1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:59.575727 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8534314-e539-44d5-abc2-db46e99c7d1d None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:59.579976 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3ab64-230a-4a45-b4bb-47bebc0c7c9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:59.592280 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 275/531] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:02:59 2022] GET /identity/v3/role_assignments?user.id=04591cd035ef4961b8b7a93e294eb881&scope.project.id=b931b81a237949aa845891d4bb5aa1c0&role.id=a5d1b78d4ec146848dfa667303603262 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:59.592479 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3ab64-230a-4a45-b4bb-47bebc0c7c9c None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:59.592556 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8534314-e539-44d5-abc2-db46e99c7d1d None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:59.619013 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-5ff3ab64-230a-4a45-b4bb-47bebc0c7c9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:02:59.619013 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:59.619013 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:59.619013 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:59.619013 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:59.619013 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:59.619013 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:59.619013 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:59.619013 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:59.619013 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:59.619013 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:59.619013 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:59.619013 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:02:59.619013 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:02:59.619013 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:02:59.619984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:02:59.619984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:59.619984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:59.619984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:59.619984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:59.619984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:59.619984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:59.619984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:59.619984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:59.619984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:59.619984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:59.619984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:59.619984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:59.619984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:59.619984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:59.619984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:59.619984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:59.620814 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:02:59.620814 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:02:59.620814 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:02:59.620814 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:02:59.620814 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:02:59.620814 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:02:59.620814 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:02:59.620814 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:02:59.629161 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 257/532] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:02:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:59.629161 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3ab64-230a-4a45-b4bb-47bebc0c7c9c None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:59.639228 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:59.714286 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8534314-e539-44d5-abc2-db46e99c7d1d None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:59.752707 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3ab64-230a-4a45-b4bb-47bebc0c7c9c None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:59.754040 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44cc69-b01e-4038-873e-fbfaef82ef3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:59.754708 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44cc69-b01e-4038-873e-fbfaef82ef3e None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:59.755246 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44cc69-b01e-4038-873e-fbfaef82ef3e None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:59.755886 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44cc69-b01e-4038-873e-fbfaef82ef3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:59.769844 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e44cc69-b01e-4038-873e-fbfaef82ef3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:59.772104 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e44cc69-b01e-4038-873e-fbfaef82ef3e None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:59.791856 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-4e44cc69-b01e-4038-873e-fbfaef82ef3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:02:59.791856 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:02:59.791856 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:02:59.791856 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:02:59.791856 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:02:59.791856 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:02:59.791856 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:02:59.791856 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:02:59.791856 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:02:59.791856 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:02:59.791856 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:02:59.791856 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:02:59.791856 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:02:59.791856 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:02:59.791856 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:02:59.792729 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:02:59.792729 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:02:59.792729 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:02:59.792729 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:02:59.792729 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:02:59.792729 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:02:59.792729 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:02:59.792729 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:02:59.792729 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:02:59.792729 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:02:59.792729 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:02:59.792729 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:02:59.792729 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:02:59.792729 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:02:59.792729 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:02:59.792729 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:02:59.792729 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:02:59.793553 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:02:59.793553 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:02:59.793553 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:02:59.793553 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:02:59.793553 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 276/533] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:02:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:02:59.793804 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44cc69-b01e-4038-873e-fbfaef82ef3e None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:59.795735 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d0140-6c21-4286-8fd4-195e91c65867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:59.796477 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d0140-6c21-4286-8fd4-195e91c65867 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:59.797073 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d0140-6c21-4286-8fd4-195e91c65867 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:59.797458 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d0140-6c21-4286-8fd4-195e91c65867 None admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:59.799650 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d0140-6c21-4286-8fd4-195e91c65867 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:59.800504 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d0140-6c21-4286-8fd4-195e91c65867 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:59.802044 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d0140-6c21-4286-8fd4-195e91c65867 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:59.821928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 258/534] 10.222.0.60 () {56 vars in 1148 bytes} [Sun Jul 31 01:02:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:59.822846 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d0140-6c21-4286-8fd4-195e91c65867 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:59.838387 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:59.885624 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:02:59.905646 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44cc69-b01e-4038-873e-fbfaef82ef3e None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:59.928145 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d0140-6c21-4286-8fd4-195e91c65867 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:02:59.940839 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13428c5b-b1c6-4a28-9f84-1b84b1bfb3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:59.941469 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13428c5b-b1c6-4a28-9f84-1b84b1bfb3e3 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:59.941748 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13428c5b-b1c6-4a28-9f84-1b84b1bfb3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:59.942017 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13428c5b-b1c6-4a28-9f84-1b84b1bfb3e3 None admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:59.942868 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13428c5b-b1c6-4a28-9f84-1b84b1bfb3e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:59.943262 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13428c5b-b1c6-4a28-9f84-1b84b1bfb3e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:59.944733 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13428c5b-b1c6-4a28-9f84-1b84b1bfb3e3 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:59.963401 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071f809-c05b-46f1-8243-63648d53aabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:02:59.964067 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071f809-c05b-46f1-8243-63648d53aabe None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:02:59.964342 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071f809-c05b-46f1-8243-63648d53aabe None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:02:59.964612 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071f809-c05b-46f1-8243-63648d53aabe None admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:02:59.965306 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7071f809-c05b-46f1-8243-63648d53aabe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:02:59.965607 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7071f809-c05b-46f1-8243-63648d53aabe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:02:59.966982 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7071f809-c05b-46f1-8243-63648d53aabe None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:02:59.968861 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 277/535] 10.222.0.60 () {56 vars in 1148 bytes} [Sun Jul 31 01:02:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:59.969835 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13428c5b-b1c6-4a28-9f84-1b84b1bfb3e3 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:02:59.979790 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 259/536] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:02:59.980722 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071f809-c05b-46f1-8243-63648d53aabe None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:00.062138 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:00.077957 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13428c5b-b1c6-4a28-9f84-1b84b1bfb3e3 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:00.098123 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071f809-c05b-46f1-8243-63648d53aabe None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:00.113113 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261905da-ece5-4a9f-9395-d31d5133e7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:00.113736 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261905da-ece5-4a9f-9395-d31d5133e7d8 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:00.114007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261905da-ece5-4a9f-9395-d31d5133e7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:00.114276 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261905da-ece5-4a9f-9395-d31d5133e7d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:00.115064 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261905da-ece5-4a9f-9395-d31d5133e7d8 None admin] RBAC: Adding query filter params (role.id=a5d1b78d4ec146848dfa667303603262, scope.project.id=b931b81a237949aa845891d4bb5aa1c0, user.id=fdebcb0a2a7548a09b3e9d3cf085e40e) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:00.115367 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261905da-ece5-4a9f-9395-d31d5133e7d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:00.116850 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261905da-ece5-4a9f-9395-d31d5133e7d8 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:00.122642 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 278/537] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:02:59 2022] GET /identity/v3/role_assignments?user.id=fdebcb0a2a7548a09b3e9d3cf085e40e&scope.project.id=b931b81a237949aa845891d4bb5aa1c0&role.id=a5d1b78d4ec146848dfa667303603262 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:00.123243 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261905da-ece5-4a9f-9395-d31d5133e7d8 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:00.145010 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:00.205001 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc41ac-67e1-4ac3-b5f8-aa6d5fcfc0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:00.205665 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc41ac-67e1-4ac3-b5f8-aa6d5fcfc0e7 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:00.205945 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc41ac-67e1-4ac3-b5f8-aa6d5fcfc0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:00.206222 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc41ac-67e1-4ac3-b5f8-aa6d5fcfc0e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:00.207053 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc41ac-67e1-4ac3-b5f8-aa6d5fcfc0e7 None admin] RBAC: Adding query filter params (role.id=a5d1b78d4ec146848dfa667303603262, scope.project.id=b931b81a237949aa845891d4bb5aa1c0, user.id=a1943ab629b6411d81327a845b77c8c1) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:00.207357 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc41ac-67e1-4ac3-b5f8-aa6d5fcfc0e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:00.208872 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc41ac-67e1-4ac3-b5f8-aa6d5fcfc0e7 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:00.235517 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 260/538] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:02:59 2022] GET /identity/v3/role_assignments?user.id=a1943ab629b6411d81327a845b77c8c1&scope.project.id=b931b81a237949aa845891d4bb5aa1c0&role.id=a5d1b78d4ec146848dfa667303603262 => generated 259 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:00.267519 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261905da-ece5-4a9f-9395-d31d5133e7d8 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:00.306204 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd8628-e7f5-4899-8b76-b0bbb3ece834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:00.307317 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd8628-e7f5-4899-8b76-b0bbb3ece834 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:00.307835 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd8628-e7f5-4899-8b76-b0bbb3ece834 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:00.308291 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd8628-e7f5-4899-8b76-b0bbb3ece834 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:00.317128 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd8628-e7f5-4899-8b76-b0bbb3ece834 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:00.319369 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd8628-e7f5-4899-8b76-b0bbb3ece834 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:00.333265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-c3bd8628-e7f5-4899-8b76-b0bbb3ece834 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:00.333265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:00.333265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:00.333265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:00.333265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:00.333265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:00.333265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:00.333265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:00.333265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:00.333265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:00.333265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:00.333265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:00.333265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:03:00.333265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:03:00.333265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:03:00.334258 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:03:00.334258 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:00.334258 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:00.334258 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:00.334258 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:00.334258 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:00.334258 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:00.334258 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:00.334258 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:00.334258 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:00.334258 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:00.334258 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:00.334258 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:00.334258 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:00.334258 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:00.334258 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:00.334258 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:00.335077 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:03:00.335077 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:03:00.335077 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:03:00.335077 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:03:00.335077 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:03:00.335077 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:03:00.335077 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:00.335077 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:00.337643 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 279/539] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:03:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:00.343080 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc41ac-67e1-4ac3-b5f8-aa6d5fcfc0e7 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:00.505741 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc41ac-67e1-4ac3-b5f8-aa6d5fcfc0e7 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:00.552796 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f6ed3-a54f-4a81-89c5-21c3f82ace10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:00.553786 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f6ed3-a54f-4a81-89c5-21c3f82ace10 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:00.554292 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f6ed3-a54f-4a81-89c5-21c3f82ace10 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:00.554776 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f6ed3-a54f-4a81-89c5-21c3f82ace10 None admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:00.555766 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1f6ed3-a54f-4a81-89c5-21c3f82ace10 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:00.556257 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1f6ed3-a54f-4a81-89c5-21c3f82ace10 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:00.557890 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1f6ed3-a54f-4a81-89c5-21c3f82ace10 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:00.566039 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:00.572347 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 261/540] 10.222.0.60 () {56 vars in 1148 bytes} [Sun Jul 31 01:03:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:00.580107 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd8628-e7f5-4899-8b76-b0bbb3ece834 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:00.673028 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:00.708596 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd8628-e7f5-4899-8b76-b0bbb3ece834 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:00.745221 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bccc1c1-97ce-440d-820e-81941c7915c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:00.746255 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccc1c1-97ce-440d-820e-81941c7915c6 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:00.746718 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccc1c1-97ce-440d-820e-81941c7915c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:00.747187 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccc1c1-97ce-440d-820e-81941c7915c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:00.748195 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bccc1c1-97ce-440d-820e-81941c7915c6 None admin] RBAC: Adding query filter params (role.id=a5d1b78d4ec146848dfa667303603262, scope.project.id=b931b81a237949aa845891d4bb5aa1c0, user.id=81117154f6d1474c805a69c5617c307d) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:00.748771 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bccc1c1-97ce-440d-820e-81941c7915c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:00.750404 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bccc1c1-97ce-440d-820e-81941c7915c6 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:00.756897 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 280/541] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:03:00 2022] GET /identity/v3/role_assignments?user.id=81117154f6d1474c805a69c5617c307d&scope.project.id=b931b81a237949aa845891d4bb5aa1c0&role.id=a5d1b78d4ec146848dfa667303603262 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:01.027729 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a6f5f-2a46-4f5e-8280-db6bb37f847e None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:01.028430 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a6f5f-2a46-4f5e-8280-db6bb37f847e None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:01.028902 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a6f5f-2a46-4f5e-8280-db6bb37f847e None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:01.031005 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 262/542] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:01.046846 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d08258-bb3e-41c4-b86d-f31b90fd25e1 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:01.047174 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d08258-bb3e-41c4-b86d-f31b90fd25e1 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:01.047397 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d08258-bb3e-41c4-b86d-f31b90fd25e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:01.067306 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-11d08258-bb3e-41c4-b86d-f31b90fd25e1 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:01.068598 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-11d08258-bb3e-41c4-b86d-f31b90fd25e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:01.136663 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 281/543] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:03:01.159528 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a6f5f-2a46-4f5e-8280-db6bb37f847e None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:01.293207 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a6f5f-2a46-4f5e-8280-db6bb37f847e None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:01.338837 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707caa1-e527-4764-84cc-97c60f32405f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:01.339505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707caa1-e527-4764-84cc-97c60f32405f None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:01.339787 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707caa1-e527-4764-84cc-97c60f32405f None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:01.340060 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707caa1-e527-4764-84cc-97c60f32405f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:01.352862 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6707caa1-e527-4764-84cc-97c60f32405f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:03:01.357875 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-6707caa1-e527-4764-84cc-97c60f32405f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:03:01.357875 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:01.357875 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:01.357875 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:01.357875 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:01.357875 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:01.357875 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:01.357875 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:01.357875 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:01.357875 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:01.357875 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:01.357875 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:01.357875 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:03:01.357875 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:03:01.357875 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:03:01.357875 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:03:01.358767 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:03:01.358767 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:03:01.358767 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:03:01.358767 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:03:01.358767 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:01.358767 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:01.358767 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:01.358767 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:01.358767 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:01.358767 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:01.358767 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:01.358767 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:01.358767 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:01.358767 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:01.358767 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:01.358767 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:01.360001 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:01.360001 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:01.360001 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:01.360001 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:01.360001 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:03:01.360001 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:03:01.360001 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:03:01.360001 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:03:01.360001 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:03:01.360001 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:03:01.360001 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:03:01.360001 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:01.360001 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 263/544] 10.222.0.60 () {56 vars in 1102 bytes} [Sun Jul 31 01:03:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:01.368630 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d08258-bb3e-41c4-b86d-f31b90fd25e1 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:01.436823 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:01.485327 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d08258-bb3e-41c4-b86d-f31b90fd25e1 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:01.526618 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57277700-afa8-4c86-a2ee-b0cb7df293c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:01.527261 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57277700-afa8-4c86-a2ee-b0cb7df293c2 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:01.527567 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57277700-afa8-4c86-a2ee-b0cb7df293c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:01.527845 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57277700-afa8-4c86-a2ee-b0cb7df293c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:01.528588 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57277700-afa8-4c86-a2ee-b0cb7df293c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:01.528883 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57277700-afa8-4c86-a2ee-b0cb7df293c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:01.530353 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57277700-afa8-4c86-a2ee-b0cb7df293c2 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:01.539514 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 282/545] 10.222.0.60 () {56 vars in 1103 bytes} [Sun Jul 31 01:03:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:01.545299 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707caa1-e527-4764-84cc-97c60f32405f None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:01.626805 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:01.682313 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707caa1-e527-4764-84cc-97c60f32405f None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:01.798404 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44367c8-ddbd-488c-aad7-cd9b44dd6054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:01.799008 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44367c8-ddbd-488c-aad7-cd9b44dd6054 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:01.799299 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44367c8-ddbd-488c-aad7-cd9b44dd6054 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:01.799608 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44367c8-ddbd-488c-aad7-cd9b44dd6054 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:01.825535 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44367c8-ddbd-488c-aad7-cd9b44dd6054 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:01.827138 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44367c8-ddbd-488c-aad7-cd9b44dd6054 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:01.864771 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-f44367c8-ddbd-488c-aad7-cd9b44dd6054 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:01.864771 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:01.864771 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:01.864771 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:01.864771 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:01.864771 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:01.864771 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:01.864771 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:01.864771 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:01.864771 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:01.864771 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:01.864771 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:01.864771 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:01.864771 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:01.864771 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:01.865661 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:01.865661 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:01.865661 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:01.865661 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:01.865661 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:01.865661 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:01.865661 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:01.865661 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:01.865661 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:01.865661 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:01.865661 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:01.865661 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:01.865661 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:01.865661 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:01.865661 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:01.865661 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:01.865661 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:01.867094 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:01.867094 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:01.867094 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:01.867094 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:01.867094 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 264/546] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:01.876703 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57277700-afa8-4c86-a2ee-b0cb7df293c2 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:02.015340 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57277700-afa8-4c86-a2ee-b0cb7df293c2 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:02.051953 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:02.070586 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72262a-b2e6-4941-9306-106a27a3b940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:02.071227 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72262a-b2e6-4941-9306-106a27a3b940 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:02.071522 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72262a-b2e6-4941-9306-106a27a3b940 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:02.071800 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72262a-b2e6-4941-9306-106a27a3b940 None admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:02.072513 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d72262a-b2e6-4941-9306-106a27a3b940 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:02.072817 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d72262a-b2e6-4941-9306-106a27a3b940 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:02.075805 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d72262a-b2e6-4941-9306-106a27a3b940 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:02.100031 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 283/547] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:02.101433 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44367c8-ddbd-488c-aad7-cd9b44dd6054 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:02.244915 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44367c8-ddbd-488c-aad7-cd9b44dd6054 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:02.259858 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:02.278099 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4c297-0e03-4c7c-80de-91ad1d41e0d1 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:02.278390 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4c297-0e03-4c7c-80de-91ad1d41e0d1 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:02.278664 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4c297-0e03-4c7c-80de-91ad1d41e0d1 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:02.281289 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4f548-8212-468f-8d9b-6fc7ebbc2dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:02.282482 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4f548-8212-468f-8d9b-6fc7ebbc2dad None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:02.282903 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4f548-8212-468f-8d9b-6fc7ebbc2dad None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:02.283617 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4f548-8212-468f-8d9b-6fc7ebbc2dad None admin] PATH_INFO: `/v3/users/swift` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:02.284435 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 284/548] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:02.292483 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4f548-8212-468f-8d9b-6fc7ebbc2dad None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:02.294304 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4f548-8212-468f-8d9b-6fc7ebbc2dad None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:02.297223 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e05cd-c346-4908-a469-ab47a68b835f None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:02.297428 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e05cd-c346-4908-a469-ab47a68b835f None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:02.297700 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e05cd-c346-4908-a469-ab47a68b835f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:02.308229 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-2ab4f548-8212-468f-8d9b-6fc7ebbc2dad None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 31 01:03:02.308229 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:02.308229 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:02.308229 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:02.308229 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:02.308229 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:02.308229 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:02.308229 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:02.308229 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:02.308229 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:02.308229 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:02.308229 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:02.308229 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:03:02.308229 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:03:02.308229 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:03:02.308229 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:03:02.309152 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:02.309152 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:02.309152 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:03:02.309152 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:02.309152 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:03:02.309152 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:02.309152 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:02.309152 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:02.309152 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:02.309152 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:02.309152 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:02.309152 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:02.309152 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:02.309152 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:02.309152 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:02.309152 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:02.309152 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:02.309152 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:02.310681 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:02.310681 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:02.310681 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:03:02.310681 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:03:02.310681 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:03:02.310681 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:03:02.310681 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:03:02.310681 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:03:02.310681 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 31 01:03:02.310681 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:02.314921 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 265/549] 10.222.0.60 () {56 vars in 1096 bytes} [Sun Jul 31 01:03:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:02.322354 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4f548-8212-468f-8d9b-6fc7ebbc2dad None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:02.339588 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-055e05cd-c346-4908-a469-ab47a68b835f None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:02.339588 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-055e05cd-c346-4908-a469-ab47a68b835f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:02.457749 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4f548-8212-468f-8d9b-6fc7ebbc2dad None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:02.495968 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e56891-1686-46ca-a1d2-26281a69243c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:02.496852 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e56891-1686-46ca-a1d2-26281a69243c None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:02.497273 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e56891-1686-46ca-a1d2-26281a69243c None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:02.497686 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e56891-1686-46ca-a1d2-26281a69243c None admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:02.498701 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e56891-1686-46ca-a1d2-26281a69243c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:02.499145 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e56891-1686-46ca-a1d2-26281a69243c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:02.500759 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e56891-1686-46ca-a1d2-26281a69243c None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:02.506160 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 285/550] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:03:02.521015 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 266/551] 10.222.0.60 () {56 vars in 1135 bytes} [Sun Jul 31 01:03:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:02.527518 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e05cd-c346-4908-a469-ab47a68b835f None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:02.532677 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e56891-1686-46ca-a1d2-26281a69243c None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:02.567980 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:02.657757 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e56891-1686-46ca-a1d2-26281a69243c None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:02.670278 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e05cd-c346-4908-a469-ab47a68b835f None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:02.688970 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:02.700216 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b01be4-5dcb-44a0-8925-ebd3b0288b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:02.701325 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b01be4-5dcb-44a0-8925-ebd3b0288b9b None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:02.702196 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b01be4-5dcb-44a0-8925-ebd3b0288b9b None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:02.702633 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b01be4-5dcb-44a0-8925-ebd3b0288b9b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:02.713308 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaeeb90-c876-46ec-bee5-3f8407c7f117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:02.714053 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaeeb90-c876-46ec-bee5-3f8407c7f117 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:02.714420 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaeeb90-c876-46ec-bee5-3f8407c7f117 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:02.714773 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaeeb90-c876-46ec-bee5-3f8407c7f117 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:02.716371 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b01be4-5dcb-44a0-8925-ebd3b0288b9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:03:02.722802 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-d7b01be4-5dcb-44a0-8925-ebd3b0288b9b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:03:02.722802 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:02.722802 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:02.722802 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:02.722802 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:02.722802 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:02.722802 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:02.722802 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:02.722802 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:02.722802 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:02.722802 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:02.722802 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:02.722802 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:03:02.722802 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:03:02.722802 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:03:02.722802 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:03:02.723840 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:03:02.723840 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:03:02.723840 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:03:02.723840 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:03:02.723840 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:02.723840 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:02.723840 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:02.723840 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:02.723840 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:02.723840 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:02.723840 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:02.723840 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:02.723840 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:02.723840 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:02.723840 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:02.723840 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:02.724791 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:02.724791 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:02.724791 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:02.724791 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:02.724791 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:03:02.724791 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:03:02.724791 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:03:02.724791 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:03:02.724791 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:03:02.724791 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:03:02.724791 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:03:02.724791 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:02.732349 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 267/552] 10.222.0.60 () {56 vars in 1102 bytes} [Sun Jul 31 01:03:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:03:02.732597 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a013ac-b439-411b-b048-247f260f1075 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:02.734052 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a013ac-b439-411b-b048-247f260f1075 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:02.734326 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a013ac-b439-411b-b048-247f260f1075 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:02.739659 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 268/553] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:02.740523 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a013ac-b439-411b-b048-247f260f1075 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:02.806944 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaeeb90-c876-46ec-bee5-3f8407c7f117 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:02.809002 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaeeb90-c876-46ec-bee5-3f8407c7f117 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:02.838459 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:02.855979 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a013ac-b439-411b-b048-247f260f1075 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:02.902970 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191badb3-4392-4808-b8fc-7799dc42e4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:02.904561 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191badb3-4392-4808-b8fc-7799dc42e4e1 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:02.905183 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191badb3-4392-4808-b8fc-7799dc42e4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:02.905672 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191badb3-4392-4808-b8fc-7799dc42e4e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:02.906948 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191badb3-4392-4808-b8fc-7799dc42e4e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:02.907461 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191badb3-4392-4808-b8fc-7799dc42e4e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:02.909738 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191badb3-4392-4808-b8fc-7799dc42e4e1 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:02.921559 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 286/554] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:03:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:03:02.927008 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49964e-8ec5-4e81-bccc-266d213238db None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:02.927008 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49964e-8ec5-4e81-bccc-266d213238db None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:02.927008 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49964e-8ec5-4e81-bccc-266d213238db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:02.927280 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 269/555] 10.222.0.60 () {56 vars in 1103 bytes} [Sun Jul 31 01:03:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:02.927957 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096691b9-804d-48d8-afb0-5836acb38d49 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:02.928250 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096691b9-804d-48d8-afb0-5836acb38d49 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:02.928526 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096691b9-804d-48d8-afb0-5836acb38d49 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:02.930158 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 270/556] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:02.930564 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096691b9-804d-48d8-afb0-5836acb38d49 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:02.944662 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-8d49964e-8ec5-4e81-bccc-266d213238db None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:02.945837 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-8d49964e-8ec5-4e81-bccc-266d213238db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:02.953696 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:03.015643 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 287/557] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:03:03.016858 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49964e-8ec5-4e81-bccc-266d213238db None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:03.051183 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096691b9-804d-48d8-afb0-5836acb38d49 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:03.086569 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02539a8-b3e8-4705-a6ce-3c1d2b01cf56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:03.087460 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02539a8-b3e8-4705-a6ce-3c1d2b01cf56 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:03.087942 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02539a8-b3e8-4705-a6ce-3c1d2b01cf56 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:03.088352 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02539a8-b3e8-4705-a6ce-3c1d2b01cf56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:03.099233 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02539a8-b3e8-4705-a6ce-3c1d2b01cf56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:03.100646 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02539a8-b3e8-4705-a6ce-3c1d2b01cf56 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:03.115537 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-f02539a8-b3e8-4705-a6ce-3c1d2b01cf56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:03.115537 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:03.115537 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:03.115537 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:03.115537 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:03.115537 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:03.115537 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:03.115537 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:03.115537 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:03.115537 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:03.115537 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:03.115537 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:03.115537 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:03.115537 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:03.115537 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:03.116475 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:03.116475 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:03.116475 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:03.116475 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:03.116475 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:03.116475 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:03.116475 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:03.116475 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:03.116475 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:03.116475 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:03.116475 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:03.116475 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:03.116475 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:03.116475 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:03.116475 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:03.116475 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:03.116475 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:03.117926 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:03.117926 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:03.117926 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:03.117926 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:03.117926 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 271/558] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:03.118250 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfc230-e9b8-45f9-ac19-3ce5bae3bd01 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:03.118446 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfc230-e9b8-45f9-ac19-3ce5bae3bd01 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:03.119101 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfc230-e9b8-45f9-ac19-3ce5bae3bd01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:03.125880 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:03.136283 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49964e-8ec5-4e81-bccc-266d213238db None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:03.140264 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-2ddfc230-e9b8-45f9-ac19-3ce5bae3bd01 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:03.141552 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-2ddfc230-e9b8-45f9-ac19-3ce5bae3bd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:03.172807 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f54a2a-ac97-4d2b-8c8c-bc610c95f6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:03.173463 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f54a2a-ac97-4d2b-8c8c-bc610c95f6bf None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:03.173847 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f54a2a-ac97-4d2b-8c8c-bc610c95f6bf None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:03.173989 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f54a2a-ac97-4d2b-8c8c-bc610c95f6bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:03.184538 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f54a2a-ac97-4d2b-8c8c-bc610c95f6bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:03.186151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f54a2a-ac97-4d2b-8c8c-bc610c95f6bf None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:03.188309 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:03.202621 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-f7f54a2a-ac97-4d2b-8c8c-bc610c95f6bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:03.202621 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:03.202621 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:03.202621 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:03.202621 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:03.202621 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:03.202621 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:03.202621 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:03.202621 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:03.202621 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:03.202621 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:03.202621 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:03.202621 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:03.202621 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:03.202621 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:03.204204 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:03.204204 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:03.204204 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:03.204204 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:03.204204 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:03.204204 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:03.204204 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:03.204204 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:03.204204 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:03.204204 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:03.204204 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:03.204204 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:03.204204 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:03.204204 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:03.204204 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:03.204204 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:03.204204 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:03.210068 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:03.210068 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:03.210068 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:03.210068 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:03.210068 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 288/559] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:03.210068 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f54a2a-ac97-4d2b-8c8c-bc610c95f6bf None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:03.229199 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 272/560] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:03:03.229926 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddfc230-e9b8-45f9-ac19-3ce5bae3bd01 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:03.335028 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddfc230-e9b8-45f9-ac19-3ce5bae3bd01 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:03.341414 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f54a2a-ac97-4d2b-8c8c-bc610c95f6bf None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:03.372632 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:03.376095 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186928c-f42c-415a-a755-922a525712d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:03.376861 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186928c-f42c-415a-a755-922a525712d2 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:03.377234 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186928c-f42c-415a-a755-922a525712d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:03.377931 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186928c-f42c-415a-a755-922a525712d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:03.379826 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f122925-8fbb-45da-be47-de9d911f6c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:03.380525 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f122925-8fbb-45da-be47-de9d911f6c28 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:03.380908 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f122925-8fbb-45da-be47-de9d911f6c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:03.381276 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f122925-8fbb-45da-be47-de9d911f6c28 None admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:03.382074 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f122925-8fbb-45da-be47-de9d911f6c28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:03.382473 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f122925-8fbb-45da-be47-de9d911f6c28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:03.384030 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f122925-8fbb-45da-be47-de9d911f6c28 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:03.388947 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186928c-f42c-415a-a755-922a525712d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:03:03.395421 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-1186928c-f42c-415a-a755-922a525712d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:03:03.395421 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:03.395421 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:03.395421 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:03.395421 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:03.395421 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:03.395421 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:03.395421 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:03.395421 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:03.395421 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:03.395421 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:03.395421 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:03.395421 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:03:03.395421 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:03:03.395421 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:03:03.395421 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:03:03.396363 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:03:03.396363 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:03:03.396363 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:03:03.396363 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:03:03.396363 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:03.396363 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:03.396363 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:03.396363 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:03.396363 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:03.396363 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:03.396363 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:03.396363 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:03.396363 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:03.396363 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:03.396363 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:03.396363 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:03.398459 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:03.398459 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:03.398459 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:03.398459 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:03.398459 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:03:03.398459 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:03:03.398459 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:03:03.398459 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:03:03.398459 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:03:03.398459 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:03:03.398459 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:03:03.398459 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:03.399099 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 273/561] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:03.399171 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 289/562] 10.222.0.60 () {56 vars in 1102 bytes} [Sun Jul 31 01:03:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:03.399237 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f122925-8fbb-45da-be47-de9d911f6c28 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:03.399385 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186928c-f42c-415a-a755-922a525712d2 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:03.454205 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:03.498100 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186928c-f42c-415a-a755-922a525712d2 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:03.498538 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f122925-8fbb-45da-be47-de9d911f6c28 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:03.532930 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167624f-429f-4a66-93aa-b799e205c24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:03.533526 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6fefb0-a231-428c-89b3-7be8e7ac7506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:03.533827 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167624f-429f-4a66-93aa-b799e205c24f None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:03.534104 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167624f-429f-4a66-93aa-b799e205c24f None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:03.534237 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fefb0-a231-428c-89b3-7be8e7ac7506 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:03.534407 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fefb0-a231-428c-89b3-7be8e7ac7506 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:03.534551 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167624f-429f-4a66-93aa-b799e205c24f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:03.534675 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fefb0-a231-428c-89b3-7be8e7ac7506 None admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:03.535362 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6fefb0-a231-428c-89b3-7be8e7ac7506 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:03.535696 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6fefb0-a231-428c-89b3-7be8e7ac7506 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:03.537082 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6fefb0-a231-428c-89b3-7be8e7ac7506 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:03.544771 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6167624f-429f-4a66-93aa-b799e205c24f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:03:03.549161 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 274/563] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:03.550121 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-6167624f-429f-4a66-93aa-b799e205c24f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:03:03.550121 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:03.550121 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:03.550121 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:03.550121 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:03.550121 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:03.550121 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:03.550121 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:03.550121 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:03.550121 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:03.550121 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:03.550121 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:03.550121 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:03:03.550121 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:03:03.550121 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:03:03.550121 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:03:03.551065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:03:03.551065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:03:03.551065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:03:03.551065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:03:03.551065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:03.551065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:03.551065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:03.551065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:03.551065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:03.551065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:03.551065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:03.551065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:03.551065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:03.551065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:03.551065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:03.551065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:03.551949 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:03.551949 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:03.551949 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:03.551949 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:03.551949 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:03:03.551949 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:03:03.551949 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:03:03.551949 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:03:03.551949 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:03:03.551949 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:03:03.551949 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:03:03.551949 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:03.552596 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eedf299-fc3b-4fc9-a1b4-32bc94660154 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:03.552596 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eedf299-fc3b-4fc9-a1b4-32bc94660154 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:03.552596 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eedf299-fc3b-4fc9-a1b4-32bc94660154 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:03.552596 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 275/564] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:03.552841 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eedf299-fc3b-4fc9-a1b4-32bc94660154 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:03.555690 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 290/565] 10.222.0.60 () {56 vars in 1102 bytes} [Sun Jul 31 01:03:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:03.557728 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167624f-429f-4a66-93aa-b799e205c24f None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:03.610041 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:03.658074 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167624f-429f-4a66-93aa-b799e205c24f None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:03.658546 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eedf299-fc3b-4fc9-a1b4-32bc94660154 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:03.671593 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:03.691158 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ce5f3-a19f-49b2-8a1b-973d5402fa60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:03.691357 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631e62d-5851-46a8-b068-1ddc2bc4a3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:03.691822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ce5f3-a19f-49b2-8a1b-973d5402fa60 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:03.691972 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631e62d-5851-46a8-b068-1ddc2bc4a3be None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:03.692099 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ce5f3-a19f-49b2-8a1b-973d5402fa60 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:03.692254 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631e62d-5851-46a8-b068-1ddc2bc4a3be None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:03.692357 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ce5f3-a19f-49b2-8a1b-973d5402fa60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:03.692529 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631e62d-5851-46a8-b068-1ddc2bc4a3be None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:03.693253 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5631e62d-5851-46a8-b068-1ddc2bc4a3be None admin] RBAC: Adding query filter params (name=service) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:03.693557 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5631e62d-5851-46a8-b068-1ddc2bc4a3be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:03.694941 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5631e62d-5851-46a8-b068-1ddc2bc4a3be None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:03.698805 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343ce5f3-a19f-49b2-8a1b-973d5402fa60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:03.700277 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343ce5f3-a19f-49b2-8a1b-973d5402fa60 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:03.703133 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 276/566] 10.222.0.60 () {56 vars in 1103 bytes} [Sun Jul 31 01:03:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:03.703977 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631e62d-5851-46a8-b068-1ddc2bc4a3be None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:03.712375 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-343ce5f3-a19f-49b2-8a1b-973d5402fa60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:03.712375 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:03.712375 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:03.712375 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:03.712375 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:03.712375 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:03.712375 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:03.712375 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:03.712375 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:03.712375 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:03.712375 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:03.712375 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:03.712375 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:03:03.712375 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:03:03.712375 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:03:03.713259 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:03:03.713259 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:03.713259 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:03.713259 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:03.713259 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:03.713259 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:03.713259 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:03.713259 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:03.713259 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:03.713259 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:03.713259 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:03.713259 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:03.713259 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:03.713259 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:03.713259 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:03.713259 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:03.713259 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:03.714201 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:03:03.714201 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:03:03.714201 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:03:03.714201 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:03:03.714201 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:03:03.714201 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:03:03.714201 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:03.714201 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:03.714201 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 291/567] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:03:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:03.715096 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425df05-4cf4-4727-8506-0995dcfe247e None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:03.715374 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425df05-4cf4-4727-8506-0995dcfe247e None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:03.716012 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425df05-4cf4-4727-8506-0995dcfe247e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:03.733042 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-e425df05-4cf4-4727-8506-0995dcfe247e None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:03.734266 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-e425df05-4cf4-4727-8506-0995dcfe247e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:03.802227 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 292/568] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:03:03.803055 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425df05-4cf4-4727-8506-0995dcfe247e None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:03.808318 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631e62d-5851-46a8-b068-1ddc2bc4a3be None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:03.823107 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:03.844588 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff52d93-7e36-47cb-984b-14408d5ffbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:03.845244 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff52d93-7e36-47cb-984b-14408d5ffbf6 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:03.845592 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff52d93-7e36-47cb-984b-14408d5ffbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:03.845905 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff52d93-7e36-47cb-984b-14408d5ffbf6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:03.853476 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff52d93-7e36-47cb-984b-14408d5ffbf6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:03.854950 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff52d93-7e36-47cb-984b-14408d5ffbf6 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:03.866389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-0ff52d93-7e36-47cb-984b-14408d5ffbf6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:03:03.866389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:03.866389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:03.866389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:03.866389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:03.866389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:03.866389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:03.866389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:03.866389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:03.866389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:03.866389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:03.866389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:03.866389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:03:03.866389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:03:03.866389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:03:03.866389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:03:03.867390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:03.867390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:03.867390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:03:03.867390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:03.867390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:03:03.867390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:03.867390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:03.867390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:03.867390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:03.867390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:03.867390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:03.867390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:03.867390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:03.867390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:03.867390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:03.867390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:03.867390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:03.867390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:03.868541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:03.868541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:03.868541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:03:03.868541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:03:03.868541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:03:03.868541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:03:03.868541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:03:03.868541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:03:03.868541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:03:03.868541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:03.868541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 277/569] 10.222.0.60 () {56 vars in 1093 bytes} [Sun Jul 31 01:03:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:03.868541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff52d93-7e36-47cb-984b-14408d5ffbf6 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:03.914704 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425df05-4cf4-4727-8506-0995dcfe247e None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:03.917013 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:03.948794 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b9e03-c989-4318-a14a-9ca333453ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:03.949443 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b9e03-c989-4318-a14a-9ca333453ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:03.949674 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b9e03-c989-4318-a14a-9ca333453ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:03.949940 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b9e03-c989-4318-a14a-9ca333453ea6 None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:03.950652 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545b9e03-c989-4318-a14a-9ca333453ea6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:03.950948 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545b9e03-c989-4318-a14a-9ca333453ea6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:03.952456 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545b9e03-c989-4318-a14a-9ca333453ea6 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:03.960220 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 293/570] 10.222.0.60 () {56 vars in 1103 bytes} [Sun Jul 31 01:03:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:03.960985 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b9e03-c989-4318-a14a-9ca333453ea6 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:03.971040 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff52d93-7e36-47cb-984b-14408d5ffbf6 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:04.004335 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8addca-ba24-4636-91c8-8e0d0d5a2ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:04.004990 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8addca-ba24-4636-91c8-8e0d0d5a2ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:04.005263 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8addca-ba24-4636-91c8-8e0d0d5a2ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:04.005536 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8addca-ba24-4636-91c8-8e0d0d5a2ed9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:04.016386 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8addca-ba24-4636-91c8-8e0d0d5a2ed9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:04.017834 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8addca-ba24-4636-91c8-8e0d0d5a2ed9 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:04.033009 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-5d8addca-ba24-4636-91c8-8e0d0d5a2ed9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:04.033009 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:04.033009 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:04.033009 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:04.033009 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:04.033009 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:04.033009 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:04.033009 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:04.033009 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:04.033009 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:04.033009 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:04.033009 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:04.033009 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:04.033009 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:04.033009 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:04.039205 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:04.039205 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:04.039205 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:04.039205 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:04.039205 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:04.039205 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:04.039205 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:04.039205 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:04.039205 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:04.039205 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:04.039205 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:04.039205 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:04.039205 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:04.039205 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:04.039205 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:04.039205 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:04.039205 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:04.040333 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:04.040333 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:04.040333 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:04.040333 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:04.040333 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 278/571] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:04.040333 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8addca-ba24-4636-91c8-8e0d0d5a2ed9 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:04.062253 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:04.065523 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b9e03-c989-4318-a14a-9ca333453ea6 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:04.097780 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6cb83-e13f-4018-89a3-25a845b3c3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:04.098399 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6cb83-e13f-4018-89a3-25a845b3c3e5 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:04.098673 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6cb83-e13f-4018-89a3-25a845b3c3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:04.098943 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6cb83-e13f-4018-89a3-25a845b3c3e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:04.099725 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f6cb83-e13f-4018-89a3-25a845b3c3e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:04.100029 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f6cb83-e13f-4018-89a3-25a845b3c3e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:04.101497 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f6cb83-e13f-4018-89a3-25a845b3c3e5 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:04.113963 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 294/572] 10.222.0.60 () {56 vars in 1148 bytes} [Sun Jul 31 01:03:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:04.114665 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6cb83-e13f-4018-89a3-25a845b3c3e5 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:04.137284 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8addca-ba24-4636-91c8-8e0d0d5a2ed9 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:04.141639 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:04.171961 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b89aca-1e7a-43d8-bc00-f9dfed5354af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:04.172530 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b89aca-1e7a-43d8-bc00-f9dfed5354af None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:04.172810 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b89aca-1e7a-43d8-bc00-f9dfed5354af None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:04.173093 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b89aca-1e7a-43d8-bc00-f9dfed5354af None admin] PATH_INFO: `/v3/roles/service` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:04.183726 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b89aca-1e7a-43d8-bc00-f9dfed5354af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:03:04.189113 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-c9b89aca-1e7a-43d8-bc00-f9dfed5354af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:03:04.189113 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:04.189113 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:04.189113 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:04.189113 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:04.189113 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:04.189113 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:04.189113 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:04.189113 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:04.189113 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:04.189113 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:04.189113 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:04.189113 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:03:04.189113 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:03:04.189113 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:03:04.189113 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:03:04.190229 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:03:04.190229 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:03:04.190229 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:03:04.190229 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:03:04.190229 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:04.190229 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:04.190229 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:04.190229 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:04.190229 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:04.190229 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:04.190229 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:04.190229 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:04.190229 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:04.190229 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:04.190229 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:04.190229 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:04.196191 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:04.196191 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:04.196191 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:04.196191 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:04.196191 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:03:04.196191 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:03:04.196191 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:03:04.196191 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:03:04.196191 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:03:04.196191 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:03:04.196191 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:03:04.196191 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:04.196191 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 279/573] 10.222.0.60 () {56 vars in 1102 bytes} [Sun Jul 31 01:03:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:04.196191 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b89aca-1e7a-43d8-bc00-f9dfed5354af None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:04.214660 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6cb83-e13f-4018-89a3-25a845b3c3e5 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:04.247102 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b71598-167d-4f01-b0ba-bf1416990dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:04.247753 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b71598-167d-4f01-b0ba-bf1416990dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:04.248024 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b71598-167d-4f01-b0ba-bf1416990dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:04.248290 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b71598-167d-4f01-b0ba-bf1416990dc4 None admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:04.249242 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b71598-167d-4f01-b0ba-bf1416990dc4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:04.249520 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b71598-167d-4f01-b0ba-bf1416990dc4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:04.250950 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b71598-167d-4f01-b0ba-bf1416990dc4 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:04.268111 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 295/574] 10.222.0.60 () {56 vars in 1133 bytes} [Sun Jul 31 01:03:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:04.268935 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b71598-167d-4f01-b0ba-bf1416990dc4 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:04.273665 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:04.290612 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b89aca-1e7a-43d8-bc00-f9dfed5354af None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:04.323652 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b5a2d-f74e-4ab4-9c03-4cb2d38053c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:04.324280 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b5a2d-f74e-4ab4-9c03-4cb2d38053c1 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:04.324549 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b5a2d-f74e-4ab4-9c03-4cb2d38053c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:04.324814 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b5a2d-f74e-4ab4-9c03-4cb2d38053c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:04.335260 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b5a2d-f74e-4ab4-9c03-4cb2d38053c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:04.336757 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b5a2d-f74e-4ab4-9c03-4cb2d38053c1 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:04.351334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-828b5a2d-f74e-4ab4-9c03-4cb2d38053c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:04.351334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:04.351334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:04.351334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:04.351334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:04.351334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:04.351334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:04.351334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:04.351334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:04.351334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:04.351334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:04.351334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:04.351334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:04.351334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:04.351334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:04.352401 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:04.352401 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:04.352401 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:04.352401 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:04.352401 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:04.352401 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:04.352401 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:04.352401 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:04.352401 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:04.352401 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:04.352401 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:04.352401 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:04.352401 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:04.352401 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:04.352401 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:04.352401 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:04.352401 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:04.353337 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:04.353337 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:04.353337 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:04.353337 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:04.353560 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:04.353633 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 280/575] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:04.353708 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b5a2d-f74e-4ab4-9c03-4cb2d38053c1 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:04.374510 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b71598-167d-4f01-b0ba-bf1416990dc4 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:04.408667 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff57978-c1ee-4da9-928f-dd6368b424a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:04.409288 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff57978-c1ee-4da9-928f-dd6368b424a1 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:04.409560 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff57978-c1ee-4da9-928f-dd6368b424a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:04.409823 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff57978-c1ee-4da9-928f-dd6368b424a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:04.410507 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff57978-c1ee-4da9-928f-dd6368b424a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:04.410810 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff57978-c1ee-4da9-928f-dd6368b424a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:04.412240 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff57978-c1ee-4da9-928f-dd6368b424a1 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:04.423900 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 296/576] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:04.424744 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff57978-c1ee-4da9-928f-dd6368b424a1 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:04.458527 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b5a2d-f74e-4ab4-9c03-4cb2d38053c1 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:04.491780 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1768fd-c53a-4423-bf09-f40af8bcefde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:04.492496 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1768fd-c53a-4423-bf09-f40af8bcefde None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:04.492794 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1768fd-c53a-4423-bf09-f40af8bcefde None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:04.493252 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1768fd-c53a-4423-bf09-f40af8bcefde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:04.494623 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1768fd-c53a-4423-bf09-f40af8bcefde None admin] RBAC: Adding query filter params (role.id=a5d1b78d4ec146848dfa667303603262, scope.project.id=b931b81a237949aa845891d4bb5aa1c0, user.id=0c8c98c1e2d24de89c7d07753fae02e5) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:04.494950 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1768fd-c53a-4423-bf09-f40af8bcefde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:04.496402 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1768fd-c53a-4423-bf09-f40af8bcefde None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:04.503185 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 281/577] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:03:04 2022] GET /identity/v3/role_assignments?user.id=0c8c98c1e2d24de89c7d07753fae02e5&scope.project.id=b931b81a237949aa845891d4bb5aa1c0&role.id=a5d1b78d4ec146848dfa667303603262 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:04.504042 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1768fd-c53a-4423-bf09-f40af8bcefde None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:04.507033 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:04.543256 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff57978-c1ee-4da9-928f-dd6368b424a1 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:04.584782 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786bf590-8ffb-4e6e-9e78-a64d97cd00c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:04.585432 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bf590-8ffb-4e6e-9e78-a64d97cd00c8 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:04.585705 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bf590-8ffb-4e6e-9e78-a64d97cd00c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:04.585975 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bf590-8ffb-4e6e-9e78-a64d97cd00c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:04.586716 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786bf590-8ffb-4e6e-9e78-a64d97cd00c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:04.587017 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786bf590-8ffb-4e6e-9e78-a64d97cd00c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:04.588458 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786bf590-8ffb-4e6e-9e78-a64d97cd00c8 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:04.603139 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 297/578] 10.222.0.60 () {56 vars in 1103 bytes} [Sun Jul 31 01:03:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:04.603139 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786bf590-8ffb-4e6e-9e78-a64d97cd00c8 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:04.612904 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:04.638254 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1768fd-c53a-4423-bf09-f40af8bcefde None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:04.680487 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97741407-53f0-4eac-a9f5-e7030e201606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:04.681083 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97741407-53f0-4eac-a9f5-e7030e201606 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:04.681344 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97741407-53f0-4eac-a9f5-e7030e201606 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:04.681658 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97741407-53f0-4eac-a9f5-e7030e201606 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:04.696396 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97741407-53f0-4eac-a9f5-e7030e201606 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:04.697881 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97741407-53f0-4eac-a9f5-e7030e201606 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:04.713478 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-97741407-53f0-4eac-a9f5-e7030e201606 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:04.713478 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:04.713478 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:04.713478 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:04.713478 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:04.713478 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:04.713478 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:04.713478 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:04.713478 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:04.713478 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:04.713478 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:04.713478 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:04.713478 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:04.713478 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:04.713478 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:04.714409 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:04.714409 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:04.714409 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:04.714409 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:04.714409 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:04.714409 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:04.714409 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:04.714409 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:04.714409 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:04.714409 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:04.714409 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:04.714409 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:04.714409 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:04.714409 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:04.714409 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:04.714409 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:04.714409 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:04.715329 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:04.715329 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:04.715329 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:04.715329 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:04.716822 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 282/579] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:04.717769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97741407-53f0-4eac-a9f5-e7030e201606 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:04.728970 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786bf590-8ffb-4e6e-9e78-a64d97cd00c8 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:04.765680 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0991ab2-09a6-4fc6-af4c-9c3406e89a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:04.766322 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0991ab2-09a6-4fc6-af4c-9c3406e89a50 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:04.766600 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0991ab2-09a6-4fc6-af4c-9c3406e89a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:04.766871 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0991ab2-09a6-4fc6-af4c-9c3406e89a50 None admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:04.767593 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0991ab2-09a6-4fc6-af4c-9c3406e89a50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:04.767894 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0991ab2-09a6-4fc6-af4c-9c3406e89a50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:04.769289 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0991ab2-09a6-4fc6-af4c-9c3406e89a50 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:04.781491 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 298/580] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:04.782415 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0991ab2-09a6-4fc6-af4c-9c3406e89a50 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:04.789988 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:04.845463 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97741407-53f0-4eac-a9f5-e7030e201606 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:04.857295 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:04.887032 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c848d-438a-4287-844c-cff9770934af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:04.887710 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c848d-438a-4287-844c-cff9770934af None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:04.887985 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c848d-438a-4287-844c-cff9770934af None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:04.888255 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c848d-438a-4287-844c-cff9770934af None admin] PATH_INFO: `/v3/users/glance` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:04.896294 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69c848d-438a-4287-844c-cff9770934af None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:04.897083 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0991ab2-09a6-4fc6-af4c-9c3406e89a50 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:04.897738 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69c848d-438a-4287-844c-cff9770934af None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:04.912086 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-c69c848d-438a-4287-844c-cff9770934af None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 31 01:03:04.912086 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:04.912086 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:04.912086 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:04.912086 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:04.912086 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:04.912086 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:04.912086 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:04.912086 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:04.912086 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:04.912086 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:04.912086 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:04.912086 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:03:04.912086 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:03:04.912086 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:03:04.912086 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:03:04.913060 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:04.913060 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:04.913060 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:03:04.913060 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:04.913060 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:03:04.913060 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:04.913060 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:04.913060 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:04.913060 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:04.913060 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:04.913060 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:04.913060 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:04.913060 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:04.913060 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:04.913060 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:04.913060 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:04.913060 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:04.913060 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:04.913998 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:04.913998 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:04.913998 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:03:04.913998 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:03:04.913998 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:03:04.913998 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:03:04.913998 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:03:04.913998 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:03:04.913998 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 31 01:03:04.913998 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:04.913998 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 283/581] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:03:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:04.915300 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c848d-438a-4287-844c-cff9770934af None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:04.944292 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374399c-11b1-4746-ad99-f968207b8504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:04.944923 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374399c-11b1-4746-ad99-f968207b8504 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:04.945192 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374399c-11b1-4746-ad99-f968207b8504 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:04.945489 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374399c-11b1-4746-ad99-f968207b8504 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:04.964502 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374399c-11b1-4746-ad99-f968207b8504 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:04.965998 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374399c-11b1-4746-ad99-f968207b8504 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:04.981751 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-4374399c-11b1-4746-ad99-f968207b8504 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:04.981751 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:04.981751 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:04.981751 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:04.981751 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:04.981751 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:04.981751 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:04.981751 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:04.981751 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:04.981751 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:04.981751 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:04.981751 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:04.981751 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:04.981751 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:04.981751 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:04.983077 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:04.983077 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:04.983077 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:04.983077 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:04.983077 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:04.983077 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:04.983077 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:04.983077 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:04.983077 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:04.983077 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:04.983077 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:04.983077 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:04.983077 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:04.983077 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:04.983077 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:04.983077 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:04.983077 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:04.984214 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:04.984214 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:04.984214 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:04.984214 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:04.986632 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 299/582] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:04.986632 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374399c-11b1-4746-ad99-f968207b8504 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:05.041802 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c848d-438a-4287-844c-cff9770934af None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:05.057614 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:05.080898 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae72108-04ba-469b-84c3-a1a020d240e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:05.081517 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae72108-04ba-469b-84c3-a1a020d240e6 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:05.081937 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae72108-04ba-469b-84c3-a1a020d240e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:05.082227 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae72108-04ba-469b-84c3-a1a020d240e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:05.082921 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae72108-04ba-469b-84c3-a1a020d240e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:05.083270 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae72108-04ba-469b-84c3-a1a020d240e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:05.084786 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae72108-04ba-469b-84c3-a1a020d240e6 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:05.098950 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 284/583] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:05.099927 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae72108-04ba-469b-84c3-a1a020d240e6 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:05.109936 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374399c-11b1-4746-ad99-f968207b8504 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:05.129596 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:05.151199 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4df046-22bf-4a3f-9d5b-944e0a16e150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:05.151881 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4df046-22bf-4a3f-9d5b-944e0a16e150 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:05.152157 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4df046-22bf-4a3f-9d5b-944e0a16e150 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:05.152424 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4df046-22bf-4a3f-9d5b-944e0a16e150 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:05.160347 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4df046-22bf-4a3f-9d5b-944e0a16e150 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:05.161799 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4df046-22bf-4a3f-9d5b-944e0a16e150 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:05.173325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-4e4df046-22bf-4a3f-9d5b-944e0a16e150 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 31 01:03:05.173325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:05.173325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:05.173325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:05.173325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:05.173325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:05.173325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:05.173325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:05.173325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:05.173325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:05.173325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:05.173325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:05.173325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:03:05.173325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:03:05.173325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:03:05.173325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:03:05.174305 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:05.174305 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:05.174305 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:03:05.174305 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:05.174305 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:03:05.174305 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:05.174305 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:05.174305 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:05.174305 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:05.174305 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:05.174305 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:05.174305 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:05.174305 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:05.174305 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:05.174305 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:05.174305 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:05.174305 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:05.174305 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:05.175230 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:05.175230 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:05.175230 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:03:05.175230 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:03:05.175230 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:03:05.175230 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:03:05.175230 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:03:05.175230 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:03:05.175230 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 31 01:03:05.175230 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:05.175230 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 300/584] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:03:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:05.175230 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4df046-22bf-4a3f-9d5b-944e0a16e150 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:05.219283 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae72108-04ba-469b-84c3-a1a020d240e6 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:05.258851 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975908dd-0419-4117-abc2-bb0f08f53144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:05.259478 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975908dd-0419-4117-abc2-bb0f08f53144 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:05.259783 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975908dd-0419-4117-abc2-bb0f08f53144 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:05.260051 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975908dd-0419-4117-abc2-bb0f08f53144 None admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:05.260835 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975908dd-0419-4117-abc2-bb0f08f53144 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:05.261130 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975908dd-0419-4117-abc2-bb0f08f53144 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:05.262673 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975908dd-0419-4117-abc2-bb0f08f53144 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:05.280562 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 285/585] 10.222.0.60 () {56 vars in 1137 bytes} [Sun Jul 31 01:03:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:05.281403 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975908dd-0419-4117-abc2-bb0f08f53144 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:05.296549 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4df046-22bf-4a3f-9d5b-944e0a16e150 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:05.313701 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:05.342250 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b170b-0d19-48f5-b4e1-7458b83d59f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:05.342923 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b170b-0d19-48f5-b4e1-7458b83d59f2 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:05.343350 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b170b-0d19-48f5-b4e1-7458b83d59f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:05.343537 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b170b-0d19-48f5-b4e1-7458b83d59f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:05.344413 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b170b-0d19-48f5-b4e1-7458b83d59f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:05.344518 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b170b-0d19-48f5-b4e1-7458b83d59f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:05.345910 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b170b-0d19-48f5-b4e1-7458b83d59f2 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:05.363395 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 301/586] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:05.363395 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b170b-0d19-48f5-b4e1-7458b83d59f2 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:05.401802 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975908dd-0419-4117-abc2-bb0f08f53144 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:05.406264 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:05.437721 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052039a-06f6-48be-bda2-2091a9c9c62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:05.438429 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052039a-06f6-48be-bda2-2091a9c9c62f None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:05.438704 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052039a-06f6-48be-bda2-2091a9c9c62f None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:05.438975 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052039a-06f6-48be-bda2-2091a9c9c62f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:05.446650 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052039a-06f6-48be-bda2-2091a9c9c62f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:05.448286 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052039a-06f6-48be-bda2-2091a9c9c62f None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:05.460134 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-6052039a-06f6-48be-bda2-2091a9c9c62f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:05.460134 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:05.460134 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:05.460134 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:05.460134 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:05.460134 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:05.460134 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:05.460134 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:05.460134 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:05.460134 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:05.460134 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:05.460134 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:05.460134 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:03:05.460134 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:03:05.460134 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:03:05.461027 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:03:05.461027 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:05.461027 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:05.461027 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:05.461027 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:05.461027 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:05.461027 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:05.461027 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:05.461027 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:05.461027 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:05.461027 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:05.461027 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:05.461027 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:05.461027 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:05.461027 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:05.461027 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:05.461027 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:05.461900 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:03:05.461900 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:03:05.461900 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:03:05.461900 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:03:05.461900 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:03:05.461900 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:03:05.461900 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:05.461900 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:05.461900 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 286/587] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:03:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:05.462554 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052039a-06f6-48be-bda2-2091a9c9c62f None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:05.475289 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b170b-0d19-48f5-b4e1-7458b83d59f2 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:05.511855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605d3e6-94ce-40c2-b966-07f7b90c7e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:05.512721 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605d3e6-94ce-40c2-b966-07f7b90c7e90 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:05.513135 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605d3e6-94ce-40c2-b966-07f7b90c7e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:05.513403 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605d3e6-94ce-40c2-b966-07f7b90c7e90 None admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:05.514381 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2605d3e6-94ce-40c2-b966-07f7b90c7e90 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:05.514678 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2605d3e6-94ce-40c2-b966-07f7b90c7e90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:05.516138 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2605d3e6-94ce-40c2-b966-07f7b90c7e90 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:05.538250 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 302/588] 10.222.0.60 () {56 vars in 1137 bytes} [Sun Jul 31 01:03:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:05.538250 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605d3e6-94ce-40c2-b966-07f7b90c7e90 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:05.570145 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:05.580737 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052039a-06f6-48be-bda2-2091a9c9c62f None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:05.618116 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261dc95-43e2-4bde-bb3f-bb94de633e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:05.618772 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261dc95-43e2-4bde-bb3f-bb94de633e22 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:05.619044 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261dc95-43e2-4bde-bb3f-bb94de633e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:05.619310 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261dc95-43e2-4bde-bb3f-bb94de633e22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:05.631816 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261dc95-43e2-4bde-bb3f-bb94de633e22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:05.633851 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261dc95-43e2-4bde-bb3f-bb94de633e22 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:05.640194 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:05.646366 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605d3e6-94ce-40c2-b966-07f7b90c7e90 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:05.651808 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-1261dc95-43e2-4bde-bb3f-bb94de633e22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:05.651808 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:05.651808 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:05.651808 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:05.651808 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:05.651808 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:05.651808 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:05.651808 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:05.651808 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:05.651808 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:05.651808 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:05.651808 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:05.651808 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:05.651808 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:05.651808 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:05.653010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:05.653010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:05.653010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:05.653010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:05.653010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:05.653010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:05.653010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:05.653010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:05.653010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:05.653010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:05.653010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:05.653010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:05.653010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:05.653010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:05.653010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:05.653010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:05.653010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:05.653878 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:05.653878 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:05.653878 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:05.653878 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:05.657880 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 287/589] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:05.659030 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261dc95-43e2-4bde-bb3f-bb94de633e22 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:05.686992 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f637fc-ba70-4cad-85b7-25738d8321b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:05.687830 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f637fc-ba70-4cad-85b7-25738d8321b9 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:05.688445 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f637fc-ba70-4cad-85b7-25738d8321b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:05.688698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f637fc-ba70-4cad-85b7-25738d8321b9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:05.697896 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f637fc-ba70-4cad-85b7-25738d8321b9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:05.699855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f637fc-ba70-4cad-85b7-25738d8321b9 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:05.714041 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-20f637fc-ba70-4cad-85b7-25738d8321b9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 31 01:03:05.714041 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:05.714041 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:05.714041 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:05.714041 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:05.714041 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:05.714041 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:05.714041 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:05.714041 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:05.714041 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:05.714041 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:05.714041 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:05.714041 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:03:05.714041 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:03:05.714041 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:03:05.714041 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:03:05.714972 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:05.714972 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:05.714972 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:03:05.714972 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:05.714972 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:03:05.714972 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:05.714972 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:05.714972 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:05.714972 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:05.714972 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:05.714972 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:05.714972 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:05.714972 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:05.714972 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:05.714972 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:05.714972 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:05.714972 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:05.714972 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:05.715929 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:05.715929 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:05.715929 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:03:05.715929 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:03:05.715929 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:03:05.715929 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:03:05.715929 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:03:05.715929 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:03:05.715929 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 31 01:03:05.715929 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:05.718278 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 303/590] 10.222.0.60 () {56 vars in 1102 bytes} [Sun Jul 31 01:03:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:05.719204 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f637fc-ba70-4cad-85b7-25738d8321b9 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:05.769286 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261dc95-43e2-4bde-bb3f-bb94de633e22 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:05.804221 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c9079-39a4-4339-81f0-20f453423767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:05.804843 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c9079-39a4-4339-81f0-20f453423767 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:05.805125 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c9079-39a4-4339-81f0-20f453423767 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:05.805392 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c9079-39a4-4339-81f0-20f453423767 None admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:05.806136 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c9079-39a4-4339-81f0-20f453423767 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:05.806442 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c9079-39a4-4339-81f0-20f453423767 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:05.807911 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c9079-39a4-4339-81f0-20f453423767 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:05.820137 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 288/591] 10.222.0.60 () {56 vars in 1148 bytes} [Sun Jul 31 01:03:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:05.820929 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c9079-39a4-4339-81f0-20f453423767 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:05.827447 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:05.834491 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f637fc-ba70-4cad-85b7-25738d8321b9 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:05.868540 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a070a-8907-462d-a085-e5c7e054056a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:05.869187 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a070a-8907-462d-a085-e5c7e054056a None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:05.869464 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a070a-8907-462d-a085-e5c7e054056a None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:05.869734 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a070a-8907-462d-a085-e5c7e054056a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:05.881365 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a070a-8907-462d-a085-e5c7e054056a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:05.882814 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a070a-8907-462d-a085-e5c7e054056a None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:05.897348 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-475a070a-8907-462d-a085-e5c7e054056a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:05.897348 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:05.897348 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:05.897348 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:05.897348 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:05.897348 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:05.897348 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:05.897348 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:05.897348 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:05.897348 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:05.897348 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:05.897348 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:05.897348 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:05.897348 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:05.897348 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:05.898325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:05.898325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:05.898325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:05.898325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:05.898325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:05.898325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:05.898325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:05.898325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:05.898325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:05.898325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:05.898325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:05.898325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:05.898325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:05.898325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:05.898325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:05.898325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:05.898325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:05.899224 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:05.899224 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:05.899224 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:05.899224 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:05.899224 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 304/592] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:05.900015 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a070a-8907-462d-a085-e5c7e054056a None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:05.910661 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:05.938735 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c9079-39a4-4339-81f0-20f453423767 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:05.979212 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b03382-ef12-4a98-b3b0-d7f9b2b093c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:05.980168 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b03382-ef12-4a98-b3b0-d7f9b2b093c9 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:05.980460 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b03382-ef12-4a98-b3b0-d7f9b2b093c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:05.980733 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b03382-ef12-4a98-b3b0-d7f9b2b093c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:05.981433 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b03382-ef12-4a98-b3b0-d7f9b2b093c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:05.981738 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b03382-ef12-4a98-b3b0-d7f9b2b093c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:05.983140 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b03382-ef12-4a98-b3b0-d7f9b2b093c9 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:05.995530 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 289/593] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:05.995530 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b03382-ef12-4a98-b3b0-d7f9b2b093c9 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:06.008585 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a070a-8907-462d-a085-e5c7e054056a None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:06.045562 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae097390-747c-439b-b366-1a782ff964c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:06.046422 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae097390-747c-439b-b366-1a782ff964c5 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:06.046862 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae097390-747c-439b-b366-1a782ff964c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:06.047276 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae097390-747c-439b-b366-1a782ff964c5 None admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:06.048245 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae097390-747c-439b-b366-1a782ff964c5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:06.048691 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae097390-747c-439b-b366-1a782ff964c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:06.050267 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae097390-747c-439b-b366-1a782ff964c5 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:06.065892 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:06.069445 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 305/594] 10.222.0.60 () {56 vars in 1139 bytes} [Sun Jul 31 01:03:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:06.070971 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae097390-747c-439b-b366-1a782ff964c5 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:06.111982 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b03382-ef12-4a98-b3b0-d7f9b2b093c9 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:06.139375 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:06.149995 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b3fc4-c4dd-47f2-9718-389767eabb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:06.150687 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b3fc4-c4dd-47f2-9718-389767eabb47 None admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:06.150967 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b3fc4-c4dd-47f2-9718-389767eabb47 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:06.151230 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b3fc4-c4dd-47f2-9718-389767eabb47 None admin] PATH_INFO: `/v3/projects/b931b81a237949aa845891d4bb5aa1c0/users/04591cd035ef4961b8b7a93e294eb881/roles/a5d1b78d4ec146848dfa667303603262` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:06.166600 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149b3fc4-c4dd-47f2-9718-389767eabb47 None admin] RBAC: Authorizing `identity:create_grant(project_id=b931b81a237949aa845891d4bb5aa1c0, user_id=04591cd035ef4961b8b7a93e294eb881, role_id=a5d1b78d4ec146848dfa667303603262)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:06.168087 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149b3fc4-c4dd-47f2-9718-389767eabb47 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:06.175549 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae097390-747c-439b-b366-1a782ff964c5 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:06.181563 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 290/595] 10.222.0.60 () {58 vars in 1439 bytes} [Sun Jul 31 01:03:05 2022] PUT /identity/v3/projects/b931b81a237949aa845891d4bb5aa1c0/users/04591cd035ef4961b8b7a93e294eb881/roles/a5d1b78d4ec146848dfa667303603262 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:03:06.182394 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b3fc4-c4dd-47f2-9718-389767eabb47 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:06.228582 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5558a716-a0d1-4643-8948-c62c4fb50307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:06.229642 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558a716-a0d1-4643-8948-c62c4fb50307 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:06.230504 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558a716-a0d1-4643-8948-c62c4fb50307 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:06.231969 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558a716-a0d1-4643-8948-c62c4fb50307 None admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:06.232506 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5558a716-a0d1-4643-8948-c62c4fb50307 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:06.232845 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5558a716-a0d1-4643-8948-c62c4fb50307 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:06.236288 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5558a716-a0d1-4643-8948-c62c4fb50307 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:06.260661 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 306/596] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:06.262013 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5558a716-a0d1-4643-8948-c62c4fb50307 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:06.312244 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b3fc4-c4dd-47f2-9718-389767eabb47 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:06.328270 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:06.362737 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea0bb5-317f-408d-8efe-9bbc44dd66d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:06.362737 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea0bb5-317f-408d-8efe-9bbc44dd66d9 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:06.362737 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea0bb5-317f-408d-8efe-9bbc44dd66d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:06.363130 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea0bb5-317f-408d-8efe-9bbc44dd66d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:06.373600 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acea0bb5-317f-408d-8efe-9bbc44dd66d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:06.375042 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acea0bb5-317f-408d-8efe-9bbc44dd66d9 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:06.391965 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-acea0bb5-317f-408d-8efe-9bbc44dd66d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:06.391965 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:06.391965 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:06.391965 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:06.391965 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:06.391965 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:06.391965 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:06.391965 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:06.391965 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:06.391965 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:06.391965 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:06.391965 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:06.391965 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:03:06.391965 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:03:06.391965 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:03:06.392909 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:03:06.392909 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:06.392909 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:06.392909 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:06.392909 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:06.392909 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:06.392909 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:06.392909 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:06.392909 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:06.392909 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:06.392909 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:06.392909 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:06.392909 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:06.392909 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:06.392909 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:06.392909 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:06.392909 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:06.393789 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:03:06.393789 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:03:06.393789 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:03:06.393789 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:03:06.393789 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:03:06.393789 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:03:06.393789 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:06.393789 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:06.393789 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 291/597] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:03:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:06.394352 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea0bb5-317f-408d-8efe-9bbc44dd66d9 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:06.425492 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5558a716-a0d1-4643-8948-c62c4fb50307 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:06.455460 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:06.466345 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f0df4-258a-45a8-922c-eccd35397875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:06.467406 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f0df4-258a-45a8-922c-eccd35397875 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:06.467846 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f0df4-258a-45a8-922c-eccd35397875 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:06.468324 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f0df4-258a-45a8-922c-eccd35397875 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:06.480951 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f0df4-258a-45a8-922c-eccd35397875 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:06.482848 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f0df4-258a-45a8-922c-eccd35397875 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:06.498881 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-5c2f0df4-258a-45a8-922c-eccd35397875 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:06.498881 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:06.498881 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:06.498881 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:06.498881 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:06.498881 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:06.498881 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:06.498881 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:06.498881 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:06.498881 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:06.498881 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:06.498881 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:06.498881 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:06.498881 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:06.498881 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:06.500000 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:06.500000 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:06.500000 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:06.500000 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:06.500000 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:06.500000 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:06.500000 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:06.500000 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:06.500000 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:06.500000 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:06.500000 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:06.500000 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:06.500000 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:06.500000 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:06.500000 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:06.500000 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:06.500000 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:06.501053 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:06.501053 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:06.501053 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:06.501053 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:06.503341 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 307/598] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:06.504248 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea0bb5-317f-408d-8efe-9bbc44dd66d9 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:06.504487 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f0df4-258a-45a8-922c-eccd35397875 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:06.539383 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c341225-ab63-4dd9-aff2-610b6b0b670d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:06.540063 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c341225-ab63-4dd9-aff2-610b6b0b670d None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:06.540340 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c341225-ab63-4dd9-aff2-610b6b0b670d None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:06.541313 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c341225-ab63-4dd9-aff2-610b6b0b670d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:06.547824 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c341225-ab63-4dd9-aff2-610b6b0b670d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:06.549052 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c341225-ab63-4dd9-aff2-610b6b0b670d None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:06.560575 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-7c341225-ab63-4dd9-aff2-610b6b0b670d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:06.560575 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:06.560575 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:06.560575 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:06.560575 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:06.560575 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:06.560575 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:06.560575 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:06.560575 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:06.560575 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:06.560575 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:06.560575 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:06.560575 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:03:06.560575 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:03:06.560575 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:03:06.561568 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:03:06.561568 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:06.561568 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:06.561568 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:06.561568 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:06.561568 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:06.561568 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:06.561568 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:06.561568 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:06.561568 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:06.561568 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:06.561568 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:06.561568 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:06.561568 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:06.561568 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:06.561568 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:06.561568 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:06.562493 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:03:06.562493 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:03:06.562493 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:03:06.562493 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:03:06.562493 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:03:06.562493 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:03:06.562493 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:06.562493 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:06.562493 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 292/599] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:03:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:06.563766 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c341225-ab63-4dd9-aff2-610b6b0b670d None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:06.597533 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:06.613564 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f0df4-258a-45a8-922c-eccd35397875 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:06.647597 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8827eed-d877-48d5-a2f9-5b66da3abceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:06.648230 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8827eed-d877-48d5-a2f9-5b66da3abceb None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:06.648506 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8827eed-d877-48d5-a2f9-5b66da3abceb None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:06.648775 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8827eed-d877-48d5-a2f9-5b66da3abceb None admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:06.649526 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8827eed-d877-48d5-a2f9-5b66da3abceb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:06.649832 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8827eed-d877-48d5-a2f9-5b66da3abceb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:06.651266 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8827eed-d877-48d5-a2f9-5b66da3abceb None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:06.664222 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 308/600] 10.222.0.60 () {56 vars in 1148 bytes} [Sun Jul 31 01:03:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:06.666542 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c341225-ab63-4dd9-aff2-610b6b0b670d None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:06.669084 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549c7db-8bf6-4c02-9e9b-c45d420aa928 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:06.669441 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549c7db-8bf6-4c02-9e9b-c45d420aa928 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:06.670670 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549c7db-8bf6-4c02-9e9b-c45d420aa928 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:06.672156 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 309/601] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:06.672764 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549c7db-8bf6-4c02-9e9b-c45d420aa928 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:06.710230 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb8ded-ebca-4a7a-a55a-709439f5deef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:06.710856 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb8ded-ebca-4a7a-a55a-709439f5deef None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:06.711183 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb8ded-ebca-4a7a-a55a-709439f5deef None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:06.711457 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb8ded-ebca-4a7a-a55a-709439f5deef None admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:06.712202 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb8ded-ebca-4a7a-a55a-709439f5deef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:06.712508 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb8ded-ebca-4a7a-a55a-709439f5deef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:06.713898 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb8ded-ebca-4a7a-a55a-709439f5deef None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:06.716610 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:06.729794 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 293/602] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:06.729794 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb8ded-ebca-4a7a-a55a-709439f5deef None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:06.785398 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549c7db-8bf6-4c02-9e9b-c45d420aa928 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:06.821772 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322498b-e4c6-40b5-958f-2fe5ab694a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:06.822379 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322498b-e4c6-40b5-958f-2fe5ab694a2f None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:06.822655 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322498b-e4c6-40b5-958f-2fe5ab694a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:06.822927 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322498b-e4c6-40b5-958f-2fe5ab694a2f None admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:06.823702 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a322498b-e4c6-40b5-958f-2fe5ab694a2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:06.824001 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a322498b-e4c6-40b5-958f-2fe5ab694a2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:06.825424 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a322498b-e4c6-40b5-958f-2fe5ab694a2f None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:06.833884 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:06.838252 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 310/603] 10.222.0.60 () {56 vars in 1148 bytes} [Sun Jul 31 01:03:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:06.839782 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7d573-deca-4a4a-bb6e-0ccb4d2c6f2b None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:06.840067 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7d573-deca-4a4a-bb6e-0ccb4d2c6f2b None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:06.840341 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7d573-deca-4a4a-bb6e-0ccb4d2c6f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:06.845991 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb8ded-ebca-4a7a-a55a-709439f5deef None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:06.858430 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-b1e7d573-deca-4a4a-bb6e-0ccb4d2c6f2b None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:06.859662 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-b1e7d573-deca-4a4a-bb6e-0ccb4d2c6f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:06.886647 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d224a-65ec-4544-aaaf-8efb8cd0630c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:06.887340 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d224a-65ec-4544-aaaf-8efb8cd0630c None admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:06.887636 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d224a-65ec-4544-aaaf-8efb8cd0630c None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:06.887926 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d224a-65ec-4544-aaaf-8efb8cd0630c None admin] PATH_INFO: `/v3/projects/b931b81a237949aa845891d4bb5aa1c0/users/fdebcb0a2a7548a09b3e9d3cf085e40e/roles/a5d1b78d4ec146848dfa667303603262` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:06.904400 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d224a-65ec-4544-aaaf-8efb8cd0630c None admin] RBAC: Authorizing `identity:create_grant(project_id=b931b81a237949aa845891d4bb5aa1c0, user_id=fdebcb0a2a7548a09b3e9d3cf085e40e, role_id=a5d1b78d4ec146848dfa667303603262)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:06.905903 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d224a-65ec-4544-aaaf-8efb8cd0630c None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:06.931517 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 294/604] 10.222.0.60 () {58 vars in 1439 bytes} [Sun Jul 31 01:03:06 2022] PUT /identity/v3/projects/b931b81a237949aa845891d4bb5aa1c0/users/fdebcb0a2a7548a09b3e9d3cf085e40e/roles/a5d1b78d4ec146848dfa667303603262 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:03:06.931517 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d224a-65ec-4544-aaaf-8efb8cd0630c None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:06.948239 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 311/605] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:03:06.949230 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7d573-deca-4a4a-bb6e-0ccb4d2c6f2b None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:07.004365 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:07.055377 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d224a-65ec-4544-aaaf-8efb8cd0630c None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:07.074110 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7d573-deca-4a4a-bb6e-0ccb4d2c6f2b None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:07.093279 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874e15f-a073-4337-9a04-59bf7d1a8b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:07.093943 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874e15f-a073-4337-9a04-59bf7d1a8b4a None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:07.094215 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874e15f-a073-4337-9a04-59bf7d1a8b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:07.094487 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874e15f-a073-4337-9a04-59bf7d1a8b4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:07.101693 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f874e15f-a073-4337-9a04-59bf7d1a8b4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:07.103146 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f874e15f-a073-4337-9a04-59bf7d1a8b4a None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:07.112905 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34a862-4825-4751-bdbc-e3d3bd6967f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:07.113593 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34a862-4825-4751-bdbc-e3d3bd6967f2 None admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:07.113873 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34a862-4825-4751-bdbc-e3d3bd6967f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:07.114149 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34a862-4825-4751-bdbc-e3d3bd6967f2 None admin] PATH_INFO: `/v3/projects/b931b81a237949aa845891d4bb5aa1c0/users/a1943ab629b6411d81327a845b77c8c1/roles/a5d1b78d4ec146848dfa667303603262` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:07.115460 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-f874e15f-a073-4337-9a04-59bf7d1a8b4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:07.115460 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:07.115460 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:07.115460 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:07.115460 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:07.115460 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:07.115460 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:07.115460 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:07.115460 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:07.115460 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:07.115460 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:07.115460 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:07.115460 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:03:07.115460 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:03:07.115460 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:03:07.116351 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:03:07.116351 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:07.116351 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:07.116351 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:07.116351 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:07.116351 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:07.116351 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:07.116351 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:07.116351 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:07.116351 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:07.116351 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:07.116351 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:07.116351 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:07.116351 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:07.116351 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:07.116351 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:07.116351 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:07.117239 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:03:07.117239 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:03:07.117239 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:03:07.117239 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:03:07.117239 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:03:07.117239 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:03:07.117239 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:07.117239 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:07.117239 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 295/606] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:03:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:07.118124 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874e15f-a073-4337-9a04-59bf7d1a8b4a None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:07.122186 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:07.137859 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34a862-4825-4751-bdbc-e3d3bd6967f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=b931b81a237949aa845891d4bb5aa1c0, user_id=a1943ab629b6411d81327a845b77c8c1, role_id=a5d1b78d4ec146848dfa667303603262)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:07.139528 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34a862-4825-4751-bdbc-e3d3bd6967f2 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:07.164192 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 312/607] 10.222.0.60 () {58 vars in 1439 bytes} [Sun Jul 31 01:03:06 2022] PUT /identity/v3/projects/b931b81a237949aa845891d4bb5aa1c0/users/a1943ab629b6411d81327a845b77c8c1/roles/a5d1b78d4ec146848dfa667303603262 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:03:07.164192 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34a862-4825-4751-bdbc-e3d3bd6967f2 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:07.294989 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874e15f-a073-4337-9a04-59bf7d1a8b4a None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:07.333783 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac61e0-80da-4ef2-ba2a-155349d42d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:07.334749 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac61e0-80da-4ef2-ba2a-155349d42d3e None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:07.335267 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac61e0-80da-4ef2-ba2a-155349d42d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:07.335753 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac61e0-80da-4ef2-ba2a-155349d42d3e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:07.349358 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac61e0-80da-4ef2-ba2a-155349d42d3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:03:07.355402 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-d6ac61e0-80da-4ef2-ba2a-155349d42d3e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:03:07.355402 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:07.355402 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:07.355402 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:07.355402 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:07.355402 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:07.355402 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:07.355402 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:07.355402 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:07.355402 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:07.355402 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:07.355402 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:07.355402 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:03:07.355402 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:03:07.355402 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:03:07.355402 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:03:07.356488 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:03:07.356488 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:03:07.356488 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:03:07.356488 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:03:07.356488 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:07.356488 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:07.356488 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:07.356488 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:07.356488 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:07.356488 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:07.356488 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:07.356488 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:07.356488 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:07.356488 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:07.356488 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:07.356488 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:07.357351 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:07.357351 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:07.357351 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:07.357351 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:07.357351 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:03:07.357351 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:03:07.357351 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:03:07.357351 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:03:07.357351 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:03:07.357351 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:03:07.357351 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:03:07.357351 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:07.360408 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:07.360958 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 296/608] 10.222.0.60 () {56 vars in 1102 bytes} [Sun Jul 31 01:03:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:07.366090 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac61e0-80da-4ef2-ba2a-155349d42d3e None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:07.392730 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34a862-4825-4751-bdbc-e3d3bd6967f2 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:07.429345 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2aedd-c7f0-42f9-8a6b-a5bf172ba6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:07.430330 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2aedd-c7f0-42f9-8a6b-a5bf172ba6d0 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:07.430806 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2aedd-c7f0-42f9-8a6b-a5bf172ba6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:07.431302 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2aedd-c7f0-42f9-8a6b-a5bf172ba6d0 None admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:07.434258 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2aedd-c7f0-42f9-8a6b-a5bf172ba6d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:07.434781 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2aedd-c7f0-42f9-8a6b-a5bf172ba6d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:07.434888 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:07.437583 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2aedd-c7f0-42f9-8a6b-a5bf172ba6d0 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:07.451115 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 313/609] 10.222.0.60 () {56 vars in 1148 bytes} [Sun Jul 31 01:03:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:07.460461 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2aedd-c7f0-42f9-8a6b-a5bf172ba6d0 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:07.477472 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac61e0-80da-4ef2-ba2a-155349d42d3e None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:07.513277 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173caff-cebf-46e4-8075-907b4d38dc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:07.513635 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173caff-cebf-46e4-8075-907b4d38dc7b None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:07.513810 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173caff-cebf-46e4-8075-907b4d38dc7b None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:07.514124 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173caff-cebf-46e4-8075-907b4d38dc7b None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:07.514907 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173caff-cebf-46e4-8075-907b4d38dc7b None admin] RBAC: Adding query filter params (name=service) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:07.515209 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173caff-cebf-46e4-8075-907b4d38dc7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:07.516618 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173caff-cebf-46e4-8075-907b4d38dc7b None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:07.529990 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 297/610] 10.222.0.60 () {56 vars in 1103 bytes} [Sun Jul 31 01:03:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:03:07.531273 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173caff-cebf-46e4-8075-907b4d38dc7b None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:07.584262 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2aedd-c7f0-42f9-8a6b-a5bf172ba6d0 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:07.618802 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aee845-e0de-480c-937c-cf4876693ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:07.619865 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aee845-e0de-480c-937c-cf4876693ad8 None admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:07.620365 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aee845-e0de-480c-937c-cf4876693ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:07.620846 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aee845-e0de-480c-937c-cf4876693ad8 None admin] PATH_INFO: `/v3/projects/b931b81a237949aa845891d4bb5aa1c0/users/81117154f6d1474c805a69c5617c307d/roles/a5d1b78d4ec146848dfa667303603262` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:07.629978 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:07.637396 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173caff-cebf-46e4-8075-907b4d38dc7b None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:07.637809 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aee845-e0de-480c-937c-cf4876693ad8 None admin] RBAC: Authorizing `identity:create_grant(project_id=b931b81a237949aa845891d4bb5aa1c0, user_id=81117154f6d1474c805a69c5617c307d, role_id=a5d1b78d4ec146848dfa667303603262)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:07.640142 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aee845-e0de-480c-937c-cf4876693ad8 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:07.655965 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 314/611] 10.222.0.60 () {58 vars in 1439 bytes} [Sun Jul 31 01:03:07 2022] PUT /identity/v3/projects/b931b81a237949aa845891d4bb5aa1c0/users/81117154f6d1474c805a69c5617c307d/roles/a5d1b78d4ec146848dfa667303603262 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:03:07.667183 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:07.678535 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe410cb8-199b-4366-a76c-6a70680048cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:07.679248 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe410cb8-199b-4366-a76c-6a70680048cd None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:07.679554 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe410cb8-199b-4366-a76c-6a70680048cd None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:07.679831 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe410cb8-199b-4366-a76c-6a70680048cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:07.692441 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe410cb8-199b-4366-a76c-6a70680048cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:07.693959 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe410cb8-199b-4366-a76c-6a70680048cd None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:07.710236 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-fe410cb8-199b-4366-a76c-6a70680048cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:07.710236 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:07.710236 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:07.710236 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:07.710236 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:07.710236 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:07.710236 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:07.710236 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:07.710236 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:07.710236 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:07.710236 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:07.710236 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:07.710236 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:07.710236 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:07.710236 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:07.711212 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:07.711212 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:07.711212 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:07.711212 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:07.711212 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:07.711212 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:07.711212 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:07.711212 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:07.711212 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:07.711212 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:07.711212 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:07.711212 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:07.711212 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:07.711212 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:07.711212 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:07.711212 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:07.711212 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:07.712144 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:07.712144 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:07.712144 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:07.712144 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:07.715618 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 298/612] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:07.718127 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aee845-e0de-480c-937c-cf4876693ad8 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:07.832214 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aee845-e0de-480c-937c-cf4876693ad8 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:07.882249 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ade151-651d-4752-ad86-f1bd2143ac29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:07.882898 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ade151-651d-4752-ad86-f1bd2143ac29 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:07.883173 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ade151-651d-4752-ad86-f1bd2143ac29 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:07.883443 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ade151-651d-4752-ad86-f1bd2143ac29 None admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:07.884217 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ade151-651d-4752-ad86-f1bd2143ac29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:07.884516 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ade151-651d-4752-ad86-f1bd2143ac29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:07.885924 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ade151-651d-4752-ad86-f1bd2143ac29 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:07.901382 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 315/613] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:07.907665 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe410cb8-199b-4366-a76c-6a70680048cd None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:08.014161 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe410cb8-199b-4366-a76c-6a70680048cd None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:08.048473 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfbbbb6-8510-4649-8879-1f978d1454c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:08.049192 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbbbb6-8510-4649-8879-1f978d1454c2 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:08.049467 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbbbb6-8510-4649-8879-1f978d1454c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:08.049737 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbbbb6-8510-4649-8879-1f978d1454c2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:08.058019 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfbbbb6-8510-4649-8879-1f978d1454c2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:08.059677 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfbbbb6-8510-4649-8879-1f978d1454c2 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:08.072632 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-2bfbbbb6-8510-4649-8879-1f978d1454c2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 31 01:03:08.072632 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:08.072632 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:08.072632 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:08.072632 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:08.072632 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:08.072632 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:08.072632 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:08.072632 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:08.072632 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:08.072632 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:08.072632 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:08.072632 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:03:08.072632 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:03:08.072632 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:03:08.072632 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:03:08.073606 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:08.073606 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:08.073606 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:03:08.073606 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:08.073606 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:03:08.073606 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:08.073606 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:08.073606 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:08.073606 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:08.073606 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:08.073606 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:08.073606 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:08.073606 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:08.073606 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:08.073606 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:08.073606 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:08.073606 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:08.073606 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:08.074541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:08.074541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:08.074541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:03:08.074541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:03:08.074541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:03:08.074541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:03:08.074541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:03:08.074541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:03:08.074541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 31 01:03:08.074541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:08.078682 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 299/614] 10.222.0.60 () {56 vars in 1096 bytes} [Sun Jul 31 01:03:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:08.080180 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ade151-651d-4752-ad86-f1bd2143ac29 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:08.133696 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:08.191957 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ade151-651d-4752-ad86-f1bd2143ac29 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:08.232458 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6721f879-14d0-490d-866a-e38bcfb8982f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:08.233122 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721f879-14d0-490d-866a-e38bcfb8982f None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:08.233401 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721f879-14d0-490d-866a-e38bcfb8982f None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:08.233670 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721f879-14d0-490d-866a-e38bcfb8982f None admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:08.234466 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6721f879-14d0-490d-866a-e38bcfb8982f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:08.234767 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6721f879-14d0-490d-866a-e38bcfb8982f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:08.236240 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6721f879-14d0-490d-866a-e38bcfb8982f None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:08.263134 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 316/615] 10.222.0.60 () {56 vars in 1135 bytes} [Sun Jul 31 01:03:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:08.268760 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfbbbb6-8510-4649-8879-1f978d1454c2 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:08.299879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e18ac-a424-47bd-9f2a-9763ce60f5e6 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:08.300194 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e18ac-a424-47bd-9f2a-9763ce60f5e6 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:08.300428 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e18ac-a424-47bd-9f2a-9763ce60f5e6 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:08.302028 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 317/616] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:08.306953 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d030a6-1b43-4668-8496-5627bdc61ad8 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:08.307231 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d030a6-1b43-4668-8496-5627bdc61ad8 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:08.307514 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d030a6-1b43-4668-8496-5627bdc61ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:08.334213 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-68d030a6-1b43-4668-8496-5627bdc61ad8 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:08.335417 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-68d030a6-1b43-4668-8496-5627bdc61ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:08.358437 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:08.418376 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfbbbb6-8510-4649-8879-1f978d1454c2 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:08.453527 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f54d4b9-af8b-4c35-b6b4-1ef978a5209f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:08.454187 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54d4b9-af8b-4c35-b6b4-1ef978a5209f None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:08.454462 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54d4b9-af8b-4c35-b6b4-1ef978a5209f None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:08.454731 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54d4b9-af8b-4c35-b6b4-1ef978a5209f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:08.467070 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f54d4b9-af8b-4c35-b6b4-1ef978a5209f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:08.468588 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f54d4b9-af8b-4c35-b6b4-1ef978a5209f None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:08.484378 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-1f54d4b9-af8b-4c35-b6b4-1ef978a5209f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:08.484378 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:08.484378 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:08.484378 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:08.484378 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:08.484378 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:08.484378 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:08.484378 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:08.484378 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:08.484378 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:08.484378 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:08.484378 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:08.484378 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:08.484378 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:08.484378 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:08.485318 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:08.485318 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:08.485318 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:08.485318 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:08.485318 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:08.485318 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:08.485318 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:08.485318 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:08.485318 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:08.485318 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:08.485318 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:08.485318 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:08.485318 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:08.485318 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:08.485318 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:08.485318 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:08.485318 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:08.486267 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:08.486267 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:08.486267 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:08.486267 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:08.490043 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 300/617] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:08.492061 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f54d4b9-af8b-4c35-b6b4-1ef978a5209f None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:08.565211 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 318/618] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:03:08.591852 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:08.600219 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f54d4b9-af8b-4c35-b6b4-1ef978a5209f None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:08.600584 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d030a6-1b43-4668-8496-5627bdc61ad8 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:08.637632 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361faa4-e6e0-4b17-be50-837086931617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:08.638259 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361faa4-e6e0-4b17-be50-837086931617 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:08.638534 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361faa4-e6e0-4b17-be50-837086931617 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:08.638809 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361faa4-e6e0-4b17-be50-837086931617 None admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:08.639591 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a361faa4-e6e0-4b17-be50-837086931617 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:08.639892 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a361faa4-e6e0-4b17-be50-837086931617 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:08.641857 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a361faa4-e6e0-4b17-be50-837086931617 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:08.660118 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 301/619] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:03:08.662073 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361faa4-e6e0-4b17-be50-837086931617 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:08.723500 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:08.776674 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361faa4-e6e0-4b17-be50-837086931617 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:08.825242 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d030a6-1b43-4668-8496-5627bdc61ad8 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:08.842985 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d798da-f41a-4982-88b8-997ec59e03e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:08.843677 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d798da-f41a-4982-88b8-997ec59e03e8 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:08.843960 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d798da-f41a-4982-88b8-997ec59e03e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:08.844235 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d798da-f41a-4982-88b8-997ec59e03e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:08.857344 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d798da-f41a-4982-88b8-997ec59e03e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:08.858845 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d798da-f41a-4982-88b8-997ec59e03e8 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:08.860039 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9dc9b-f70c-406d-9799-485636a51187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:08.860683 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9dc9b-f70c-406d-9799-485636a51187 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:08.860960 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9dc9b-f70c-406d-9799-485636a51187 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:08.861231 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9dc9b-f70c-406d-9799-485636a51187 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:08.871643 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d9dc9b-f70c-406d-9799-485636a51187 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:03:08.876556 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-35d9dc9b-f70c-406d-9799-485636a51187 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:03:08.876556 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:08.876556 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:08.876556 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:08.876556 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:08.876556 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:08.876556 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:08.876556 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:08.876556 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:08.876556 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:08.876556 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:08.876556 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:08.876556 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:03:08.876556 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:03:08.876556 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:03:08.876556 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:03:08.878023 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:03:08.878023 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:03:08.878023 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:03:08.878023 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:03:08.878023 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:08.878023 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:08.878023 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:08.878023 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:08.878023 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:08.878023 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:08.878023 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:08.878023 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:08.878023 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:08.878023 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:08.878023 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:08.878023 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:08.878855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:08.878855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:08.878855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:08.878855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:08.878855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:03:08.878855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:03:08.878855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:03:08.878855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:03:08.878855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:03:08.878855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:03:08.878855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:03:08.878855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:08.878855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 319/620] 10.222.0.60 () {56 vars in 1102 bytes} [Sun Jul 31 01:03:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:08.882049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-06d798da-f41a-4982-88b8-997ec59e03e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:08.882049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:08.882049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:08.882049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:08.882049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:08.882049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:08.882049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:08.882049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:08.882049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:08.882049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:08.882049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:08.882049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:08.882049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:03:08.882049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:03:08.882049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:03:08.883992 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:03:08.883992 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:08.883992 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:08.883992 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:08.883992 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:08.883992 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:08.883992 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:08.883992 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:08.883992 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:08.883992 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:08.883992 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:08.883992 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:08.883992 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:08.883992 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:08.883992 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:08.883992 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:08.883992 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:08.886055 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:03:08.886055 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:03:08.886055 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:03:08.886055 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:03:08.886055 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:03:08.886055 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:03:08.886055 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:08.886055 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:08.887057 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 302/621] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:03:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:08.892594 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9dc9b-f70c-406d-9799-485636a51187 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:08.892791 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d798da-f41a-4982-88b8-997ec59e03e8 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:08.936003 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:08.995691 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d798da-f41a-4982-88b8-997ec59e03e8 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:09.037108 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c8b98-f9e5-4c9d-a986-b1fbbd29df7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:09.037879 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c8b98-f9e5-4c9d-a986-b1fbbd29df7a None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:09.038208 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c8b98-f9e5-4c9d-a986-b1fbbd29df7a None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:09.038477 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c8b98-f9e5-4c9d-a986-b1fbbd29df7a None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:09.039205 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c8b98-f9e5-4c9d-a986-b1fbbd29df7a None admin] RBAC: Adding query filter params (name=service) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:09.039517 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c8b98-f9e5-4c9d-a986-b1fbbd29df7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:09.040888 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c8b98-f9e5-4c9d-a986-b1fbbd29df7a None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:09.058928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 303/622] 10.222.0.60 () {56 vars in 1103 bytes} [Sun Jul 31 01:03:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:03:09.065044 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c8b98-f9e5-4c9d-a986-b1fbbd29df7a None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:09.090246 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:09.105343 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9dc9b-f70c-406d-9799-485636a51187 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:09.158153 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:09.184818 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c3083-b965-4f7d-b504-7a8acfdc62cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:09.185451 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c3083-b965-4f7d-b504-7a8acfdc62cc None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:09.185759 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c3083-b965-4f7d-b504-7a8acfdc62cc None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:09.186027 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c3083-b965-4f7d-b504-7a8acfdc62cc None admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:09.186787 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c3083-b965-4f7d-b504-7a8acfdc62cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:09.187085 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c3083-b965-4f7d-b504-7a8acfdc62cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:09.188559 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c3083-b965-4f7d-b504-7a8acfdc62cc None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:09.201657 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c8b98-f9e5-4c9d-a986-b1fbbd29df7a None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:09.216487 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 320/623] 10.222.0.60 () {56 vars in 1148 bytes} [Sun Jul 31 01:03:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:09.226974 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c3083-b965-4f7d-b504-7a8acfdc62cc None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:09.272780 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77064627-5033-4e3d-a900-e56098ee5e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:09.273431 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77064627-5033-4e3d-a900-e56098ee5e47 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:09.273704 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77064627-5033-4e3d-a900-e56098ee5e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:09.273973 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77064627-5033-4e3d-a900-e56098ee5e47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:09.285606 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77064627-5033-4e3d-a900-e56098ee5e47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:09.287049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77064627-5033-4e3d-a900-e56098ee5e47 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:09.303063 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-77064627-5033-4e3d-a900-e56098ee5e47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:09.303063 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:09.303063 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:09.303063 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:09.303063 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:09.303063 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:09.303063 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:09.303063 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:09.303063 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:09.303063 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:09.303063 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:09.303063 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:09.303063 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:09.303063 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:09.303063 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:09.305193 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:09.305193 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:09.305193 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:09.305193 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:09.305193 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:09.305193 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:09.305193 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:09.305193 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:09.305193 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:09.305193 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:09.305193 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:09.305193 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:09.305193 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:09.305193 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:09.305193 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:09.305193 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:09.305193 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:09.307269 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:09.307269 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:09.307269 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:09.307269 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:09.309757 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 304/624] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:03:09.311200 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77064627-5033-4e3d-a900-e56098ee5e47 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:09.445146 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c3083-b965-4f7d-b504-7a8acfdc62cc None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:09.458851 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77064627-5033-4e3d-a900-e56098ee5e47 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:09.503717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:09.506983 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0614e0-c391-4c44-b0ee-d50fde5319e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:09.507697 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0614e0-c391-4c44-b0ee-d50fde5319e1 None admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:09.507973 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0614e0-c391-4c44-b0ee-d50fde5319e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:09.508245 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0614e0-c391-4c44-b0ee-d50fde5319e1 None admin] PATH_INFO: `/v3/projects/b931b81a237949aa845891d4bb5aa1c0/users/0c8c98c1e2d24de89c7d07753fae02e5/roles/a5d1b78d4ec146848dfa667303603262` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:09.523558 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f67be-2ef7-49f0-908f-15695eb5b077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:09.524122 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f67be-2ef7-49f0-908f-15695eb5b077 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:09.524396 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f67be-2ef7-49f0-908f-15695eb5b077 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:09.524665 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f67be-2ef7-49f0-908f-15695eb5b077 None admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:09.525367 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f67be-2ef7-49f0-908f-15695eb5b077 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:09.526070 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f67be-2ef7-49f0-908f-15695eb5b077 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:09.528503 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f67be-2ef7-49f0-908f-15695eb5b077 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:09.532759 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0614e0-c391-4c44-b0ee-d50fde5319e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=b931b81a237949aa845891d4bb5aa1c0, user_id=0c8c98c1e2d24de89c7d07753fae02e5, role_id=a5d1b78d4ec146848dfa667303603262)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:09.534439 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0614e0-c391-4c44-b0ee-d50fde5319e1 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:09.542854 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 305/625] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:09.550292 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f67be-2ef7-49f0-908f-15695eb5b077 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:09.557881 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 321/626] 10.222.0.60 () {58 vars in 1439 bytes} [Sun Jul 31 01:03:09 2022] PUT /identity/v3/projects/b931b81a237949aa845891d4bb5aa1c0/users/0c8c98c1e2d24de89c7d07753fae02e5/roles/a5d1b78d4ec146848dfa667303603262 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:03:09.626093 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85166b3b-a558-436f-9559-dfb5ac9dc3d3 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:09.626419 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85166b3b-a558-436f-9559-dfb5ac9dc3d3 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:09.626645 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85166b3b-a558-436f-9559-dfb5ac9dc3d3 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:09.636831 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 322/627] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:09 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:03:09.642531 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a1482-a125-46d5-92d5-302b13ddded6 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:09.642829 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a1482-a125-46d5-92d5-302b13ddded6 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:09.643088 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a1482-a125-46d5-92d5-302b13ddded6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:09.668337 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:09.688060 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-9d6a1482-a125-46d5-92d5-302b13ddded6 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:09.690088 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-9d6a1482-a125-46d5-92d5-302b13ddded6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:09.712043 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f67be-2ef7-49f0-908f-15695eb5b077 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:09.758716 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754c45a-848d-44f6-bf98-5fff1e79b009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:09.759396 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754c45a-848d-44f6-bf98-5fff1e79b009 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:09.759743 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754c45a-848d-44f6-bf98-5fff1e79b009 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:09.760011 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754c45a-848d-44f6-bf98-5fff1e79b009 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:09.768140 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754c45a-848d-44f6-bf98-5fff1e79b009 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:09.769605 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754c45a-848d-44f6-bf98-5fff1e79b009 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:09.774336 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 323/628] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:03:09.775386 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a86550-291d-44cb-a428-187e47388e19 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:09.775892 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a86550-291d-44cb-a428-187e47388e19 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:09.776008 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a86550-291d-44cb-a428-187e47388e19 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:09.777396 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 324/629] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:09.783450 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60431ded-3776-49b8-8fb9-0f5bae4348d3 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:09.783755 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60431ded-3776-49b8-8fb9-0f5bae4348d3 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:09.784028 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60431ded-3776-49b8-8fb9-0f5bae4348d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:09.792290 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-0754c45a-848d-44f6-bf98-5fff1e79b009 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:03:09.792290 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:09.792290 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:09.792290 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:09.792290 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:09.792290 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:09.792290 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:09.792290 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:09.792290 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:09.792290 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:09.792290 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:09.792290 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:09.792290 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:03:09.792290 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:03:09.792290 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:03:09.792290 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:03:09.793540 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:09.793540 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:09.793540 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:03:09.793540 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:09.793540 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:03:09.793540 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:09.793540 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:09.793540 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:09.793540 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:09.793540 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:09.793540 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:09.793540 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:09.793540 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:09.793540 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:09.793540 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:09.793540 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:09.793540 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:09.793540 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:09.794923 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:09.794923 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:09.794923 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:03:09.794923 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:03:09.794923 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:03:09.794923 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:03:09.794923 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:03:09.794923 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:03:09.794923 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:03:09.794923 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:09.794923 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 306/630] 10.222.0.60 () {56 vars in 1093 bytes} [Sun Jul 31 01:03:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:09.803702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754c45a-848d-44f6-bf98-5fff1e79b009 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:09.817592 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-60431ded-3776-49b8-8fb9-0f5bae4348d3 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:09.818729 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-60431ded-3776-49b8-8fb9-0f5bae4348d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:09.868144 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:09.894241 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 325/631] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:03:09.895650 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60431ded-3776-49b8-8fb9-0f5bae4348d3 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:09.927691 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754c45a-848d-44f6-bf98-5fff1e79b009 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:09.962875 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8e43f-4d60-4644-83f5-9357e840306d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:09.963722 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8e43f-4d60-4644-83f5-9357e840306d None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:09.964003 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8e43f-4d60-4644-83f5-9357e840306d None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:09.964332 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8e43f-4d60-4644-83f5-9357e840306d None admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:09.965136 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc8e43f-4d60-4644-83f5-9357e840306d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:09.965441 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc8e43f-4d60-4644-83f5-9357e840306d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:09.966867 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc8e43f-4d60-4644-83f5-9357e840306d None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:09.967125 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:09.985855 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 307/632] 10.222.0.60 () {56 vars in 1133 bytes} [Sun Jul 31 01:03:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:09.986717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8e43f-4d60-4644-83f5-9357e840306d None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:10.005218 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60431ded-3776-49b8-8fb9-0f5bae4348d3 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:10.044123 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e50826-5642-4fac-bdd6-e4823e2f73ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:10.045367 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e50826-5642-4fac-bdd6-e4823e2f73ea None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:10.045869 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e50826-5642-4fac-bdd6-e4823e2f73ea None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:10.046345 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e50826-5642-4fac-bdd6-e4823e2f73ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:10.057884 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e50826-5642-4fac-bdd6-e4823e2f73ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:03:10.063626 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-09e50826-5642-4fac-bdd6-e4823e2f73ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:03:10.063626 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:10.063626 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:10.063626 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:10.063626 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:10.063626 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:10.063626 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:10.063626 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:10.063626 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:10.063626 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:10.063626 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:10.063626 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:10.063626 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:03:10.063626 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:03:10.063626 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:03:10.063626 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:03:10.064544 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:03:10.064544 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:03:10.064544 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:03:10.064544 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:03:10.064544 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:10.064544 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:10.064544 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:10.064544 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:10.064544 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:10.064544 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:10.064544 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:10.064544 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:10.064544 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:10.064544 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:10.064544 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:10.064544 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:10.065380 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:10.065380 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:10.065380 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:10.065380 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:10.065380 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:03:10.065380 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:03:10.065380 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:03:10.065380 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:03:10.065380 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:03:10.065380 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:03:10.065380 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:03:10.065380 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:10.072718 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 326/633] 10.222.0.60 () {56 vars in 1102 bytes} [Sun Jul 31 01:03:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:10.073798 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e50826-5642-4fac-bdd6-e4823e2f73ea None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:10.100758 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8e43f-4d60-4644-83f5-9357e840306d None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:10.102605 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:10.138922 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9441d-1634-41ae-91e0-185d03ffc5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:10.139625 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9441d-1634-41ae-91e0-185d03ffc5bc None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:10.139938 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9441d-1634-41ae-91e0-185d03ffc5bc None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:10.140215 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9441d-1634-41ae-91e0-185d03ffc5bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:10.151038 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9441d-1634-41ae-91e0-185d03ffc5bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:03:10.156294 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-d0d9441d-1634-41ae-91e0-185d03ffc5bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:03:10.156294 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:10.156294 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:10.156294 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:10.156294 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:10.156294 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:10.156294 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:10.156294 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:10.156294 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:10.156294 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:10.156294 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:10.156294 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:10.156294 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:03:10.156294 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:03:10.156294 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:03:10.156294 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:03:10.157222 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:03:10.157222 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:03:10.157222 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:03:10.157222 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:03:10.157222 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:10.157222 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:10.157222 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:10.157222 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:10.157222 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:10.157222 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:10.157222 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:10.157222 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:10.157222 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:10.157222 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:10.157222 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:10.157222 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:10.158460 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:10.158460 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:10.158460 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:10.158460 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:10.158460 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:03:10.158460 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:03:10.158460 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:03:10.158460 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:03:10.158460 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:03:10.158460 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:03:10.158460 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:03:10.158460 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:10.158460 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 308/634] 10.222.0.60 () {56 vars in 1102 bytes} [Sun Jul 31 01:03:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:10.159339 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9441d-1634-41ae-91e0-185d03ffc5bc None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:10.189193 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e50826-5642-4fac-bdd6-e4823e2f73ea None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:10.216838 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:10.226798 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f834d31-61a9-4c36-a51d-b8eda0911e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:10.227994 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f834d31-61a9-4c36-a51d-b8eda0911e92 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:10.228548 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f834d31-61a9-4c36-a51d-b8eda0911e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:10.229007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f834d31-61a9-4c36-a51d-b8eda0911e92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:10.263397 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9441d-1634-41ae-91e0-185d03ffc5bc None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:10.301063 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b1960-002c-4da0-aaa7-cd6dac0af4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:10.301258 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b1960-002c-4da0-aaa7-cd6dac0af4e5 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:10.301544 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b1960-002c-4da0-aaa7-cd6dac0af4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:10.301823 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b1960-002c-4da0-aaa7-cd6dac0af4e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:10.302599 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b1960-002c-4da0-aaa7-cd6dac0af4e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:10.302910 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b1960-002c-4da0-aaa7-cd6dac0af4e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:10.304287 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f834d31-61a9-4c36-a51d-b8eda0911e92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:10.304414 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b1960-002c-4da0-aaa7-cd6dac0af4e5 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:10.306166 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f834d31-61a9-4c36-a51d-b8eda0911e92 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:10.317650 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 309/635] 10.222.0.60 () {56 vars in 1103 bytes} [Sun Jul 31 01:03:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:10.317650 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b1960-002c-4da0-aaa7-cd6dac0af4e5 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:10.344194 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:10.423768 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 327/636] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:03:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:03:10.424763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f834d31-61a9-4c36-a51d-b8eda0911e92 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:10.427181 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b1960-002c-4da0-aaa7-cd6dac0af4e5 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:10.451312 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:10.461313 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71873362-bc8f-4128-8bfd-f9dd788998f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:10.461968 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71873362-bc8f-4128-8bfd-f9dd788998f9 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:10.462248 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71873362-bc8f-4128-8bfd-f9dd788998f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:10.462519 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71873362-bc8f-4128-8bfd-f9dd788998f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:10.463237 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71873362-bc8f-4128-8bfd-f9dd788998f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:10.463642 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71873362-bc8f-4128-8bfd-f9dd788998f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:10.465027 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71873362-bc8f-4128-8bfd-f9dd788998f9 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:10.473444 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 310/637] 10.222.0.60 () {56 vars in 1103 bytes} [Sun Jul 31 01:03:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:10.474604 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66a20d-223d-441f-b9c5-a4457e9c20a5 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:10.474887 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66a20d-223d-441f-b9c5-a4457e9c20a5 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:10.475155 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66a20d-223d-441f-b9c5-a4457e9c20a5 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:10.480476 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 311/638] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:10.481226 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f66a20d-223d-441f-b9c5-a4457e9c20a5 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:10.530420 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f834d31-61a9-4c36-a51d-b8eda0911e92 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:10.564500 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efea859-aa29-4cbe-abe0-f8af8b89374a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:10.565059 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efea859-aa29-4cbe-abe0-f8af8b89374a None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:10.565332 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efea859-aa29-4cbe-abe0-f8af8b89374a None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:10.565597 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efea859-aa29-4cbe-abe0-f8af8b89374a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:10.573052 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:10.576211 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efea859-aa29-4cbe-abe0-f8af8b89374a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:10.577663 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efea859-aa29-4cbe-abe0-f8af8b89374a None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:10.590637 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f66a20d-223d-441f-b9c5-a4457e9c20a5 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:10.593934 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-9efea859-aa29-4cbe-abe0-f8af8b89374a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:10.593934 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:10.593934 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:10.593934 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:10.593934 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:10.593934 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:10.593934 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:10.593934 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:10.593934 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:10.593934 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:10.593934 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:10.593934 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:10.593934 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:10.593934 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:10.593934 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:10.594897 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:10.594897 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:10.594897 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:10.594897 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:10.594897 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:10.594897 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:10.594897 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:10.594897 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:10.594897 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:10.594897 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:10.594897 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:10.594897 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:10.594897 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:10.594897 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:10.594897 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:10.594897 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:10.594897 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:10.595808 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:10.595808 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:10.595808 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:10.595808 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:10.600089 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 328/639] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:10.600674 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efea859-aa29-4cbe-abe0-f8af8b89374a None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:10.626294 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d1496d-fcfe-4300-982d-e52a28570e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:10.627223 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d1496d-fcfe-4300-982d-e52a28570e8d None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:10.627895 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d1496d-fcfe-4300-982d-e52a28570e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:10.628162 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d1496d-fcfe-4300-982d-e52a28570e8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:10.638820 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d1496d-fcfe-4300-982d-e52a28570e8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:10.640487 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d1496d-fcfe-4300-982d-e52a28570e8d None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:10.655621 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-f5d1496d-fcfe-4300-982d-e52a28570e8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:10.655621 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:10.655621 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:10.655621 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:10.655621 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:10.655621 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:10.655621 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:10.655621 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:10.655621 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:10.655621 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:10.655621 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:10.655621 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:10.655621 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:10.655621 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:10.655621 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:10.656556 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:10.656556 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:10.656556 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:10.656556 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:10.656556 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:10.656556 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:10.656556 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:10.656556 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:10.656556 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:10.656556 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:10.656556 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:10.656556 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:10.656556 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:10.656556 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:10.656556 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:10.656556 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:10.656556 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:10.657477 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:10.657477 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:10.657477 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:10.657477 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:10.657477 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 312/640] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:10.658153 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e5616-a694-461b-b9a7-b250871126fc None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:10.658153 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e5616-a694-461b-b9a7-b250871126fc None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:10.658460 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e5616-a694-461b-b9a7-b250871126fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:10.678508 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-6f6e5616-a694-461b-b9a7-b250871126fc None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:10.679761 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-6f6e5616-a694-461b-b9a7-b250871126fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:10.691079 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:10.717012 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efea859-aa29-4cbe-abe0-f8af8b89374a None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:10.759509 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 313/641] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:03:10.759509 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e5616-a694-461b-b9a7-b250871126fc None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:10.762446 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e365f1-f412-401d-91a4-80f57c242aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:10.763260 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e365f1-f412-401d-91a4-80f57c242aaa None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:10.763648 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e365f1-f412-401d-91a4-80f57c242aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:10.764094 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e365f1-f412-401d-91a4-80f57c242aaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:10.776042 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e365f1-f412-401d-91a4-80f57c242aaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:10.777718 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e365f1-f412-401d-91a4-80f57c242aaa None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:10.793005 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-52e365f1-f412-401d-91a4-80f57c242aaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:10.793005 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:10.793005 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:10.793005 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:10.793005 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:10.793005 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:10.793005 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:10.793005 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:10.793005 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:10.793005 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:10.793005 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:10.793005 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:10.793005 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:10.793005 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:10.793005 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:10.793964 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:10.793964 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:10.793964 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:10.793964 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:10.793964 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:10.793964 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:10.793964 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:10.793964 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:10.793964 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:10.793964 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:10.793964 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:10.793964 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:10.793964 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:10.793964 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:10.793964 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:10.793964 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:10.793964 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:10.794862 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:10.794862 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:10.794862 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:10.794862 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:10.799008 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 329/642] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:10.799663 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e365f1-f412-401d-91a4-80f57c242aaa None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:10.824241 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:10.865423 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e5616-a694-461b-b9a7-b250871126fc None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:10.901732 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa67b34-f0d9-459c-9b8d-30696c116830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:10.902363 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa67b34-f0d9-459c-9b8d-30696c116830 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:10.902631 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa67b34-f0d9-459c-9b8d-30696c116830 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:10.902911 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa67b34-f0d9-459c-9b8d-30696c116830 None admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:10.903628 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa67b34-f0d9-459c-9b8d-30696c116830 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:10.903937 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa67b34-f0d9-459c-9b8d-30696c116830 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:10.905442 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa67b34-f0d9-459c-9b8d-30696c116830 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:10.906943 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e365f1-f412-401d-91a4-80f57c242aaa None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:10.916535 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 314/643] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:10.917331 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa67b34-f0d9-459c-9b8d-30696c116830 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:10.939843 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:10.947860 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938ec2e-5929-4f21-ba27-32d013ad605b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:10.948684 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938ec2e-5929-4f21-ba27-32d013ad605b None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:10.949103 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938ec2e-5929-4f21-ba27-32d013ad605b None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:10.949592 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938ec2e-5929-4f21-ba27-32d013ad605b None admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:10.950542 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9938ec2e-5929-4f21-ba27-32d013ad605b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:10.951006 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9938ec2e-5929-4f21-ba27-32d013ad605b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:10.952457 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9938ec2e-5929-4f21-ba27-32d013ad605b None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:10.970249 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 330/644] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:10.970821 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938ec2e-5929-4f21-ba27-32d013ad605b None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:11.025612 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa67b34-f0d9-459c-9b8d-30696c116830 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:11.058250 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:11.066690 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0640e-2790-497f-9f49-74bee4deafee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:11.067047 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0640e-2790-497f-9f49-74bee4deafee None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:11.067310 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0640e-2790-497f-9f49-74bee4deafee None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:11.067620 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0640e-2790-497f-9f49-74bee4deafee None admin] PATH_INFO: `/v3/roles/service` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:11.074518 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938ec2e-5929-4f21-ba27-32d013ad605b None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:11.083046 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e0640e-2790-497f-9f49-74bee4deafee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:03:11.088474 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-08e0640e-2790-497f-9f49-74bee4deafee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:03:11.088474 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:11.088474 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:11.088474 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:11.088474 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:11.088474 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:11.088474 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:11.088474 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:11.088474 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:11.088474 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:11.088474 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:11.088474 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:11.088474 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:03:11.088474 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:03:11.088474 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:03:11.088474 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:03:11.089381 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:03:11.089381 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:03:11.089381 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:03:11.089381 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:03:11.089381 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:11.089381 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:11.089381 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:11.089381 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:11.089381 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:11.089381 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:11.089381 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:11.089381 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:11.089381 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:11.089381 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:11.089381 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:11.089381 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:11.090375 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:11.090375 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:11.090375 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:11.090375 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:11.090375 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:03:11.090375 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:03:11.090375 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:03:11.090375 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:03:11.090375 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:03:11.090375 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:03:11.090375 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:03:11.090375 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:11.090375 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 315/645] 10.222.0.60 () {56 vars in 1102 bytes} [Sun Jul 31 01:03:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:11.090375 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0640e-2790-497f-9f49-74bee4deafee None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:11.119154 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c0356-1413-4950-9ed8-79b6a9e2e1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:11.119819 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c0356-1413-4950-9ed8-79b6a9e2e1b5 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:11.120098 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c0356-1413-4950-9ed8-79b6a9e2e1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:11.120372 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c0356-1413-4950-9ed8-79b6a9e2e1b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:11.121098 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7c0356-1413-4950-9ed8-79b6a9e2e1b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:11.121403 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7c0356-1413-4950-9ed8-79b6a9e2e1b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:11.122787 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7c0356-1413-4950-9ed8-79b6a9e2e1b5 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:11.134687 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 331/646] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:11.135518 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c0356-1413-4950-9ed8-79b6a9e2e1b5 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:11.188523 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:11.213182 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0640e-2790-497f-9f49-74bee4deafee None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:11.246449 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c0356-1413-4950-9ed8-79b6a9e2e1b5 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:11.250906 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb45c7a-0c75-48b1-a372-f811b9528664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:11.251870 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb45c7a-0c75-48b1-a372-f811b9528664 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:11.252669 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb45c7a-0c75-48b1-a372-f811b9528664 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:11.253115 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb45c7a-0c75-48b1-a372-f811b9528664 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:11.261759 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb45c7a-0c75-48b1-a372-f811b9528664 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:11.263224 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb45c7a-0c75-48b1-a372-f811b9528664 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:11.274989 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-cbb45c7a-0c75-48b1-a372-f811b9528664 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 31 01:03:11.274989 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:11.274989 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:11.274989 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:11.274989 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:11.274989 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:11.274989 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:11.274989 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:11.274989 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:11.274989 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:11.274989 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:11.274989 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:11.274989 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:03:11.274989 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:03:11.274989 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:03:11.274989 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:03:11.276000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:11.276000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:11.276000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:03:11.276000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:11.276000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:03:11.276000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:11.276000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:11.276000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:11.276000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:11.276000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:11.276000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:11.276000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:11.276000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:11.276000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:11.276000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:11.276000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:11.276000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:11.276000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:11.276946 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:11.276946 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:11.276946 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:03:11.276946 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:03:11.276946 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:03:11.276946 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:03:11.276946 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:03:11.276946 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:03:11.276946 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 31 01:03:11.276946 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:11.276946 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 316/647] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:03:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:11.276946 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb45c7a-0c75-48b1-a372-f811b9528664 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:11.286484 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d72e5-52b1-41f8-b576-8a3ae13e59bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:11.287139 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d72e5-52b1-41f8-b576-8a3ae13e59bd None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:11.287416 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d72e5-52b1-41f8-b576-8a3ae13e59bd None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:11.287726 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d72e5-52b1-41f8-b576-8a3ae13e59bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:11.294690 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d72e5-52b1-41f8-b576-8a3ae13e59bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:11.296323 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d72e5-52b1-41f8-b576-8a3ae13e59bd None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:11.307370 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-df5d72e5-52b1-41f8-b576-8a3ae13e59bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:11.307370 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:11.307370 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:11.307370 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:11.307370 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:11.307370 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:11.307370 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:11.307370 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:11.307370 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:11.307370 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:11.307370 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:11.307370 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:11.307370 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:03:11.307370 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:03:11.307370 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:03:11.308359 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:03:11.308359 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:11.308359 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:11.308359 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:11.308359 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:11.308359 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:11.308359 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:11.308359 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:11.308359 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:11.308359 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:11.308359 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:11.308359 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:11.308359 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:11.308359 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:11.308359 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:11.308359 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:11.308359 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:11.309263 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:03:11.309263 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:03:11.309263 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:03:11.309263 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:03:11.309263 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:03:11.309263 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:03:11.309263 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:11.309263 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:11.309263 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 332/648] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:03:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:11.309743 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d72e5-52b1-41f8-b576-8a3ae13e59bd None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:11.335450 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:11.389735 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb45c7a-0c75-48b1-a372-f811b9528664 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:11.421074 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d72e5-52b1-41f8-b576-8a3ae13e59bd None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:11.424367 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14882872-f26f-4def-b570-4c94bb9b4036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:11.424995 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14882872-f26f-4def-b570-4c94bb9b4036 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:11.425273 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14882872-f26f-4def-b570-4c94bb9b4036 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:11.425545 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14882872-f26f-4def-b570-4c94bb9b4036 None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:11.426264 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14882872-f26f-4def-b570-4c94bb9b4036 None admin] RBAC: Adding query filter params (name=service) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:11.426566 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14882872-f26f-4def-b570-4c94bb9b4036 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:11.427980 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14882872-f26f-4def-b570-4c94bb9b4036 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:11.432040 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:11.437340 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 317/649] 10.222.0.60 () {56 vars in 1103 bytes} [Sun Jul 31 01:03:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:11.438393 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14882872-f26f-4def-b570-4c94bb9b4036 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:11.462435 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eba25c-1c87-4e5e-9406-c1c62b6e483c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:11.463466 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eba25c-1c87-4e5e-9406-c1c62b6e483c None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:11.463949 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eba25c-1c87-4e5e-9406-c1c62b6e483c None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:11.464363 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eba25c-1c87-4e5e-9406-c1c62b6e483c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:11.472139 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eba25c-1c87-4e5e-9406-c1c62b6e483c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:11.473796 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eba25c-1c87-4e5e-9406-c1c62b6e483c None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:11.485170 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-32eba25c-1c87-4e5e-9406-c1c62b6e483c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 31 01:03:11.485170 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:11.485170 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:11.485170 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:11.485170 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:11.485170 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:11.485170 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:11.485170 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:11.485170 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:11.485170 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:11.485170 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:11.485170 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:11.485170 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:03:11.485170 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:03:11.485170 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:03:11.485170 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:03:11.486205 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:11.486205 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:11.486205 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:03:11.486205 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:11.486205 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:03:11.486205 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:11.486205 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:11.486205 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:11.486205 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:11.486205 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:11.486205 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:11.486205 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:11.486205 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:11.486205 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:11.486205 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:11.486205 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:11.486205 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:11.486205 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:11.487308 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:11.487308 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:11.487308 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:03:11.487308 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:03:11.487308 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:03:11.487308 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:03:11.487308 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:03:11.487308 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:03:11.487308 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 31 01:03:11.487308 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:11.489200 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 333/650] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:03:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:11.490092 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eba25c-1c87-4e5e-9406-c1c62b6e483c None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:11.545096 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14882872-f26f-4def-b570-4c94bb9b4036 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:11.555995 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:11.582054 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f3ccd1-cd40-4e95-813f-5533147d43d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:11.582798 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3ccd1-cd40-4e95-813f-5533147d43d6 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:11.583138 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3ccd1-cd40-4e95-813f-5533147d43d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:11.583411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3ccd1-cd40-4e95-813f-5533147d43d6 None admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:11.584761 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f3ccd1-cd40-4e95-813f-5533147d43d6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:11.584761 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f3ccd1-cd40-4e95-813f-5533147d43d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:11.586852 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f3ccd1-cd40-4e95-813f-5533147d43d6 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:11.596699 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eba25c-1c87-4e5e-9406-c1c62b6e483c None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:11.604322 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 318/651] 10.222.0.60 () {56 vars in 1137 bytes} [Sun Jul 31 01:03:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:11.605127 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f3ccd1-cd40-4e95-813f-5533147d43d6 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:11.631906 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0291f-7f36-45ee-a8ce-840618afda49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:11.632534 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0291f-7f36-45ee-a8ce-840618afda49 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:11.632810 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0291f-7f36-45ee-a8ce-840618afda49 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:11.633074 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0291f-7f36-45ee-a8ce-840618afda49 None admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:11.633824 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a0291f-7f36-45ee-a8ce-840618afda49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:11.634134 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a0291f-7f36-45ee-a8ce-840618afda49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:11.635611 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a0291f-7f36-45ee-a8ce-840618afda49 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:11.648349 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 334/652] 10.222.0.60 () {56 vars in 1148 bytes} [Sun Jul 31 01:03:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:11.649138 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0291f-7f36-45ee-a8ce-840618afda49 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:11.679301 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:11.705473 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f3ccd1-cd40-4e95-813f-5533147d43d6 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:11.740074 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbee78e-5763-4b15-b0ba-99eefcf4737e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:11.740694 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbee78e-5763-4b15-b0ba-99eefcf4737e None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:11.740982 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbee78e-5763-4b15-b0ba-99eefcf4737e None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:11.741244 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbee78e-5763-4b15-b0ba-99eefcf4737e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:11.749424 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0291f-7f36-45ee-a8ce-840618afda49 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:11.751655 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbee78e-5763-4b15-b0ba-99eefcf4737e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:11.753466 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbee78e-5763-4b15-b0ba-99eefcf4737e None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:11.768816 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-1cbee78e-5763-4b15-b0ba-99eefcf4737e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:11.768816 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:11.768816 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:11.768816 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:11.768816 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:11.768816 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:11.768816 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:11.768816 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:11.768816 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:11.768816 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:11.768816 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:11.768816 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:11.768816 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:11.768816 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:11.768816 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:11.769757 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:11.769757 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:11.769757 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:11.769757 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:11.769757 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:11.769757 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:11.769757 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:11.769757 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:11.769757 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:11.769757 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:11.769757 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:11.769757 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:11.769757 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:11.769757 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:11.769757 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:11.769757 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:11.769757 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:11.770634 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:11.770634 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:11.770634 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:11.770634 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:11.770634 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 319/653] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:11.771097 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83f4d0-0e0c-4027-9567-537b09da224c None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:11.771374 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83f4d0-0e0c-4027-9567-537b09da224c None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:11.771666 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83f4d0-0e0c-4027-9567-537b09da224c None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:11.772875 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 320/654] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:11.773549 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83f4d0-0e0c-4027-9567-537b09da224c None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:11.789533 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd97119a-0c0a-412d-9707-4983e89c5446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:11.790162 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97119a-0c0a-412d-9707-4983e89c5446 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:11.790436 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97119a-0c0a-412d-9707-4983e89c5446 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:11.790708 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97119a-0c0a-412d-9707-4983e89c5446 None admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:11.791518 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd97119a-0c0a-412d-9707-4983e89c5446 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:11.791839 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd97119a-0c0a-412d-9707-4983e89c5446 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:11.793274 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd97119a-0c0a-412d-9707-4983e89c5446 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:11.794825 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:11.809946 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 335/655] 10.222.0.60 () {56 vars in 1137 bytes} [Sun Jul 31 01:03:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:11.810781 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd97119a-0c0a-412d-9707-4983e89c5446 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:11.872632 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83f4d0-0e0c-4027-9567-537b09da224c None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:11.893759 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:11.906189 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd97119a-0c0a-412d-9707-4983e89c5446 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:11.906681 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d349f-44ab-4146-aa09-70a29cf929db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:11.907309 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d349f-44ab-4146-aa09-70a29cf929db None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:11.907623 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d349f-44ab-4146-aa09-70a29cf929db None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:11.907895 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d349f-44ab-4146-aa09-70a29cf929db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:11.939771 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a63054-a256-42c0-a2df-6dbc75651b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:11.940383 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a63054-a256-42c0-a2df-6dbc75651b62 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:11.940673 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a63054-a256-42c0-a2df-6dbc75651b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:11.940943 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a63054-a256-42c0-a2df-6dbc75651b62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:11.941723 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a63054-a256-42c0-a2df-6dbc75651b62 None admin] RBAC: Adding query filter params (role.id=a5d1b78d4ec146848dfa667303603262, scope.project.id=b931b81a237949aa845891d4bb5aa1c0, user.id=04591cd035ef4961b8b7a93e294eb881) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:11.942023 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a63054-a256-42c0-a2df-6dbc75651b62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:11.943501 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a63054-a256-42c0-a2df-6dbc75651b62 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:11.949222 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 336/656] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:03:11 2022] GET /identity/v3/role_assignments?user.id=04591cd035ef4961b8b7a93e294eb881&scope.project.id=b931b81a237949aa845891d4bb5aa1c0&role.id=a5d1b78d4ec146848dfa667303603262 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:11.949970 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a63054-a256-42c0-a2df-6dbc75651b62 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:11.989894 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382d349f-44ab-4146-aa09-70a29cf929db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:11.991437 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382d349f-44ab-4146-aa09-70a29cf929db None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:12.016354 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:12.058451 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a63054-a256-42c0-a2df-6dbc75651b62 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:12.096238 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f72ecc-e32e-4a85-a4b9-29f05334476f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:12.096864 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f72ecc-e32e-4a85-a4b9-29f05334476f None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:12.097107 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f72ecc-e32e-4a85-a4b9-29f05334476f None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:12.097376 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f72ecc-e32e-4a85-a4b9-29f05334476f None admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:12.098092 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f72ecc-e32e-4a85-a4b9-29f05334476f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:12.098474 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f72ecc-e32e-4a85-a4b9-29f05334476f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:12.099760 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f72ecc-e32e-4a85-a4b9-29f05334476f None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:12.117324 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 337/657] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:12.117550 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 321/658] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:03:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:03:12.117648 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593fedf-79c0-4cac-94b9-91ea16af589d None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:12.117648 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593fedf-79c0-4cac-94b9-91ea16af589d None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:12.117648 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593fedf-79c0-4cac-94b9-91ea16af589d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:12.117891 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d349f-44ab-4146-aa09-70a29cf929db None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:12.135245 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-1593fedf-79c0-4cac-94b9-91ea16af589d None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:12.136426 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-1593fedf-79c0-4cac-94b9-91ea16af589d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:12.145725 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:12.212354 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 338/659] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:03:12.213304 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1593fedf-79c0-4cac-94b9-91ea16af589d None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:12.239852 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d349f-44ab-4146-aa09-70a29cf929db None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:12.261415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:12.277314 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbc149-3bb5-40cf-9b4d-c83c0e637cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:12.278028 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbc149-3bb5-40cf-9b4d-c83c0e637cde None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:12.278371 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbc149-3bb5-40cf-9b4d-c83c0e637cde None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:12.278705 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbc149-3bb5-40cf-9b4d-c83c0e637cde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:12.316628 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1593fedf-79c0-4cac-94b9-91ea16af589d None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:12.346640 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bbc149-3bb5-40cf-9b4d-c83c0e637cde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:12.348268 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bbc149-3bb5-40cf-9b4d-c83c0e637cde None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:12.355686 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7a0a9-a619-40b0-acde-f0b3dbe53a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:12.355686 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7a0a9-a619-40b0-acde-f0b3dbe53a5e None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:12.355686 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7a0a9-a619-40b0-acde-f0b3dbe53a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:12.355686 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7a0a9-a619-40b0-acde-f0b3dbe53a5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:12.369588 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f7a0a9-a619-40b0-acde-f0b3dbe53a5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:12.371247 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f7a0a9-a619-40b0-acde-f0b3dbe53a5e None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:12.373695 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:12.388669 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-c7f7a0a9-a619-40b0-acde-f0b3dbe53a5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:12.388669 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:12.388669 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:12.388669 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:12.388669 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:12.388669 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:12.388669 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:12.388669 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:12.388669 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:12.388669 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:12.388669 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:12.388669 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:12.388669 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:12.388669 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:12.388669 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:12.389842 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:12.389842 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:12.389842 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:12.389842 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:12.389842 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:12.389842 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:12.389842 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:12.389842 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:12.389842 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:12.389842 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:12.389842 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:12.389842 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:12.389842 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:12.389842 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:12.389842 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:12.389842 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:12.389842 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:12.391393 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:12.391393 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:12.391393 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:12.391393 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:12.391393 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 339/660] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:12.391393 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7a0a9-a619-40b0-acde-f0b3dbe53a5e None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:12.457758 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 322/661] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:03:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:03:12.458630 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbc149-3bb5-40cf-9b4d-c83c0e637cde None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:12.485630 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:12.499258 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7a0a9-a619-40b0-acde-f0b3dbe53a5e None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:12.535831 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b843d0-e977-4aea-9c30-08bac4b59dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:12.536474 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b843d0-e977-4aea-9c30-08bac4b59dec None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:12.536745 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b843d0-e977-4aea-9c30-08bac4b59dec None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:12.537012 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b843d0-e977-4aea-9c30-08bac4b59dec None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:12.544798 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b843d0-e977-4aea-9c30-08bac4b59dec None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:12.546287 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b843d0-e977-4aea-9c30-08bac4b59dec None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:12.557651 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-18b843d0-e977-4aea-9c30-08bac4b59dec None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 31 01:03:12.557651 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:12.557651 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:12.557651 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:12.557651 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:12.557651 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:12.557651 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:12.557651 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:12.557651 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:12.557651 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:12.557651 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:12.557651 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:12.557651 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:03:12.557651 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:03:12.557651 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:03:12.557651 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:03:12.558589 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:12.558589 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:12.558589 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:03:12.558589 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:12.558589 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:03:12.558589 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:12.558589 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:12.558589 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:12.558589 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:12.558589 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:12.558589 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:12.558589 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:12.558589 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:12.558589 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:12.558589 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:12.558589 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:12.558589 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:12.558589 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:12.560427 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:12.560427 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:12.560427 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:03:12.560427 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:03:12.560427 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:03:12.560427 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:03:12.560427 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:03:12.560427 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:03:12.560427 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 31 01:03:12.560427 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:12.560427 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 340/662] 10.222.0.60 () {56 vars in 1102 bytes} [Sun Jul 31 01:03:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:12.560427 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b843d0-e977-4aea-9c30-08bac4b59dec None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:12.570448 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbc149-3bb5-40cf-9b4d-c83c0e637cde None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:12.609028 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad2aa1-81cf-40b5-9990-f1d2f48a467f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:12.609670 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad2aa1-81cf-40b5-9990-f1d2f48a467f None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:12.609919 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad2aa1-81cf-40b5-9990-f1d2f48a467f None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:12.610193 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad2aa1-81cf-40b5-9990-f1d2f48a467f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:12.620216 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad2aa1-81cf-40b5-9990-f1d2f48a467f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:03:12.625195 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-3dad2aa1-81cf-40b5-9990-f1d2f48a467f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:03:12.625195 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:12.625195 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:12.625195 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:12.625195 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:12.625195 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:12.625195 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:12.625195 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:12.625195 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:12.625195 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:12.625195 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:12.625195 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:12.625195 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:03:12.625195 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:03:12.625195 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:03:12.625195 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:03:12.626279 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:03:12.626279 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:03:12.626279 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:03:12.626279 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:03:12.626279 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:12.626279 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:12.626279 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:12.626279 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:12.626279 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:12.626279 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:12.626279 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:12.626279 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:12.626279 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:12.626279 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:12.626279 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:12.626279 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:12.627688 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:12.627688 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:12.627688 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:12.627688 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:12.627688 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:03:12.627688 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:03:12.627688 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:03:12.627688 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:03:12.627688 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:03:12.627688 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:03:12.627688 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:03:12.627688 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:12.631409 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 323/663] 10.222.0.60 () {56 vars in 1102 bytes} [Sun Jul 31 01:03:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:12.632314 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad2aa1-81cf-40b5-9990-f1d2f48a467f None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:12.636330 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:12.686910 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b843d0-e977-4aea-9c30-08bac4b59dec None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:12.722935 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb291f4-6954-4a2e-a33d-63c0b8fd3c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:12.723891 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb291f4-6954-4a2e-a33d-63c0b8fd3c20 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:12.724342 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb291f4-6954-4a2e-a33d-63c0b8fd3c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:12.724614 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb291f4-6954-4a2e-a33d-63c0b8fd3c20 None admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:12.724722 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:12.725316 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb291f4-6954-4a2e-a33d-63c0b8fd3c20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:12.725625 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb291f4-6954-4a2e-a33d-63c0b8fd3c20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:12.727397 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb291f4-6954-4a2e-a33d-63c0b8fd3c20 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:12.740428 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 341/664] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:12.745594 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb291f4-6954-4a2e-a33d-63c0b8fd3c20 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:12.745740 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad2aa1-81cf-40b5-9990-f1d2f48a467f None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:12.782517 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d500a-9bca-48f0-895b-af8fc867e6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:12.783067 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d500a-9bca-48f0-895b-af8fc867e6d2 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:12.783347 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d500a-9bca-48f0-895b-af8fc867e6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:12.783648 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d500a-9bca-48f0-895b-af8fc867e6d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:12.793932 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d500a-9bca-48f0-895b-af8fc867e6d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:12.795430 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d500a-9bca-48f0-895b-af8fc867e6d2 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:12.810717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-5c9d500a-9bca-48f0-895b-af8fc867e6d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:12.810717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:12.810717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:12.810717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:12.810717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:12.810717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:12.810717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:12.810717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:12.810717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:12.810717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:12.810717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:12.810717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:12.810717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:12.810717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:12.810717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:12.811651 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:12.811651 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:12.811651 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:12.811651 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:12.811651 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:12.811651 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:12.811651 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:12.811651 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:12.811651 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:12.811651 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:12.811651 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:12.811651 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:12.811651 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:12.811651 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:12.811651 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:12.811651 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:12.811651 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:12.812735 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:12.812735 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:12.812735 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:12.812735 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:12.816409 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 324/665] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:12.817219 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d500a-9bca-48f0-895b-af8fc867e6d2 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:12.851412 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb291f4-6954-4a2e-a33d-63c0b8fd3c20 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:12.865610 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:12.888041 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98d3f7-b231-434b-9636-3370790c4108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:12.888990 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98d3f7-b231-434b-9636-3370790c4108 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:12.889427 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98d3f7-b231-434b-9636-3370790c4108 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:12.889754 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98d3f7-b231-434b-9636-3370790c4108 None admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:12.891748 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98d3f7-b231-434b-9636-3370790c4108 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:12.892069 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98d3f7-b231-434b-9636-3370790c4108 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:12.894051 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98d3f7-b231-434b-9636-3370790c4108 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:12.917744 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 342/666] 10.222.0.60 () {56 vars in 1139 bytes} [Sun Jul 31 01:03:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:12.918568 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98d3f7-b231-434b-9636-3370790c4108 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:12.933004 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d500a-9bca-48f0-895b-af8fc867e6d2 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:12.970630 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:12.976718 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b97e0c-b43c-42a0-aa19-da50ecf31429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:12.977349 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b97e0c-b43c-42a0-aa19-da50ecf31429 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:12.977629 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b97e0c-b43c-42a0-aa19-da50ecf31429 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:12.977899 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b97e0c-b43c-42a0-aa19-da50ecf31429 None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:12.978745 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b97e0c-b43c-42a0-aa19-da50ecf31429 None admin] RBAC: Adding query filter params (name=service) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:12.979048 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b97e0c-b43c-42a0-aa19-da50ecf31429 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:12.980448 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b97e0c-b43c-42a0-aa19-da50ecf31429 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:12.990264 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 325/667] 10.222.0.60 () {56 vars in 1103 bytes} [Sun Jul 31 01:03:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:12.991084 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b97e0c-b43c-42a0-aa19-da50ecf31429 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:13.028381 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98d3f7-b231-434b-9636-3370790c4108 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:13.063684 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e026ecf-d34f-42d4-ab4a-2e6209c96072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:13.064347 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e026ecf-d34f-42d4-ab4a-2e6209c96072 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:13.064625 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e026ecf-d34f-42d4-ab4a-2e6209c96072 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:13.064894 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e026ecf-d34f-42d4-ab4a-2e6209c96072 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:13.071835 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e026ecf-d34f-42d4-ab4a-2e6209c96072 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:13.073296 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e026ecf-d34f-42d4-ab4a-2e6209c96072 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:13.085018 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-6e026ecf-d34f-42d4-ab4a-2e6209c96072 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:13.085018 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:13.085018 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:13.085018 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:13.085018 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:13.085018 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:13.085018 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:13.085018 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:13.085018 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:13.085018 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:13.085018 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:13.085018 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:13.085018 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:03:13.085018 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:03:13.085018 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:03:13.086001 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:03:13.086001 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:13.086001 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:13.086001 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:13.086001 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:13.086001 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:13.086001 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:13.086001 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:13.086001 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:13.086001 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:13.086001 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:13.086001 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:13.086001 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:13.086001 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:13.086001 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:13.086001 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:13.086001 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:13.086987 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:03:13.086987 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:03:13.086987 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:03:13.086987 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:03:13.086987 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:03:13.086987 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:03:13.086987 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:13.086987 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:13.086987 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 343/668] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:03:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:13.086987 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e026ecf-d34f-42d4-ab4a-2e6209c96072 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:13.102023 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b97e0c-b43c-42a0-aa19-da50ecf31429 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:13.124773 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:13.143553 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e9a16-ed81-4c53-8140-4abf694ba0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:13.144280 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e9a16-ed81-4c53-8140-4abf694ba0a0 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:13.144563 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e9a16-ed81-4c53-8140-4abf694ba0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:13.144840 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e9a16-ed81-4c53-8140-4abf694ba0a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:13.145564 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1e9a16-ed81-4c53-8140-4abf694ba0a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:13.145864 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1e9a16-ed81-4c53-8140-4abf694ba0a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:13.147249 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1e9a16-ed81-4c53-8140-4abf694ba0a0 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:13.164002 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 326/669] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:13.164002 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e9a16-ed81-4c53-8140-4abf694ba0a0 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:13.204070 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e026ecf-d34f-42d4-ab4a-2e6209c96072 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:13.216683 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:13.241049 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65807c64-f483-413c-aa1f-022854b46f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:13.241595 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65807c64-f483-413c-aa1f-022854b46f25 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:13.241931 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65807c64-f483-413c-aa1f-022854b46f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:13.242208 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65807c64-f483-413c-aa1f-022854b46f25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:13.265058 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e9a16-ed81-4c53-8140-4abf694ba0a0 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:13.299841 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23bb1c-f951-4951-8804-79b44b9d6e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:13.300592 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23bb1c-f951-4951-8804-79b44b9d6e53 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:13.300770 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23bb1c-f951-4951-8804-79b44b9d6e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:13.301041 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23bb1c-f951-4951-8804-79b44b9d6e53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:13.311882 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23bb1c-f951-4951-8804-79b44b9d6e53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:13.313336 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23bb1c-f951-4951-8804-79b44b9d6e53 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:13.321927 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65807c64-f483-413c-aa1f-022854b46f25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:13.323932 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65807c64-f483-413c-aa1f-022854b46f25 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:13.328702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-6a23bb1c-f951-4951-8804-79b44b9d6e53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:13.328702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:13.328702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:13.328702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:13.328702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:13.328702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:13.328702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:13.328702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:13.328702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:13.328702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:13.328702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:13.328702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:13.328702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:13.328702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:13.328702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:13.329754 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:13.329754 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:13.329754 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:13.329754 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:13.329754 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:13.329754 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:13.329754 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:13.329754 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:13.329754 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:13.329754 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:13.329754 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:13.329754 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:13.329754 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:13.329754 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:13.329754 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:13.329754 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:13.329754 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:13.330639 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:13.330639 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:13.330639 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:13.330639 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:13.330639 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 327/670] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:13.330639 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23bb1c-f951-4951-8804-79b44b9d6e53 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:13.367591 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:13.444721 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 344/671] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:03:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:03:13.445433 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23bb1c-f951-4951-8804-79b44b9d6e53 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:13.446098 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65807c64-f483-413c-aa1f-022854b46f25 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:13.456973 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:13.485896 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9291e5e-5f7c-4673-a649-38662737c653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:13.486523 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9291e5e-5f7c-4673-a649-38662737c653 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:13.486803 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9291e5e-5f7c-4673-a649-38662737c653 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:13.487079 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9291e5e-5f7c-4673-a649-38662737c653 None admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:13.487889 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9291e5e-5f7c-4673-a649-38662737c653 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:13.488196 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9291e5e-5f7c-4673-a649-38662737c653 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:13.489633 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9291e5e-5f7c-4673-a649-38662737c653 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:13.501832 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 328/672] 10.222.0.60 () {56 vars in 1148 bytes} [Sun Jul 31 01:03:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:13.503249 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9291e5e-5f7c-4673-a649-38662737c653 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:13.561268 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65807c64-f483-413c-aa1f-022854b46f25 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:13.591725 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:13.597320 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d019e9be-b67b-47cf-af3e-3ef7760086be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:13.598252 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019e9be-b67b-47cf-af3e-3ef7760086be None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:13.598530 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019e9be-b67b-47cf-af3e-3ef7760086be None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:13.598801 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019e9be-b67b-47cf-af3e-3ef7760086be None admin] PATH_INFO: `/v3/projects/service` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:13.606808 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d019e9be-b67b-47cf-af3e-3ef7760086be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:13.608350 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d019e9be-b67b-47cf-af3e-3ef7760086be None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:13.616846 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9291e5e-5f7c-4673-a649-38662737c653 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:13.619756 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-d019e9be-b67b-47cf-af3e-3ef7760086be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:13.619756 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:13.619756 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:13.619756 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:13.619756 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:13.619756 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:13.619756 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:13.619756 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:13.619756 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:13.619756 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:13.619756 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:13.619756 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:13.619756 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:03:13.619756 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:03:13.619756 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:03:13.620858 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:03:13.620858 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:13.620858 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:13.620858 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:13.620858 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:13.620858 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:13.620858 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:13.620858 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:13.620858 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:13.620858 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:13.620858 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:13.620858 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:13.620858 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:13.620858 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:13.620858 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:13.620858 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:13.620858 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:13.621730 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:03:13.621730 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:03:13.621730 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:03:13.621730 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:03:13.621730 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:03:13.621730 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:03:13.621730 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:13.621730 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:13.621730 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 345/673] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:03:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:13.621730 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d019e9be-b67b-47cf-af3e-3ef7760086be None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:13.658445 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd06a58-066b-449b-b825-b2febd6eaf15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:13.659076 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd06a58-066b-449b-b825-b2febd6eaf15 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:13.659357 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd06a58-066b-449b-b825-b2febd6eaf15 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:13.659663 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd06a58-066b-449b-b825-b2febd6eaf15 None admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:13.660364 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd06a58-066b-449b-b825-b2febd6eaf15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:13.660672 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd06a58-066b-449b-b825-b2febd6eaf15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:13.662095 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd06a58-066b-449b-b825-b2febd6eaf15 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:13.674482 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 329/674] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:13.679515 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd06a58-066b-449b-b825-b2febd6eaf15 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:13.734110 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d019e9be-b67b-47cf-af3e-3ef7760086be None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:13.773100 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0616d20-1111-4acc-8fdc-4bdfc310afcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:13.773689 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0616d20-1111-4acc-8fdc-4bdfc310afcc None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:13.773960 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0616d20-1111-4acc-8fdc-4bdfc310afcc None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:13.774234 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0616d20-1111-4acc-8fdc-4bdfc310afcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:13.786917 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0616d20-1111-4acc-8fdc-4bdfc310afcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:13.788465 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0616d20-1111-4acc-8fdc-4bdfc310afcc None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:13.804295 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-d0616d20-1111-4acc-8fdc-4bdfc310afcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:13.804295 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:13.804295 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:13.804295 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:13.804295 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:13.804295 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:13.804295 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:13.804295 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:13.804295 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:13.804295 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:13.804295 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:13.804295 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:13.804295 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:13.804295 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:13.804295 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:13.805265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:13.805265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:13.805265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:13.805265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:13.805265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:13.805265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:13.805265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:13.805265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:13.805265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:13.805265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:13.805265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:13.805265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:13.805265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:13.805265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:13.805265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:13.805265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:13.805265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:13.806139 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:13.806139 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:13.806139 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:13.806139 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:13.806139 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 346/675] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:13.806930 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0616d20-1111-4acc-8fdc-4bdfc310afcc None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:13.834227 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:13.858325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:13.911858 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd06a58-066b-449b-b825-b2febd6eaf15 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:13.916613 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0616d20-1111-4acc-8fdc-4bdfc310afcc None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:13.947132 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a457c74-e281-41f8-8cd9-3d2310146f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:13.947887 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a457c74-e281-41f8-8cd9-3d2310146f86 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:13.948169 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a457c74-e281-41f8-8cd9-3d2310146f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:13.948440 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a457c74-e281-41f8-8cd9-3d2310146f86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:13.949232 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a457c74-e281-41f8-8cd9-3d2310146f86 None admin] RBAC: Adding query filter params (role.id=a5d1b78d4ec146848dfa667303603262, scope.project.id=b931b81a237949aa845891d4bb5aa1c0, user.id=fdebcb0a2a7548a09b3e9d3cf085e40e) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:13.949538 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a457c74-e281-41f8-8cd9-3d2310146f86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:13.950960 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a457c74-e281-41f8-8cd9-3d2310146f86 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:13.955643 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c8336-a01d-46fd-915d-01ab43fda208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:13.956274 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c8336-a01d-46fd-915d-01ab43fda208 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:13.956556 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c8336-a01d-46fd-915d-01ab43fda208 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:13.956828 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c8336-a01d-46fd-915d-01ab43fda208 None admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:13.967951 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 330/676] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:03:13 2022] GET /identity/v3/role_assignments?user.id=fdebcb0a2a7548a09b3e9d3cf085e40e&scope.project.id=b931b81a237949aa845891d4bb5aa1c0&role.id=a5d1b78d4ec146848dfa667303603262 => generated 608 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:13.968178 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c8336-a01d-46fd-915d-01ab43fda208 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:13.968178 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c8336-a01d-46fd-915d-01ab43fda208 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:13.968328 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a457c74-e281-41f8-8cd9-3d2310146f86 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:13.968417 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c8336-a01d-46fd-915d-01ab43fda208 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:13.985661 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 347/677] 10.222.0.60 () {56 vars in 1148 bytes} [Sun Jul 31 01:03:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:13.986560 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c8336-a01d-46fd-915d-01ab43fda208 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:14.069871 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:14.082261 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a457c74-e281-41f8-8cd9-3d2310146f86 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:14.101931 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c8336-a01d-46fd-915d-01ab43fda208 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:14.105706 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:14.125163 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8473b7-6860-4fd7-8e6d-d6d80c3c4bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:14.126141 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8473b7-6860-4fd7-8e6d-d6d80c3c4bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:14.126384 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8473b7-6860-4fd7-8e6d-d6d80c3c4bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:14.127145 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8473b7-6860-4fd7-8e6d-d6d80c3c4bd3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:14.136604 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8473b7-6860-4fd7-8e6d-d6d80c3c4bd3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:14.138058 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8473b7-6860-4fd7-8e6d-d6d80c3c4bd3 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:14.141683 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638bcd7a-aeca-43bd-a41f-b7cc4153de8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:14.142311 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638bcd7a-aeca-43bd-a41f-b7cc4153de8f None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:14.142594 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638bcd7a-aeca-43bd-a41f-b7cc4153de8f None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:14.142884 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638bcd7a-aeca-43bd-a41f-b7cc4153de8f None admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:14.144061 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638bcd7a-aeca-43bd-a41f-b7cc4153de8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:14.144061 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638bcd7a-aeca-43bd-a41f-b7cc4153de8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:14.145244 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638bcd7a-aeca-43bd-a41f-b7cc4153de8f None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:14.151095 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-2b8473b7-6860-4fd7-8e6d-d6d80c3c4bd3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 31 01:03:14.151095 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:14.151095 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:14.151095 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:14.151095 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:14.151095 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:14.151095 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:14.151095 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:14.151095 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:14.151095 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:14.151095 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:14.151095 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:14.151095 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:03:14.151095 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:03:14.151095 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:03:14.151095 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:03:14.152071 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:14.152071 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:14.152071 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:03:14.152071 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:14.152071 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:03:14.152071 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:14.152071 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:14.152071 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:14.152071 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:14.152071 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:14.152071 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:14.152071 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:14.152071 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:14.152071 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:14.152071 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:14.152071 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:14.152071 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:14.152071 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:14.153041 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:14.153041 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:14.153041 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:03:14.153041 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:03:14.153041 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:03:14.153041 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:03:14.153041 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:03:14.153041 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:03:14.153041 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 31 01:03:14.153041 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:14.153592 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 331/678] 10.222.0.60 () {56 vars in 1096 bytes} [Sun Jul 31 01:03:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:14.154011 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8473b7-6860-4fd7-8e6d-d6d80c3c4bd3 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:14.157406 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 348/679] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:14.158817 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd19ed-d00f-4c49-b768-37621451116a None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:14.159092 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd19ed-d00f-4c49-b768-37621451116a None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:14.159361 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd19ed-d00f-4c49-b768-37621451116a None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:14.161414 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 349/680] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:14.162101 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd19ed-d00f-4c49-b768-37621451116a None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:14.270253 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8473b7-6860-4fd7-8e6d-d6d80c3c4bd3 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:14.282701 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd19ed-d00f-4c49-b768-37621451116a None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:14.306970 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb6c66-29a3-4105-8e03-117f5f6afcef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:14.308052 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb6c66-29a3-4105-8e03-117f5f6afcef None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:14.308326 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb6c66-29a3-4105-8e03-117f5f6afcef None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:14.308590 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb6c66-29a3-4105-8e03-117f5f6afcef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:14.309374 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fb6c66-29a3-4105-8e03-117f5f6afcef None admin] RBAC: Adding query filter params (role.id=a5d1b78d4ec146848dfa667303603262, scope.project.id=b931b81a237949aa845891d4bb5aa1c0, user.id=a1943ab629b6411d81327a845b77c8c1) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:14.309675 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fb6c66-29a3-4105-8e03-117f5f6afcef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:14.311366 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fb6c66-29a3-4105-8e03-117f5f6afcef None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:14.315556 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81012447-4073-490f-9003-5289372f38a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:14.316184 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81012447-4073-490f-9003-5289372f38a2 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:14.316459 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81012447-4073-490f-9003-5289372f38a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:14.316733 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81012447-4073-490f-9003-5289372f38a2 None admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:14.317528 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81012447-4073-490f-9003-5289372f38a2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:14.323672 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81012447-4073-490f-9003-5289372f38a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:14.324279 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 332/681] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:03:14 2022] GET /identity/v3/role_assignments?user.id=a1943ab629b6411d81327a845b77c8c1&scope.project.id=b931b81a237949aa845891d4bb5aa1c0&role.id=a5d1b78d4ec146848dfa667303603262 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:14.324279 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb6c66-29a3-4105-8e03-117f5f6afcef None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:14.324474 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81012447-4073-490f-9003-5289372f38a2 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:14.346541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:14.351199 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 350/682] 10.222.0.60 () {56 vars in 1135 bytes} [Sun Jul 31 01:03:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:14.352836 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb1b87-5804-4541-bdda-9edbfc1ff194 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:14.353296 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb1b87-5804-4541-bdda-9edbfc1ff194 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:14.353725 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb1b87-5804-4541-bdda-9edbfc1ff194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:14.382449 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-8bcb1b87-5804-4541-bdda-9edbfc1ff194 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:14.384185 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-8bcb1b87-5804-4541-bdda-9edbfc1ff194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:14.406565 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:14.466746 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb6c66-29a3-4105-8e03-117f5f6afcef None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:14.467569 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 351/683] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:03:14.468530 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb1b87-5804-4541-bdda-9edbfc1ff194 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:14.506430 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf7ccf-f24f-4723-b448-9b743e0a438a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:14.507531 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf7ccf-f24f-4723-b448-9b743e0a438a None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:14.508029 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf7ccf-f24f-4723-b448-9b743e0a438a None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:14.508495 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf7ccf-f24f-4723-b448-9b743e0a438a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:14.517082 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf7ccf-f24f-4723-b448-9b743e0a438a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:14.518858 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf7ccf-f24f-4723-b448-9b743e0a438a None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:14.530947 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-c4bf7ccf-f24f-4723-b448-9b743e0a438a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:14.530947 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:14.530947 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:14.530947 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:14.530947 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:14.530947 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:14.530947 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:14.530947 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:14.530947 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:14.530947 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:14.530947 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:14.530947 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:14.530947 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:03:14.530947 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:03:14.530947 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:03:14.531889 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:03:14.531889 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:14.531889 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:14.531889 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:14.531889 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:14.531889 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:14.531889 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:14.531889 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:14.531889 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:14.531889 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:14.531889 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:14.531889 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:14.531889 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:14.531889 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:14.531889 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:14.531889 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:14.531889 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:14.532758 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:03:14.532758 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:03:14.532758 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:03:14.532758 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:03:14.532758 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:03:14.532758 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:03:14.532758 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:14.532758 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:14.534485 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 333/684] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:03:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:14.535382 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf7ccf-f24f-4723-b448-9b743e0a438a None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:14.577020 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb1b87-5804-4541-bdda-9edbfc1ff194 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:14.614262 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127d1a5-b422-4d48-9100-493babd7617c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:14.614890 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127d1a5-b422-4d48-9100-493babd7617c None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:14.615163 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127d1a5-b422-4d48-9100-493babd7617c None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:14.615429 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127d1a5-b422-4d48-9100-493babd7617c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:14.625254 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:14.643628 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:14.664251 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf7ccf-f24f-4723-b448-9b743e0a438a None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:14.692438 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1127d1a5-b422-4d48-9100-493babd7617c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:14.693969 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1127d1a5-b422-4d48-9100-493babd7617c None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:14.711526 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2012c00-00cb-43f8-8db6-27be99d1c39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:14.712860 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2012c00-00cb-43f8-8db6-27be99d1c39f None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:14.713320 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2012c00-00cb-43f8-8db6-27be99d1c39f None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:14.713768 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2012c00-00cb-43f8-8db6-27be99d1c39f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:14.728500 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2012c00-00cb-43f8-8db6-27be99d1c39f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:03:14.735777 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-f2012c00-00cb-43f8-8db6-27be99d1c39f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:03:14.735777 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:14.735777 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:14.735777 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:14.735777 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:14.735777 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:14.735777 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:14.735777 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:14.735777 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:14.735777 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:14.735777 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:14.735777 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:14.735777 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:03:14.735777 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:03:14.735777 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:03:14.735777 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:03:14.736757 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:03:14.736757 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:03:14.736757 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:03:14.736757 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:03:14.736757 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:14.736757 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:14.736757 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:14.736757 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:14.736757 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:14.736757 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:14.736757 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:14.736757 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:14.736757 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:14.736757 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:14.736757 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:14.736757 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:14.737620 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:14.737620 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:14.737620 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:14.737620 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:14.737620 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:03:14.737620 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:03:14.737620 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:03:14.737620 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:03:14.737620 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:03:14.737620 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:03:14.737620 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:03:14.737620 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:14.740617 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 334/685] 10.222.0.60 () {56 vars in 1096 bytes} [Sun Jul 31 01:03:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:14.742190 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2012c00-00cb-43f8-8db6-27be99d1c39f None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:14.801767 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 352/686] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:03:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:03:14.802634 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127d1a5-b422-4d48-9100-493babd7617c None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:14.853066 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2012c00-00cb-43f8-8db6-27be99d1c39f None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:14.854783 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:14.891670 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35118cd0-66f9-409d-8df8-4ebd08727258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:14.892615 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35118cd0-66f9-409d-8df8-4ebd08727258 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:14.893076 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35118cd0-66f9-409d-8df8-4ebd08727258 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:14.893555 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35118cd0-66f9-409d-8df8-4ebd08727258 None admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:14.894609 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35118cd0-66f9-409d-8df8-4ebd08727258 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:14.895140 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35118cd0-66f9-409d-8df8-4ebd08727258 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:14.896769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35118cd0-66f9-409d-8df8-4ebd08727258 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:14.900490 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:14.903376 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127d1a5-b422-4d48-9100-493babd7617c None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:14.917501 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 335/687] 10.222.0.60 () {56 vars in 1148 bytes} [Sun Jul 31 01:03:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:14.919377 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35118cd0-66f9-409d-8df8-4ebd08727258 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:14.938971 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba647e48-9cf7-471c-8fee-2b269f0f3976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:14.939728 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba647e48-9cf7-471c-8fee-2b269f0f3976 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:14.940073 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba647e48-9cf7-471c-8fee-2b269f0f3976 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:14.940410 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba647e48-9cf7-471c-8fee-2b269f0f3976 None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:14.941436 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba647e48-9cf7-471c-8fee-2b269f0f3976 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:14.941547 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba647e48-9cf7-471c-8fee-2b269f0f3976 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:14.942941 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba647e48-9cf7-471c-8fee-2b269f0f3976 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:14.951863 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 353/688] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:03:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:14.952814 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba647e48-9cf7-471c-8fee-2b269f0f3976 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:15.051270 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35118cd0-66f9-409d-8df8-4ebd08727258 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:15.056763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba647e48-9cf7-471c-8fee-2b269f0f3976 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:15.071176 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:15.090802 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be1689-25bb-4e1f-89a5-575260660683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:15.092150 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be1689-25bb-4e1f-89a5-575260660683 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:15.092671 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54f872-a31d-4154-be09-8a5754413b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:15.092837 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be1689-25bb-4e1f-89a5-575260660683 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:15.093361 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54f872-a31d-4154-be09-8a5754413b55 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:15.093584 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be1689-25bb-4e1f-89a5-575260660683 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:15.093694 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54f872-a31d-4154-be09-8a5754413b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:15.093893 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54f872-a31d-4154-be09-8a5754413b55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:15.094696 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a54f872-a31d-4154-be09-8a5754413b55 None admin] RBAC: Adding query filter params (role.id=a5d1b78d4ec146848dfa667303603262, scope.project.id=b931b81a237949aa845891d4bb5aa1c0, user.id=81117154f6d1474c805a69c5617c307d) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:15.094990 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a54f872-a31d-4154-be09-8a5754413b55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:15.096503 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a54f872-a31d-4154-be09-8a5754413b55 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:15.103414 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 354/689] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:03:14 2022] GET /identity/v3/role_assignments?user.id=81117154f6d1474c805a69c5617c307d&scope.project.id=b931b81a237949aa845891d4bb5aa1c0&role.id=a5d1b78d4ec146848dfa667303603262 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:15.104309 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54f872-a31d-4154-be09-8a5754413b55 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:15.107049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8be1689-25bb-4e1f-89a5-575260660683 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:15.109010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8be1689-25bb-4e1f-89a5-575260660683 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:15.126776 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-d8be1689-25bb-4e1f-89a5-575260660683 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:15.126776 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:15.126776 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:15.126776 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:15.126776 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:15.126776 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:15.126776 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:15.126776 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:15.126776 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:15.126776 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:15.126776 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:15.126776 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:15.126776 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:15.126776 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:15.126776 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:15.128174 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:15.128174 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:15.128174 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:15.128174 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:15.128174 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:15.128174 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:15.128174 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:15.128174 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:15.128174 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:15.128174 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:15.128174 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:15.128174 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:15.128174 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:15.128174 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:15.128174 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:15.128174 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:15.128174 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:15.129056 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:15.129056 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:15.129056 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:15.129056 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:15.131658 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 336/690] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:15.139550 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be1689-25bb-4e1f-89a5-575260660683 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:15.254343 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:15.294143 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54f872-a31d-4154-be09-8a5754413b55 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:15.339454 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97acfc77-ee56-4f96-9588-02f5faa4556e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:15.340225 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97acfc77-ee56-4f96-9588-02f5faa4556e None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:15.340498 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97acfc77-ee56-4f96-9588-02f5faa4556e None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:15.340775 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97acfc77-ee56-4f96-9588-02f5faa4556e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:15.354220 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be1689-25bb-4e1f-89a5-575260660683 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:15.356346 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97acfc77-ee56-4f96-9588-02f5faa4556e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:15.358840 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97acfc77-ee56-4f96-9588-02f5faa4556e None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:15.380855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-97acfc77-ee56-4f96-9588-02f5faa4556e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:15.380855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:15.380855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:15.380855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:15.380855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:15.380855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:15.380855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:15.380855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:15.380855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:15.380855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:15.380855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:15.380855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:15.380855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:15.380855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:15.380855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:15.381822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:15.381822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:15.381822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:15.381822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:15.381822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:15.381822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:15.381822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:15.381822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:15.381822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:15.381822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:15.381822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:15.381822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:15.381822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:15.381822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:15.381822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:15.381822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:15.381822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:15.382739 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:15.382739 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:15.382739 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:15.382739 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:15.382739 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 355/691] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:15.387933 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97acfc77-ee56-4f96-9588-02f5faa4556e None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:15.399699 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7645466e-e142-4520-8298-e45f4b16e899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:15.400331 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645466e-e142-4520-8298-e45f4b16e899 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:15.400609 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645466e-e142-4520-8298-e45f4b16e899 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:15.400879 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645466e-e142-4520-8298-e45f4b16e899 None admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:15.401578 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7645466e-e142-4520-8298-e45f4b16e899 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:15.401880 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7645466e-e142-4520-8298-e45f4b16e899 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:15.403310 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7645466e-e142-4520-8298-e45f4b16e899 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:15.421388 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 337/692] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:03:15.426834 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7645466e-e142-4520-8298-e45f4b16e899 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:15.428044 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:15.513515 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97acfc77-ee56-4f96-9588-02f5faa4556e None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:15.551095 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed00232-91b2-4edb-930f-8598b88b3d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:15.551949 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed00232-91b2-4edb-930f-8598b88b3d80 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:15.552338 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed00232-91b2-4edb-930f-8598b88b3d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:15.552714 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed00232-91b2-4edb-930f-8598b88b3d80 None admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:15.553716 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed00232-91b2-4edb-930f-8598b88b3d80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:15.554196 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed00232-91b2-4edb-930f-8598b88b3d80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:15.556300 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed00232-91b2-4edb-930f-8598b88b3d80 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:15.558121 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7645466e-e142-4520-8298-e45f4b16e899 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:15.568072 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:15.583150 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 356/693] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:03:15.588685 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed00232-91b2-4edb-930f-8598b88b3d80 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:15.601696 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c1f75-f235-4be4-8b72-180a67ce6d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:15.602722 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c1f75-f235-4be4-8b72-180a67ce6d3f None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:15.603705 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c1f75-f235-4be4-8b72-180a67ce6d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:15.604202 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c1f75-f235-4be4-8b72-180a67ce6d3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:15.612877 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3c1f75-f235-4be4-8b72-180a67ce6d3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:15.614626 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3c1f75-f235-4be4-8b72-180a67ce6d3f None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:15.629035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-2b3c1f75-f235-4be4-8b72-180a67ce6d3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:15.629035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:15.629035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:15.629035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:15.629035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:15.629035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:15.629035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:15.629035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:15.629035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:15.629035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:15.629035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:15.629035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:15.629035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:03:15.629035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:03:15.629035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:03:15.629990 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:03:15.629990 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:15.629990 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:15.629990 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:15.629990 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:15.629990 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:15.629990 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:15.629990 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:15.629990 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:15.629990 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:15.629990 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:15.629990 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:15.629990 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:15.629990 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:15.629990 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:15.629990 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:15.629990 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:15.630893 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:03:15.630893 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:03:15.630893 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:03:15.630893 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:03:15.630893 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:03:15.630893 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:03:15.630893 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:15.630893 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:15.633873 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 338/694] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:03:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:03:15.643429 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c1f75-f235-4be4-8b72-180a67ce6d3f None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:15.730983 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:15.744923 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed00232-91b2-4edb-930f-8598b88b3d80 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:15.787504 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6bca90-aaae-4715-9cfd-5980658beae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:15.789462 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bca90-aaae-4715-9cfd-5980658beae4 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:15.790654 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bca90-aaae-4715-9cfd-5980658beae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:15.791150 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bca90-aaae-4715-9cfd-5980658beae4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:15.802322 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6bca90-aaae-4715-9cfd-5980658beae4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:15.804750 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6bca90-aaae-4715-9cfd-5980658beae4 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:15.828053 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-cd6bca90-aaae-4715-9cfd-5980658beae4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:03:15.828053 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:15.828053 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:15.828053 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:15.828053 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:15.828053 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:15.828053 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:15.828053 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:15.828053 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:15.828053 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:15.828053 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:15.828053 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:15.828053 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:03:15.828053 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:03:15.828053 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:03:15.828053 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:03:15.829072 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:15.829072 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:15.829072 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:03:15.829072 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:15.829072 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:03:15.829072 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:15.829072 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:15.829072 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:15.829072 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:15.829072 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:15.829072 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:15.829072 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:15.829072 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:15.829072 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:15.829072 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:15.829072 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:15.829072 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:15.829072 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:15.830051 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:15.830051 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:15.830051 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:03:15.830051 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:03:15.830051 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:03:15.830051 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:03:15.830051 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:03:15.830051 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:03:15.830051 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:03:15.830051 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:15.837556 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 357/695] 10.222.0.60 () {56 vars in 1093 bytes} [Sun Jul 31 01:03:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:03:15.845180 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6bca90-aaae-4715-9cfd-5980658beae4 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:15.863285 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c1f75-f235-4be4-8b72-180a67ce6d3f None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:15.927098 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6c9f2-9eb0-425f-814b-f079970b9807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:15.927776 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6c9f2-9eb0-425f-814b-f079970b9807 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:15.928070 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6c9f2-9eb0-425f-814b-f079970b9807 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:15.928332 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6c9f2-9eb0-425f-814b-f079970b9807 None admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:15.929090 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6c9f2-9eb0-425f-814b-f079970b9807 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:15.929393 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6c9f2-9eb0-425f-814b-f079970b9807 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:15.930838 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6c9f2-9eb0-425f-814b-f079970b9807 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:15.943622 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 339/696] 10.222.0.60 () {56 vars in 1148 bytes} [Sun Jul 31 01:03:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:03:15.952352 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6c9f2-9eb0-425f-814b-f079970b9807 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:16.002620 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:16.037467 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6bca90-aaae-4715-9cfd-5980658beae4 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:16.091221 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af50d2-0b5b-46da-8ee5-ec73e7e65fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:16.091924 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af50d2-0b5b-46da-8ee5-ec73e7e65fdf None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:16.092208 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af50d2-0b5b-46da-8ee5-ec73e7e65fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:16.092482 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af50d2-0b5b-46da-8ee5-ec73e7e65fdf None admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:16.093283 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1af50d2-0b5b-46da-8ee5-ec73e7e65fdf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:16.093591 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1af50d2-0b5b-46da-8ee5-ec73e7e65fdf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:16.095124 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1af50d2-0b5b-46da-8ee5-ec73e7e65fdf None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:16.113224 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 358/697] 10.222.0.60 () {56 vars in 1133 bytes} [Sun Jul 31 01:03:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:16.118754 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af50d2-0b5b-46da-8ee5-ec73e7e65fdf None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:16.126953 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6c9f2-9eb0-425f-814b-f079970b9807 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:16.135902 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:16.183283 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff64cc-67a7-4864-aa39-445aae813e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:16.183968 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff64cc-67a7-4864-aa39-445aae813e2b None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:16.184251 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff64cc-67a7-4864-aa39-445aae813e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:16.184513 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff64cc-67a7-4864-aa39-445aae813e2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:16.185317 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eff64cc-67a7-4864-aa39-445aae813e2b None admin] RBAC: Adding query filter params (role.id=a5d1b78d4ec146848dfa667303603262, scope.project.id=b931b81a237949aa845891d4bb5aa1c0, user.id=0c8c98c1e2d24de89c7d07753fae02e5) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:16.185765 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eff64cc-67a7-4864-aa39-445aae813e2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:16.187212 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eff64cc-67a7-4864-aa39-445aae813e2b None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:16.194073 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 340/698] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:03:15 2022] GET /identity/v3/role_assignments?user.id=0c8c98c1e2d24de89c7d07753fae02e5&scope.project.id=b931b81a237949aa845891d4bb5aa1c0&role.id=a5d1b78d4ec146848dfa667303603262 => generated 608 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:03:16.195304 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d08e2-8656-42b6-b6bc-9def82a2c8a1 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:16.195638 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d08e2-8656-42b6-b6bc-9def82a2c8a1 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:16.195917 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d08e2-8656-42b6-b6bc-9def82a2c8a1 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:16.199530 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 341/699] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:16.203273 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d663852-c038-459a-8f98-ba66e1ca1fd3 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:16.203699 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d663852-c038-459a-8f98-ba66e1ca1fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:16.204074 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d663852-c038-459a-8f98-ba66e1ca1fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:16.229819 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-6d663852-c038-459a-8f98-ba66e1ca1fd3 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:16.231066 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-6d663852-c038-459a-8f98-ba66e1ca1fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:16.282650 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af50d2-0b5b-46da-8ee5-ec73e7e65fdf None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:16.349589 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53595081-855a-419e-8de3-ea449187c7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:16.350282 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53595081-855a-419e-8de3-ea449187c7d8 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:16.350509 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53595081-855a-419e-8de3-ea449187c7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:16.350770 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53595081-855a-419e-8de3-ea449187c7d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:16.396268 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 342/700] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:03:16.437110 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d663852-c038-459a-8f98-ba66e1ca1fd3 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:16.441268 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53595081-855a-419e-8de3-ea449187c7d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:16.442737 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53595081-855a-419e-8de3-ea449187c7d8 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:16.459247 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:16.467520 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:16.559753 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d663852-c038-459a-8f98-ba66e1ca1fd3 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:16.571057 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 359/701] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:03:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:03:16.572738 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89f352-528d-41c9-a1e5-7c4d0691a603 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:16.573023 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89f352-528d-41c9-a1e5-7c4d0691a603 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:16.573293 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89f352-528d-41c9-a1e5-7c4d0691a603 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:16.575063 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 360/702] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:16.580399 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89f352-528d-41c9-a1e5-7c4d0691a603 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:16.603038 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c61aec-d7bc-4e5b-b912-d9aa50af999a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:16.604097 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c61aec-d7bc-4e5b-b912-d9aa50af999a None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:16.604594 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c61aec-d7bc-4e5b-b912-d9aa50af999a None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:16.605072 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c61aec-d7bc-4e5b-b912-d9aa50af999a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:16.617741 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c61aec-d7bc-4e5b-b912-d9aa50af999a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:16.619225 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c61aec-d7bc-4e5b-b912-d9aa50af999a None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:16.635091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-d3c61aec-d7bc-4e5b-b912-d9aa50af999a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:16.635091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:16.635091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:16.635091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:16.635091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:16.635091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:16.635091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:16.635091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:16.635091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:16.635091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:16.635091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:16.635091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:16.635091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:16.635091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:16.635091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:16.636066 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:16.636066 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:16.636066 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:16.636066 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:16.636066 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:16.636066 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:16.636066 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:16.636066 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:16.636066 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:16.636066 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:16.636066 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:16.636066 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:16.636066 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:16.636066 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:16.636066 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:16.636066 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:16.636066 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:16.636948 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:16.636948 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:16.636948 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:16.636948 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:16.636948 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 343/703] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:16.637781 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cbe2e-c7d0-4599-98c9-5492cc315cdc None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:16.638061 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cbe2e-c7d0-4599-98c9-5492cc315cdc None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:16.638332 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cbe2e-c7d0-4599-98c9-5492cc315cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:16.661245 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-5c4cbe2e-c7d0-4599-98c9-5492cc315cdc None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:16.662360 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-5c4cbe2e-c7d0-4599-98c9-5492cc315cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:16.711524 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89f352-528d-41c9-a1e5-7c4d0691a603 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:16.725189 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:16.736299 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 344/704] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:03:16.742724 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4cbe2e-c7d0-4599-98c9-5492cc315cdc None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:16.745306 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:16.775232 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9076ba-90dc-4887-8387-b4c2963f7514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:16.776413 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9076ba-90dc-4887-8387-b4c2963f7514 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:16.776896 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9076ba-90dc-4887-8387-b4c2963f7514 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:16.777358 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9076ba-90dc-4887-8387-b4c2963f7514 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:16.793195 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9076ba-90dc-4887-8387-b4c2963f7514 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:16.795232 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9076ba-90dc-4887-8387-b4c2963f7514 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:16.811399 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-8b9076ba-90dc-4887-8387-b4c2963f7514 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:16.811399 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:16.811399 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:16.811399 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:16.811399 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:16.811399 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:16.811399 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:16.811399 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:16.811399 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:16.811399 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:16.811399 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:16.811399 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:16.811399 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:16.811399 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:16.811399 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:16.812365 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:16.812365 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:16.812365 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:16.812365 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:16.812365 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:16.812365 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:16.812365 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:16.812365 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:16.812365 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:16.812365 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:16.812365 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:16.812365 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:16.812365 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:16.812365 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:16.812365 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:16.812365 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:16.812365 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:16.813231 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:16.813231 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:16.813231 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:16.813231 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:16.815625 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 361/705] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:16.816650 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9076ba-90dc-4887-8387-b4c2963f7514 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:16.844687 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4cbe2e-c7d0-4599-98c9-5492cc315cdc None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:16.880154 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3db665-5532-4cd8-bd43-01a437738454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:16.880777 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3db665-5532-4cd8-bd43-01a437738454 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:16.881056 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3db665-5532-4cd8-bd43-01a437738454 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:16.881329 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3db665-5532-4cd8-bd43-01a437738454 None admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:16.882088 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3db665-5532-4cd8-bd43-01a437738454 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:16.882394 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3db665-5532-4cd8-bd43-01a437738454 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:16.883901 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3db665-5532-4cd8-bd43-01a437738454 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:16.896276 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 345/706] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:16.897184 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3db665-5532-4cd8-bd43-01a437738454 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:16.919713 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9076ba-90dc-4887-8387-b4c2963f7514 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:16.955213 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb03b24-9d89-4948-9cde-0a0026422a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:16.955895 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb03b24-9d89-4948-9cde-0a0026422a29 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:16.956169 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb03b24-9d89-4948-9cde-0a0026422a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:16.956438 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb03b24-9d89-4948-9cde-0a0026422a29 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:16.957161 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb03b24-9d89-4948-9cde-0a0026422a29 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:16.958642 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb03b24-9d89-4948-9cde-0a0026422a29 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:16.960154 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:16.972601 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-ccb03b24-9d89-4948-9cde-0a0026422a29 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 31 01:03:16.972601 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:16.972601 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:03:16.972601 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:03:16.972601 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:03:16.972601 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:03:16.972601 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:03:16.972601 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:16.972601 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 31 01:03:16.972601 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:16.972601 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:03:16.972601 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:16.972601 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:16.972601 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:16.972601 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:16.972601 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:16.973763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:16.973763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:16.973763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:16.973763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:16.973763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:16.973763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:16.973763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:16.973763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:03:16.973763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:03:16.973763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:03:16.973763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:03:16.973763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:16.973763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:16.973763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:16.973763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:16.973763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:16.974633 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:16.974633 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:16.974633 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:16.974633 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:16.974633 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:16.974633 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:16.974633 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:16.974633 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:16.974633 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:16.974633 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:16.974633 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:16.974633 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:03:16.974633 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:16.974633 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 31 01:03:16.974633 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:16.978853 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 362/707] 10.222.0.60 () {56 vars in 1129 bytes} [Sun Jul 31 01:03:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:16.979846 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb03b24-9d89-4948-9cde-0a0026422a29 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:17.001349 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3db665-5532-4cd8-bd43-01a437738454 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:17.007826 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:17.036907 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aeb42b-00d0-43e3-93a4-8fd7e3452d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:17.037835 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aeb42b-00d0-43e3-93a4-8fd7e3452d3b None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:17.038500 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aeb42b-00d0-43e3-93a4-8fd7e3452d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:17.039139 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aeb42b-00d0-43e3-93a4-8fd7e3452d3b None admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:17.039984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aeb42b-00d0-43e3-93a4-8fd7e3452d3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:17.040534 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aeb42b-00d0-43e3-93a4-8fd7e3452d3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:17.042587 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aeb42b-00d0-43e3-93a4-8fd7e3452d3b None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:17.058570 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 346/708] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:17.060014 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aeb42b-00d0-43e3-93a4-8fd7e3452d3b None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:17.081964 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb03b24-9d89-4948-9cde-0a0026422a29 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:17.117574 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563aaa8f-354a-4ea5-9eaa-53d481825123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:17.118199 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563aaa8f-354a-4ea5-9eaa-53d481825123 None admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:17.118473 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563aaa8f-354a-4ea5-9eaa-53d481825123 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:17.118737 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563aaa8f-354a-4ea5-9eaa-53d481825123 None admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:17.119544 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563aaa8f-354a-4ea5-9eaa-53d481825123 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:17.121033 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563aaa8f-354a-4ea5-9eaa-53d481825123 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:17.147821 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 363/709] 10.222.0.60 () {60 vars in 1132 bytes} [Sun Jul 31 01:03:16 2022] POST /identity/v3/users => generated 254 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:03:17.148715 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563aaa8f-354a-4ea5-9eaa-53d481825123 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:17.173298 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aeb42b-00d0-43e3-93a4-8fd7e3452d3b None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:17.198557 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:17.211358 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de55142-a5eb-4df4-a54a-c9b943fc2090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:17.212178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de55142-a5eb-4df4-a54a-c9b943fc2090 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:17.212519 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de55142-a5eb-4df4-a54a-c9b943fc2090 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:17.212881 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de55142-a5eb-4df4-a54a-c9b943fc2090 None admin] PATH_INFO: `/v3/services` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:17.213644 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de55142-a5eb-4df4-a54a-c9b943fc2090 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:17.214016 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de55142-a5eb-4df4-a54a-c9b943fc2090 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:17.215529 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de55142-a5eb-4df4-a54a-c9b943fc2090 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:17.220935 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 347/710] 10.222.0.60 () {56 vars in 1124 bytes} [Sun Jul 31 01:03:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:17.232669 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de55142-a5eb-4df4-a54a-c9b943fc2090 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:17.271539 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:17.309101 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563aaa8f-354a-4ea5-9eaa-53d481825123 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:17.369478 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de55142-a5eb-4df4-a54a-c9b943fc2090 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:17.383939 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01f65a-b3d4-43d3-83a9-2cbcb108f900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:17.384791 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01f65a-b3d4-43d3-83a9-2cbcb108f900 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:17.385134 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01f65a-b3d4-43d3-83a9-2cbcb108f900 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:17.385473 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01f65a-b3d4-43d3-83a9-2cbcb108f900 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:17.392957 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01f65a-b3d4-43d3-83a9-2cbcb108f900 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:17.394621 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01f65a-b3d4-43d3-83a9-2cbcb108f900 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:17.405760 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9ddac-6f14-450f-91d3-60819fc4e142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:17.406493 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9ddac-6f14-450f-91d3-60819fc4e142 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:17.406779 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9ddac-6f14-450f-91d3-60819fc4e142 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:17.407053 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9ddac-6f14-450f-91d3-60819fc4e142 None admin] PATH_INFO: `/v3/services` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:17.407769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9ddac-6f14-450f-91d3-60819fc4e142 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:17.408073 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9ddac-6f14-450f-91d3-60819fc4e142 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:17.408442 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-ff01f65a-b3d4-43d3-83a9-2cbcb108f900 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:17.408442 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:17.408442 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:17.408442 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:17.408442 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:17.408442 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:17.408442 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:17.408442 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:17.408442 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:17.408442 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:17.408442 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:17.408442 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:17.408442 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:03:17.408442 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:03:17.408442 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:03:17.409396 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:03:17.409396 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:17.409396 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:17.409396 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:17.409396 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:17.409396 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:17.409396 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:17.409396 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:17.409396 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:17.409396 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:17.409396 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:17.409396 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:17.409396 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:17.409396 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:17.409396 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:17.409396 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:17.409396 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:17.410352 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:03:17.410352 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:03:17.410352 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:03:17.410352 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:03:17.410352 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:03:17.410352 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:03:17.410352 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:17.410352 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:17.410781 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9ddac-6f14-450f-91d3-60819fc4e142 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:17.410851 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 364/711] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:03:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:17.417386 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01f65a-b3d4-43d3-83a9-2cbcb108f900 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:17.417636 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 348/712] 10.222.0.60 () {56 vars in 1124 bytes} [Sun Jul 31 01:03:17 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:17.534631 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01f65a-b3d4-43d3-83a9-2cbcb108f900 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:17.572223 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8385e4-d465-42ab-ba8b-d5d13baba805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:17.572870 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8385e4-d465-42ab-ba8b-d5d13baba805 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:17.573141 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8385e4-d465-42ab-ba8b-d5d13baba805 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:17.573410 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8385e4-d465-42ab-ba8b-d5d13baba805 None admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:17.574192 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8385e4-d465-42ab-ba8b-d5d13baba805 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:17.574495 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8385e4-d465-42ab-ba8b-d5d13baba805 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:17.576025 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8385e4-d465-42ab-ba8b-d5d13baba805 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:17.586635 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:17.590837 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 365/713] 10.222.0.60 () {56 vars in 1148 bytes} [Sun Jul 31 01:03:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:17.597113 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9ddac-6f14-450f-91d3-60819fc4e142 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:17.655100 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:17.705563 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9ddac-6f14-450f-91d3-60819fc4e142 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:17.739120 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7788e93-53c8-494e-94b5-930c4fa7d209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:17.739773 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7788e93-53c8-494e-94b5-930c4fa7d209 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:17.740051 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7788e93-53c8-494e-94b5-930c4fa7d209 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:17.740331 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7788e93-53c8-494e-94b5-930c4fa7d209 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:17.741123 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7788e93-53c8-494e-94b5-930c4fa7d209 None admin] RBAC: Adding query filter params (role.id=fef526a7d2e741ce995d107f3ac934ae, scope.project.id=b931b81a237949aa845891d4bb5aa1c0, user.id=04591cd035ef4961b8b7a93e294eb881) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:17.741419 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7788e93-53c8-494e-94b5-930c4fa7d209 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:17.742848 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7788e93-53c8-494e-94b5-930c4fa7d209 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:17.748972 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 349/714] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:03:17 2022] GET /identity/v3/role_assignments?user.id=04591cd035ef4961b8b7a93e294eb881&scope.project.id=b931b81a237949aa845891d4bb5aa1c0&role.id=fef526a7d2e741ce995d107f3ac934ae => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:17.998994 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b9970-f4b6-4cb3-a4ac-4abb65e51988 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:17.999270 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b9970-f4b6-4cb3-a4ac-4abb65e51988 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:17.999569 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b9970-f4b6-4cb3-a4ac-4abb65e51988 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:18.001197 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 366/715] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:18.006998 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea77469-9940-409c-a3bf-b524e55bfee9 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:18.007295 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea77469-9940-409c-a3bf-b524e55bfee9 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:18.007606 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea77469-9940-409c-a3bf-b524e55bfee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:18.027011 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-aea77469-9940-409c-a3bf-b524e55bfee9 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:18.028216 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-aea77469-9940-409c-a3bf-b524e55bfee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:18.098183 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 350/716] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:03:18.119473 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b9970-f4b6-4cb3-a4ac-4abb65e51988 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:18.248660 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b9970-f4b6-4cb3-a4ac-4abb65e51988 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:18.297672 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371bc780-a07c-4f43-aee7-e52dcd9cb929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:18.298382 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371bc780-a07c-4f43-aee7-e52dcd9cb929 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:18.298661 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371bc780-a07c-4f43-aee7-e52dcd9cb929 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:18.298933 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371bc780-a07c-4f43-aee7-e52dcd9cb929 None admin] PATH_INFO: `/v3/services/network` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:18.299595 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371bc780-a07c-4f43-aee7-e52dcd9cb929 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:18.300979 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371bc780-a07c-4f43-aee7-e52dcd9cb929 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:18.313110 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-371bc780-a07c-4f43-aee7-e52dcd9cb929 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 31 01:03:18.313110 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:18.313110 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:03:18.313110 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:03:18.313110 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:03:18.313110 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:03:18.313110 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:03:18.313110 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:18.313110 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 31 01:03:18.313110 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:18.313110 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:03:18.313110 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:18.313110 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:18.313110 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:18.313110 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:18.313110 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:18.313110 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:18.314106 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:18.314106 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:18.314106 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:18.314106 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:18.314106 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:18.314106 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:18.314106 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:03:18.314106 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:03:18.314106 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:03:18.314106 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:03:18.314106 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:18.314106 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:18.314106 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:18.314106 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:18.314106 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:18.314106 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:18.314967 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:18.314967 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:18.314967 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:18.314967 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:18.314967 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:18.314967 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:18.314967 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:18.314967 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:18.314967 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:18.314967 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:18.314967 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:03:18.314967 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:18.314967 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 31 01:03:18.314967 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:18.314967 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 367/717] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:03:18 2022] GET /identity/v3/services/network => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:18.320389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea77469-9940-409c-a3bf-b524e55bfee9 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:18.396598 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:18.452662 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea77469-9940-409c-a3bf-b524e55bfee9 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:18.486778 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355041b7-c685-4c4b-ad89-73cd6faa2a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:18.487409 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355041b7-c685-4c4b-ad89-73cd6faa2a8e None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:18.487707 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355041b7-c685-4c4b-ad89-73cd6faa2a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:18.487976 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355041b7-c685-4c4b-ad89-73cd6faa2a8e None admin] PATH_INFO: `/v3/services` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:18.488664 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355041b7-c685-4c4b-ad89-73cd6faa2a8e None admin] RBAC: Adding query filter params (name=network) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:18.489044 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355041b7-c685-4c4b-ad89-73cd6faa2a8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:18.490421 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355041b7-c685-4c4b-ad89-73cd6faa2a8e None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:18.495270 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 351/718] 10.222.0.60 () {56 vars in 1112 bytes} [Sun Jul 31 01:03:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:18.501094 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371bc780-a07c-4f43-aee7-e52dcd9cb929 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:18.565195 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:18.603925 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371bc780-a07c-4f43-aee7-e52dcd9cb929 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:18.637548 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e77c9f-c26f-4bd4-9acf-dc4c81486ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:18.638174 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e77c9f-c26f-4bd4-9acf-dc4c81486ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:18.638450 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e77c9f-c26f-4bd4-9acf-dc4c81486ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:18.638756 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e77c9f-c26f-4bd4-9acf-dc4c81486ea7 None admin] PATH_INFO: `/v3/services` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:18.639434 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e77c9f-c26f-4bd4-9acf-dc4c81486ea7 None admin] RBAC: Adding query filter params (type=network) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:18.639770 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e77c9f-c26f-4bd4-9acf-dc4c81486ea7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:18.641141 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e77c9f-c26f-4bd4-9acf-dc4c81486ea7 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:18.647439 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 368/719] 10.222.0.60 () {56 vars in 1112 bytes} [Sun Jul 31 01:03:18 2022] GET /identity/v3/services?type=network => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:18.848573 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac06d75-ace9-418a-9845-7200c75b336f None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:18.848765 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac06d75-ace9-418a-9845-7200c75b336f None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:18.849041 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac06d75-ace9-418a-9845-7200c75b336f None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:18.850655 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 352/720] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:18.855685 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bce16-0f09-4d58-90cd-4d4677e0375f None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:18.855972 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bce16-0f09-4d58-90cd-4d4677e0375f None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:18.856311 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bce16-0f09-4d58-90cd-4d4677e0375f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:18.878767 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-b98bce16-0f09-4d58-90cd-4d4677e0375f None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:18.879990 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-b98bce16-0f09-4d58-90cd-4d4677e0375f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:18.961666 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 369/721] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:03:18.994737 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac06d75-ace9-418a-9845-7200c75b336f None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:19.110886 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac06d75-ace9-418a-9845-7200c75b336f None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:19.132092 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:19.150552 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b474af-893a-45a6-a967-db8a0f0b3425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:19.151275 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b474af-893a-45a6-a967-db8a0f0b3425 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:19.151586 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b474af-893a-45a6-a967-db8a0f0b3425 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:19.151858 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b474af-893a-45a6-a967-db8a0f0b3425 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:19.169036 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b474af-893a-45a6-a967-db8a0f0b3425 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:03:19.174392 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-70b474af-893a-45a6-a967-db8a0f0b3425 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:03:19.174392 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:19.174392 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:19.174392 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:19.174392 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:19.174392 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:19.174392 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:19.174392 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:19.174392 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:19.174392 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:19.174392 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:19.174392 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:19.174392 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:03:19.174392 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:03:19.174392 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:03:19.174392 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:03:19.175415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:03:19.175415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:03:19.175415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:03:19.175415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:03:19.175415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:19.175415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:19.175415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:19.175415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:19.175415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:19.175415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:19.175415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:19.175415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:19.175415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:19.175415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:19.175415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:19.175415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:19.176296 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:19.176296 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:19.176296 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:19.176296 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:19.176296 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:03:19.176296 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:03:19.176296 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:03:19.176296 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:03:19.176296 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:03:19.176296 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:03:19.176296 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:03:19.176296 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:19.176296 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 353/722] 10.222.0.60 () {56 vars in 1096 bytes} [Sun Jul 31 01:03:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:19.184838 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98bce16-0f09-4d58-90cd-4d4677e0375f None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:19.278143 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:19.328109 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98bce16-0f09-4d58-90cd-4d4677e0375f None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:19.382212 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607ff69-2d31-4882-956a-ef76ba180947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:19.382853 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607ff69-2d31-4882-956a-ef76ba180947 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:19.383127 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607ff69-2d31-4882-956a-ef76ba180947 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:19.383395 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607ff69-2d31-4882-956a-ef76ba180947 None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:19.384153 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d607ff69-2d31-4882-956a-ef76ba180947 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:19.384447 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d607ff69-2d31-4882-956a-ef76ba180947 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:19.385836 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d607ff69-2d31-4882-956a-ef76ba180947 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:19.398772 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 370/723] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:03:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:19.404778 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b474af-893a-45a6-a967-db8a0f0b3425 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:19.528296 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b474af-893a-45a6-a967-db8a0f0b3425 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:19.564123 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b5b1f-201b-4b0b-8c6d-15f558715e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:19.565219 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b5b1f-201b-4b0b-8c6d-15f558715e98 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:19.565696 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b5b1f-201b-4b0b-8c6d-15f558715e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:19.566208 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b5b1f-201b-4b0b-8c6d-15f558715e98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:19.577755 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b5b1f-201b-4b0b-8c6d-15f558715e98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:19.579569 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b5b1f-201b-4b0b-8c6d-15f558715e98 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:19.596032 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-925b5b1f-201b-4b0b-8c6d-15f558715e98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:19.596032 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:19.596032 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:19.596032 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:19.596032 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:19.596032 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:19.596032 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:19.596032 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:19.596032 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:19.596032 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:19.596032 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:19.596032 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:19.596032 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:19.596032 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:19.596032 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:19.596988 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:19.596988 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:19.596988 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:19.596988 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:19.596988 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:19.596988 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:19.596988 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:19.596988 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:19.596988 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:19.596988 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:19.596988 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:19.596988 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:19.596988 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:19.596988 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:19.596988 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:19.596988 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:19.596988 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:19.597882 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:19.597882 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:19.597882 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:19.597882 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:19.600217 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 354/724] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:19.608661 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607ff69-2d31-4882-956a-ef76ba180947 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:19.771677 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607ff69-2d31-4882-956a-ef76ba180947 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:19.813145 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:19.816250 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64adba08-c888-4589-9636-e9654d3d3883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:19.817174 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adba08-c888-4589-9636-e9654d3d3883 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:19.817376 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adba08-c888-4589-9636-e9654d3d3883 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:19.823892 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adba08-c888-4589-9636-e9654d3d3883 None admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:19.824647 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64adba08-c888-4589-9636-e9654d3d3883 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:19.824960 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64adba08-c888-4589-9636-e9654d3d3883 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:19.826435 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64adba08-c888-4589-9636-e9654d3d3883 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:19.839659 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 371/725] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:19.845080 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b5b1f-201b-4b0b-8c6d-15f558715e98 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:19.868473 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea9288-e761-4318-b6f8-706110e72e0d None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:19.868812 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea9288-e761-4318-b6f8-706110e72e0d None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:19.869024 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea9288-e761-4318-b6f8-706110e72e0d None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:19.870393 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 372/726] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:19.887531 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:19.887733 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc5b68-e4a7-4895-be93-4a3dec820fd5 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:19.887733 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc5b68-e4a7-4895-be93-4a3dec820fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:19.887733 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc5b68-e4a7-4895-be93-4a3dec820fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:19.925961 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-7ccc5b68-e4a7-4895-be93-4a3dec820fd5 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:19.929546 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-7ccc5b68-e4a7-4895-be93-4a3dec820fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:20.039108 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 373/727] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:03:20.061765 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b5b1f-201b-4b0b-8c6d-15f558715e98 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:20.075405 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc5b68-e4a7-4895-be93-4a3dec820fd5 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:20.124871 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bbf7f8-f04c-4351-860f-ea72b9c5e27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:20.125786 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbf7f8-f04c-4351-860f-ea72b9c5e27d None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:20.126027 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbf7f8-f04c-4351-860f-ea72b9c5e27d None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:20.126339 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbf7f8-f04c-4351-860f-ea72b9c5e27d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:20.136743 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bbf7f8-f04c-4351-860f-ea72b9c5e27d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:20.138445 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bbf7f8-f04c-4351-860f-ea72b9c5e27d None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:20.152330 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-94bbf7f8-f04c-4351-860f-ea72b9c5e27d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 31 01:03:20.152330 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:20.152330 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:20.152330 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:20.152330 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:20.152330 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:20.152330 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:20.152330 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:20.152330 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:20.152330 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:20.152330 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:20.152330 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:20.152330 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:03:20.152330 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:03:20.152330 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:03:20.152330 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:03:20.153342 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:20.153342 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:20.153342 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:03:20.153342 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:20.153342 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:03:20.153342 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:20.153342 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:20.153342 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:20.153342 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:20.153342 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:20.153342 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:20.153342 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:20.153342 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:20.153342 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:20.153342 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:20.153342 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:20.153342 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:20.153342 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:20.154337 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:20.154337 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:20.154337 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:03:20.154337 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:03:20.154337 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:03:20.154337 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:03:20.154337 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:03:20.154337 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:03:20.154337 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 31 01:03:20.154337 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:20.154337 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 355/728] 10.222.0.60 () {56 vars in 1096 bytes} [Sun Jul 31 01:03:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:20.155512 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64937982-2379-49c5-aee8-66e7b4388709 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:20.155512 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64937982-2379-49c5-aee8-66e7b4388709 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:20.155689 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64937982-2379-49c5-aee8-66e7b4388709 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:20.157376 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 356/729] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:20.164034 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701aadc-f118-4b66-be6b-ce1f352cba6f None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:20.164312 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701aadc-f118-4b66-be6b-ce1f352cba6f None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:20.164579 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701aadc-f118-4b66-be6b-ce1f352cba6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:20.183691 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-6701aadc-f118-4b66-be6b-ce1f352cba6f None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:20.184904 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-6701aadc-f118-4b66-be6b-ce1f352cba6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:20.201038 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc5b68-e4a7-4895-be93-4a3dec820fd5 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:20.215531 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:20.245533 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14700287-5dfa-43e9-a44e-90382959bc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:20.245886 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14700287-5dfa-43e9-a44e-90382959bc76 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:20.246212 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14700287-5dfa-43e9-a44e-90382959bc76 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:20.246481 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14700287-5dfa-43e9-a44e-90382959bc76 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:20.258372 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14700287-5dfa-43e9-a44e-90382959bc76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:03:20.262997 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 357/730] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:03:20.264089 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6701aadc-f118-4b66-be6b-ce1f352cba6f None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:20.271852 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-14700287-5dfa-43e9-a44e-90382959bc76 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:03:20.271852 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:20.271852 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:20.271852 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:20.271852 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:20.271852 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:20.271852 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:20.271852 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:20.271852 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:20.271852 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:20.271852 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:20.271852 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:20.271852 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:03:20.271852 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:03:20.271852 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:03:20.271852 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:03:20.272966 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:03:20.272966 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:03:20.272966 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:03:20.272966 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:03:20.272966 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:20.272966 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:20.272966 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:20.272966 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:20.272966 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:20.272966 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:20.272966 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:20.272966 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:20.272966 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:20.272966 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:20.272966 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:20.272966 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:20.273814 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:20.273814 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:20.273814 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:20.273814 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:20.273814 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:03:20.273814 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:03:20.273814 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:03:20.273814 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:03:20.273814 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:03:20.273814 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:03:20.273814 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:03:20.273814 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:20.273814 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 374/731] 10.222.0.60 () {56 vars in 1102 bytes} [Sun Jul 31 01:03:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:03:20.279113 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:20.279513 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14700287-5dfa-43e9-a44e-90382959bc76 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:20.382799 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6701aadc-f118-4b66-be6b-ce1f352cba6f None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:20.397400 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14700287-5dfa-43e9-a44e-90382959bc76 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:20.420468 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde3665-5e26-4fc8-a047-a79197b915e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:20.421185 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde3665-5e26-4fc8-a047-a79197b915e5 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:20.421470 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde3665-5e26-4fc8-a047-a79197b915e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:20.421746 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde3665-5e26-4fc8-a047-a79197b915e5 None admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:20.422730 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde3665-5e26-4fc8-a047-a79197b915e5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:20.423129 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde3665-5e26-4fc8-a047-a79197b915e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:20.424678 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde3665-5e26-4fc8-a047-a79197b915e5 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:20.433512 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaea809-e636-447c-a99f-28c84e03e72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:20.434139 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaea809-e636-447c-a99f-28c84e03e72d None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:20.434417 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaea809-e636-447c-a99f-28c84e03e72d None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:20.434687 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaea809-e636-447c-a99f-28c84e03e72d None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:20.435433 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaea809-e636-447c-a99f-28c84e03e72d None admin] RBAC: Adding query filter params (name=service) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:20.435766 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaea809-e636-447c-a99f-28c84e03e72d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:20.437127 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaea809-e636-447c-a99f-28c84e03e72d None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:20.448715 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 358/732] 10.222.0.60 () {56 vars in 1135 bytes} [Sun Jul 31 01:03:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:20.448715 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25552399-2a4a-489e-9941-08e66bd3db71 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:20.448959 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 375/733] 10.222.0.60 () {56 vars in 1103 bytes} [Sun Jul 31 01:03:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:20.448959 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaea809-e636-447c-a99f-28c84e03e72d None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:20.449117 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25552399-2a4a-489e-9941-08e66bd3db71 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:20.449117 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25552399-2a4a-489e-9941-08e66bd3db71 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:20.449847 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 359/734] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:20.450616 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25552399-2a4a-489e-9941-08e66bd3db71 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:20.487926 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:20.531569 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:20.559860 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaea809-e636-447c-a99f-28c84e03e72d None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:20.569267 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25552399-2a4a-489e-9941-08e66bd3db71 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:20.597206 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e575e10-5248-464c-a398-39f13c2d69fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:20.597840 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e575e10-5248-464c-a398-39f13c2d69fb None admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:20.598110 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e575e10-5248-464c-a398-39f13c2d69fb None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:20.598377 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e575e10-5248-464c-a398-39f13c2d69fb None admin] PATH_INFO: `/v3/services` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:20.599070 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e575e10-5248-464c-a398-39f13c2d69fb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:20.600503 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e575e10-5248-464c-a398-39f13c2d69fb None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:20.606906 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b511429-cd96-4fbe-8049-20e977b424c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:20.607695 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b511429-cd96-4fbe-8049-20e977b424c5 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:20.607977 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b511429-cd96-4fbe-8049-20e977b424c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:20.608244 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b511429-cd96-4fbe-8049-20e977b424c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:20.627957 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 376/735] 10.222.0.60 () {60 vars in 1141 bytes} [Sun Jul 31 01:03:20 2022] POST /identity/v3/services => generated 251 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:03:20.627957 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e575e10-5248-464c-a398-39f13c2d69fb None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:20.695821 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b511429-cd96-4fbe-8049-20e977b424c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:20.697435 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b511429-cd96-4fbe-8049-20e977b424c5 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:20.757495 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:20.782775 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e575e10-5248-464c-a398-39f13c2d69fb None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:20.801210 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:20.828622 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f5db63-cf50-4f95-b823-bd1b863fd399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:20.830634 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5db63-cf50-4f95-b823-bd1b863fd399 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:20.830901 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 360/736] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:03:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:03:20.832993 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa2a40-aa48-4e87-a7a1-7cece6929830 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:20.833283 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa2a40-aa48-4e87-a7a1-7cece6929830 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:20.833555 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa2a40-aa48-4e87-a7a1-7cece6929830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:20.835842 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5db63-cf50-4f95-b823-bd1b863fd399 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:20.836136 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5db63-cf50-4f95-b823-bd1b863fd399 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:20.856371 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-8dfa2a40-aa48-4e87-a7a1-7cece6929830 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:20.857651 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-8dfa2a40-aa48-4e87-a7a1-7cece6929830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:20.938584 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 361/737] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:20 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:03:20.939419 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa2a40-aa48-4e87-a7a1-7cece6929830 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:20.977438 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f5db63-cf50-4f95-b823-bd1b863fd399 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:20.979096 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f5db63-cf50-4f95-b823-bd1b863fd399 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:20.998487 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-53f5db63-cf50-4f95-b823-bd1b863fd399 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:20.998487 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:20.998487 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:20.998487 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:20.998487 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:20.998487 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:20.998487 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:20.998487 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:20.998487 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:20.998487 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:20.998487 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:20.998487 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:20.998487 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:20.998487 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:20.998487 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:20.999552 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:20.999552 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:20.999552 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:20.999552 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:20.999552 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:20.999552 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:20.999552 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:20.999552 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:20.999552 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:20.999552 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:20.999552 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:20.999552 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:20.999552 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:20.999552 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:20.999552 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:20.999552 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:20.999552 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:21.000635 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:21.000635 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:21.000635 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:21.000635 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:21.000635 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 377/738] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:21.006149 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f5db63-cf50-4f95-b823-bd1b863fd399 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:21.062147 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:21.067333 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa2a40-aa48-4e87-a7a1-7cece6929830 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:21.104883 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9c723-9f81-48b9-b6e3-f4ef83a62f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:21.105667 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9c723-9f81-48b9-b6e3-f4ef83a62f74 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:21.105929 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9c723-9f81-48b9-b6e3-f4ef83a62f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:21.106181 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9c723-9f81-48b9-b6e3-f4ef83a62f74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:21.117763 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f9c723-9f81-48b9-b6e3-f4ef83a62f74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:21.119229 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f9c723-9f81-48b9-b6e3-f4ef83a62f74 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:21.131476 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f5db63-cf50-4f95-b823-bd1b863fd399 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:21.135359 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-27f9c723-9f81-48b9-b6e3-f4ef83a62f74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:21.135359 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:21.135359 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:21.135359 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:21.135359 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:21.135359 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:21.135359 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:21.135359 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:21.135359 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:21.135359 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:21.135359 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:21.135359 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:21.135359 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:21.135359 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:21.135359 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:21.136319 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:21.136319 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:21.136319 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:21.136319 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:21.136319 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:21.136319 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:21.136319 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:21.136319 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:21.136319 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:21.136319 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:21.136319 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:21.136319 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:21.136319 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:21.136319 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:21.136319 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:21.136319 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:21.136319 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:21.137227 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:21.137227 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:21.137227 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:21.137227 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:21.137227 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 362/739] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:21.137534 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9c723-9f81-48b9-b6e3-f4ef83a62f74 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:21.171066 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc43f2-987e-42f1-bdd8-0c4e02a94548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:21.171851 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc43f2-987e-42f1-bdd8-0c4e02a94548 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:21.172140 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc43f2-987e-42f1-bdd8-0c4e02a94548 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:21.172404 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc43f2-987e-42f1-bdd8-0c4e02a94548 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:21.180980 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:21.184960 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc43f2-987e-42f1-bdd8-0c4e02a94548 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:03:21.190648 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-06cc43f2-987e-42f1-bdd8-0c4e02a94548 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:03:21.190648 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:21.190648 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:21.190648 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:21.190648 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:21.190648 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:21.190648 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:21.190648 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:21.190648 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:21.190648 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:21.190648 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:21.190648 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:21.190648 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:03:21.190648 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:03:21.190648 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:03:21.190648 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:03:21.191782 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:03:21.191782 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:03:21.191782 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:03:21.191782 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:03:21.191782 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:21.191782 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:21.191782 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:21.191782 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:21.191782 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:21.191782 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:21.191782 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:21.191782 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:21.191782 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:21.191782 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:21.191782 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:21.191782 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:21.192721 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:21.192721 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:21.192721 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:21.192721 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:21.192721 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:03:21.192721 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:03:21.192721 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:03:21.192721 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:03:21.192721 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:03:21.192721 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:03:21.192721 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:03:21.192721 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:21.192721 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 378/740] 10.222.0.60 () {56 vars in 1096 bytes} [Sun Jul 31 01:03:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:21.193492 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15acbe3-67fd-41e4-9696-7f5303561c44 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:21.193628 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15acbe3-67fd-41e4-9696-7f5303561c44 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:21.193900 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15acbe3-67fd-41e4-9696-7f5303561c44 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:21.195308 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 379/741] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:21.195896 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15acbe3-67fd-41e4-9696-7f5303561c44 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:21.271365 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9c723-9f81-48b9-b6e3-f4ef83a62f74 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:21.310615 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a227994-8e27-4348-b01a-1ae4eb380f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:21.310835 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15acbe3-67fd-41e4-9696-7f5303561c44 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:21.311276 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a227994-8e27-4348-b01a-1ae4eb380f48 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:21.311583 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a227994-8e27-4348-b01a-1ae4eb380f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:21.311856 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a227994-8e27-4348-b01a-1ae4eb380f48 None admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:21.312555 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a227994-8e27-4348-b01a-1ae4eb380f48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:21.312857 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a227994-8e27-4348-b01a-1ae4eb380f48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:21.314227 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a227994-8e27-4348-b01a-1ae4eb380f48 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:21.326308 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 363/742] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:21.327587 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14988df2-5871-401c-a05f-cd3aa13ff406 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:21.327867 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14988df2-5871-401c-a05f-cd3aa13ff406 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:21.328140 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14988df2-5871-401c-a05f-cd3aa13ff406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:21.347080 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-14988df2-5871-401c-a05f-cd3aa13ff406 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:21.348544 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-14988df2-5871-401c-a05f-cd3aa13ff406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:21.352219 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357da518-a898-463b-bd32-f22cdd6c37a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:21.352782 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:21.352886 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357da518-a898-463b-bd32-f22cdd6c37a7 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:21.353121 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357da518-a898-463b-bd32-f22cdd6c37a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:21.353387 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357da518-a898-463b-bd32-f22cdd6c37a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:21.355526 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357da518-a898-463b-bd32-f22cdd6c37a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:21.355526 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357da518-a898-463b-bd32-f22cdd6c37a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:21.355816 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357da518-a898-463b-bd32-f22cdd6c37a7 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:21.373399 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 380/743] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:21.374215 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357da518-a898-463b-bd32-f22cdd6c37a7 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:21.450184 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:21.451790 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 364/744] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:21 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:03:21.452700 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14988df2-5871-401c-a05f-cd3aa13ff406 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:21.496220 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357da518-a898-463b-bd32-f22cdd6c37a7 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:21.535585 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c290083d-8b95-4c25-a166-ac623cee22c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:21.536622 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290083d-8b95-4c25-a166-ac623cee22c7 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:21.537153 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290083d-8b95-4c25-a166-ac623cee22c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:21.537728 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290083d-8b95-4c25-a166-ac623cee22c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:21.538510 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c290083d-8b95-4c25-a166-ac623cee22c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:21.538812 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c290083d-8b95-4c25-a166-ac623cee22c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:21.540196 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c290083d-8b95-4c25-a166-ac623cee22c7 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:21.550079 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 381/745] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:03:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:21.550902 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c290083d-8b95-4c25-a166-ac623cee22c7 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:21.572252 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14988df2-5871-401c-a05f-cd3aa13ff406 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:21.616775 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db77304-f002-4d3b-8d93-c93d7aa0de00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:21.618406 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db77304-f002-4d3b-8d93-c93d7aa0de00 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:21.619154 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db77304-f002-4d3b-8d93-c93d7aa0de00 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:21.619671 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db77304-f002-4d3b-8d93-c93d7aa0de00 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:21.630736 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db77304-f002-4d3b-8d93-c93d7aa0de00 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:21.633216 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db77304-f002-4d3b-8d93-c93d7aa0de00 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:21.637596 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:21.648702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-0db77304-f002-4d3b-8d93-c93d7aa0de00 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 31 01:03:21.648702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:21.648702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:21.648702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:21.648702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:21.648702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:21.648702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:21.648702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:21.648702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:21.648702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:21.648702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:21.648702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:21.648702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:03:21.648702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:03:21.648702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:03:21.648702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:03:21.649650 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:21.649650 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:21.649650 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:03:21.649650 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:21.649650 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:03:21.649650 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:21.649650 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:21.649650 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:21.649650 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:21.649650 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:21.649650 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:21.649650 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:21.649650 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:21.649650 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:21.649650 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:21.649650 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:21.649650 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:21.649650 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:21.650568 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:21.650568 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:21.650568 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:03:21.650568 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:03:21.650568 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:03:21.650568 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:03:21.650568 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:03:21.650568 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:03:21.650568 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 31 01:03:21.650568 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:21.650568 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 365/746] 10.222.0.60 () {56 vars in 1117 bytes} [Sun Jul 31 01:03:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:21.651220 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db77304-f002-4d3b-8d93-c93d7aa0de00 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:21.657271 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c290083d-8b95-4c25-a166-ac623cee22c7 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:21.681973 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:21.694281 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5279383-1e5f-4e3e-b24c-6cfd77ca45e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:21.694947 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5279383-1e5f-4e3e-b24c-6cfd77ca45e5 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:21.695210 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5279383-1e5f-4e3e-b24c-6cfd77ca45e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:21.695493 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5279383-1e5f-4e3e-b24c-6cfd77ca45e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:21.702409 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5279383-1e5f-4e3e-b24c-6cfd77ca45e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:21.703821 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5279383-1e5f-4e3e-b24c-6cfd77ca45e5 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:21.715800 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-c5279383-1e5f-4e3e-b24c-6cfd77ca45e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:21.715800 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:21.715800 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:21.715800 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:21.715800 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:21.715800 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:21.715800 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:21.715800 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:21.715800 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:21.715800 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:21.715800 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:21.715800 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:21.715800 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:03:21.715800 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:03:21.715800 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:03:21.716843 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:03:21.716843 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:21.716843 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:21.716843 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:21.716843 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:21.716843 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:21.716843 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:21.716843 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:21.716843 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:21.716843 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:21.716843 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:21.716843 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:21.716843 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:21.716843 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:21.716843 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:21.716843 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:21.716843 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:21.717726 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:03:21.717726 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:03:21.717726 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:03:21.717726 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:03:21.717726 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:03:21.717726 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:03:21.717726 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:21.717726 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:21.717726 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 382/747] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:03:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:21.718202 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5279383-1e5f-4e3e-b24c-6cfd77ca45e5 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:21.770488 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db77304-f002-4d3b-8d93-c93d7aa0de00 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:21.808275 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b2ff0-d354-42f4-8fa0-a766c549c36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:21.808903 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b2ff0-d354-42f4-8fa0-a766c549c36d None admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:21.809173 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b2ff0-d354-42f4-8fa0-a766c549c36d None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:21.809431 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b2ff0-d354-42f4-8fa0-a766c549c36d None admin] PATH_INFO: `/v3/services` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:21.810147 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b2ff0-d354-42f4-8fa0-a766c549c36d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:21.811823 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b2ff0-d354-42f4-8fa0-a766c549c36d None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:21.819784 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5279383-1e5f-4e3e-b24c-6cfd77ca45e5 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:21.831331 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 366/748] 10.222.0.60 () {60 vars in 1141 bytes} [Sun Jul 31 01:03:21 2022] POST /identity/v3/services => generated 240 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:03:21.832678 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b2ff0-d354-42f4-8fa0-a766c549c36d None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:21.878378 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06817df0-28be-4d70-af30-776c0ee18d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:21.879043 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06817df0-28be-4d70-af30-776c0ee18d58 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:21.879304 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06817df0-28be-4d70-af30-776c0ee18d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:21.879592 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06817df0-28be-4d70-af30-776c0ee18d58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:21.892299 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06817df0-28be-4d70-af30-776c0ee18d58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:21.893829 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06817df0-28be-4d70-af30-776c0ee18d58 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:21.909824 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-06817df0-28be-4d70-af30-776c0ee18d58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:21.909824 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:21.909824 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:21.909824 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:21.909824 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:21.909824 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:21.909824 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:21.909824 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:21.909824 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:21.909824 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:21.909824 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:21.909824 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:21.909824 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:21.909824 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:21.909824 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:21.910833 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:21.910833 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:21.910833 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:21.910833 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:21.910833 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:21.910833 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:21.910833 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:21.910833 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:21.910833 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:21.910833 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:21.910833 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:21.910833 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:21.910833 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:21.910833 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:21.910833 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:21.910833 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:21.910833 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:21.911822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:21.911822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:21.911822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:21.911822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:21.911822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 383/749] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:21.912530 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06817df0-28be-4d70-af30-776c0ee18d58 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:21.922284 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:21.952351 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:21.983268 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b2ff0-d354-42f4-8fa0-a766c549c36d None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:22.032409 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03299f9c-bff2-44bf-801f-1622215cf14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:22.033192 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03299f9c-bff2-44bf-801f-1622215cf14a None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:22.033478 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03299f9c-bff2-44bf-801f-1622215cf14a None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:22.034433 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03299f9c-bff2-44bf-801f-1622215cf14a None admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:22.034917 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03299f9c-bff2-44bf-801f-1622215cf14a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:22.035230 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03299f9c-bff2-44bf-801f-1622215cf14a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:22.036705 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03299f9c-bff2-44bf-801f-1622215cf14a None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:22.048355 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06817df0-28be-4d70-af30-776c0ee18d58 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:22.057745 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 367/750] 10.222.0.60 () {56 vars in 1149 bytes} [Sun Jul 31 01:03:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:22.058985 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03299f9c-bff2-44bf-801f-1622215cf14a None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:22.090734 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81defe-27f8-4fff-aa50-48c1ca3dd48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:22.091572 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81defe-27f8-4fff-aa50-48c1ca3dd48b None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:22.091902 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81defe-27f8-4fff-aa50-48c1ca3dd48b None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:22.092502 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81defe-27f8-4fff-aa50-48c1ca3dd48b None admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:22.093556 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81defe-27f8-4fff-aa50-48c1ca3dd48b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:22.093867 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81defe-27f8-4fff-aa50-48c1ca3dd48b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:22.096227 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81defe-27f8-4fff-aa50-48c1ca3dd48b None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:22.111930 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 384/751] 10.222.0.60 () {56 vars in 1148 bytes} [Sun Jul 31 01:03:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:22.116104 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81defe-27f8-4fff-aa50-48c1ca3dd48b None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:22.187510 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03299f9c-bff2-44bf-801f-1622215cf14a None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:22.214388 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:22.226711 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92d238-3ec2-4e3b-a22d-abc612805023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:22.227852 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:22.228301 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92d238-3ec2-4e3b-a22d-abc612805023 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:22.228771 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92d238-3ec2-4e3b-a22d-abc612805023 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:22.230491 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92d238-3ec2-4e3b-a22d-abc612805023 None admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:22.231817 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf92d238-3ec2-4e3b-a22d-abc612805023 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:22.232397 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf92d238-3ec2-4e3b-a22d-abc612805023 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:22.235438 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf92d238-3ec2-4e3b-a22d-abc612805023 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:22.241177 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81defe-27f8-4fff-aa50-48c1ca3dd48b None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:22.252651 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 368/752] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:22.254327 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92d238-3ec2-4e3b-a22d-abc612805023 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:22.290788 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292fa41a-c894-4a5a-adc5-ef21bf21c4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:22.292224 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fa41a-c894-4a5a-adc5-ef21bf21c4cf None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:22.292502 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fa41a-c894-4a5a-adc5-ef21bf21c4cf None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:22.292774 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fa41a-c894-4a5a-adc5-ef21bf21c4cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:22.365398 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92d238-3ec2-4e3b-a22d-abc612805023 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:22.383874 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292fa41a-c894-4a5a-adc5-ef21bf21c4cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:22.385760 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292fa41a-c894-4a5a-adc5-ef21bf21c4cf None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:22.403084 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0783b-40d0-436e-97cd-ec43459958a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:22.403906 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0783b-40d0-436e-97cd-ec43459958a6 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:22.404356 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0783b-40d0-436e-97cd-ec43459958a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:22.404744 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0783b-40d0-436e-97cd-ec43459958a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:22.405680 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d0783b-40d0-436e-97cd-ec43459958a6 None admin] RBAC: Adding query filter params (role.id=fef526a7d2e741ce995d107f3ac934ae, scope.project.id=b931b81a237949aa845891d4bb5aa1c0, user.id=0c8c98c1e2d24de89c7d07753fae02e5) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:22.406089 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d0783b-40d0-436e-97cd-ec43459958a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:22.407740 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d0783b-40d0-436e-97cd-ec43459958a6 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:22.420177 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 369/753] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:03:22 2022] GET /identity/v3/role_assignments?user.id=0c8c98c1e2d24de89c7d07753fae02e5&scope.project.id=b931b81a237949aa845891d4bb5aa1c0&role.id=fef526a7d2e741ce995d107f3ac934ae => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:22.421320 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0783b-40d0-436e-97cd-ec43459958a6 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:22.519351 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:22.535939 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:22.541435 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 385/754] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:03:22 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:03:22.547401 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292fa41a-c894-4a5a-adc5-ef21bf21c4cf None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:22.659071 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0783b-40d0-436e-97cd-ec43459958a6 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:22.701202 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292fa41a-c894-4a5a-adc5-ef21bf21c4cf None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:22.739615 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada2c519-c273-4a54-b6b3-090409482434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:22.740695 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2c519-c273-4a54-b6b3-090409482434 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:22.740977 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2c519-c273-4a54-b6b3-090409482434 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:22.741249 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2c519-c273-4a54-b6b3-090409482434 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:22.746456 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81d254-01c1-4b96-b1ae-4717e21b42ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:22.748000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81d254-01c1-4b96-b1ae-4717e21b42ce None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:22.748282 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81d254-01c1-4b96-b1ae-4717e21b42ce None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:22.748554 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81d254-01c1-4b96-b1ae-4717e21b42ce None admin] PATH_INFO: `/v3/users/nova` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:22.764957 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada2c519-c273-4a54-b6b3-090409482434 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:22.766442 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada2c519-c273-4a54-b6b3-090409482434 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:22.768196 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c81d254-01c1-4b96-b1ae-4717e21b42ce None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:22.771623 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c81d254-01c1-4b96-b1ae-4717e21b42ce None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:22.797319 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-ada2c519-c273-4a54-b6b3-090409482434 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:22.797319 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:22.797319 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:22.797319 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:22.797319 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:22.797319 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:22.797319 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:22.797319 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:22.797319 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:22.797319 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:22.797319 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:22.797319 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:22.797319 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:22.797319 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:22.797319 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:22.798770 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:22.798770 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:22.798770 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:22.798770 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:22.798770 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:22.798770 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:22.798770 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:22.798770 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:22.798770 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:22.798770 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:22.798770 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:22.798770 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:22.798770 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:22.798770 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:22.798770 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:22.798770 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:22.798770 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:22.800174 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:22.800174 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:22.800174 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:22.800174 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:22.800827 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-0c81d254-01c1-4b96-b1ae-4717e21b42ce None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:03:22.800827 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:22.800827 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:22.800827 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:22.800827 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:22.800827 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:22.800827 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:22.800827 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:22.800827 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:22.800827 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:22.800827 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:22.800827 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:22.800827 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:03:22.800827 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:03:22.800827 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:03:22.800827 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:03:22.802034 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:22.802034 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:22.802034 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:03:22.802034 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:22.802034 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:03:22.802034 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:22.802034 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:22.802034 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:22.802034 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:22.802034 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:22.802034 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:22.802034 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:22.802034 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:22.802034 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:22.802034 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:22.802034 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:22.802034 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:22.802034 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:22.803190 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:22.803190 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:22.803190 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:03:22.803190 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:03:22.803190 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:03:22.803190 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:03:22.803190 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:03:22.803190 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:03:22.803190 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:03:22.803190 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:22.803190 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 370/755] 10.222.0.60 () {56 vars in 1093 bytes} [Sun Jul 31 01:03:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:22.803190 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba55aa7-230d-4228-9b76-df1cc429cd22 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:22.803190 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba55aa7-230d-4228-9b76-df1cc429cd22 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:22.804630 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba55aa7-230d-4228-9b76-df1cc429cd22 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:22.804630 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 371/756] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:22.811567 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 386/757] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:22.811567 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada2c519-c273-4a54-b6b3-090409482434 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:22.812219 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f5a6b-18c3-4528-80e8-2ee63b3efa10 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:22.812482 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f5a6b-18c3-4528-80e8-2ee63b3efa10 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:22.812753 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f5a6b-18c3-4528-80e8-2ee63b3efa10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:22.832584 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-543f5a6b-18c3-4528-80e8-2ee63b3efa10 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:22.833778 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-543f5a6b-18c3-4528-80e8-2ee63b3efa10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:22.870805 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:22.920025 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 372/758] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:03:22.920796 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f5a6b-18c3-4528-80e8-2ee63b3efa10 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:22.946023 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada2c519-c273-4a54-b6b3-090409482434 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:22.967951 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:22.993765 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c0697-cf1d-4752-99f9-d467dadb21a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:22.995072 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c0697-cf1d-4752-99f9-d467dadb21a2 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:22.995993 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c0697-cf1d-4752-99f9-d467dadb21a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:22.996747 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c0697-cf1d-4752-99f9-d467dadb21a2 None admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:22.998055 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c0697-cf1d-4752-99f9-d467dadb21a2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:22.998978 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c0697-cf1d-4752-99f9-d467dadb21a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:23.001201 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c0697-cf1d-4752-99f9-d467dadb21a2 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:23.031817 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 387/759] 10.222.0.60 () {56 vars in 1133 bytes} [Sun Jul 31 01:03:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:23.031817 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c0697-cf1d-4752-99f9-d467dadb21a2 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:23.056018 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f5a6b-18c3-4528-80e8-2ee63b3efa10 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:23.102055 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405f08b-9452-40a0-99e7-ec99ce8953e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:23.103626 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405f08b-9452-40a0-99e7-ec99ce8953e3 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:23.104348 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405f08b-9452-40a0-99e7-ec99ce8953e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:23.104826 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405f08b-9452-40a0-99e7-ec99ce8953e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:23.106337 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8405f08b-9452-40a0-99e7-ec99ce8953e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:23.106844 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8405f08b-9452-40a0-99e7-ec99ce8953e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:23.108495 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8405f08b-9452-40a0-99e7-ec99ce8953e3 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:23.131092 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 373/760] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:23.132242 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405f08b-9452-40a0-99e7-ec99ce8953e3 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:23.168796 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:23.174458 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c0697-cf1d-4752-99f9-d467dadb21a2 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:23.218536 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d5511-e517-49f3-8bdb-cb557211b8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:23.219651 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d5511-e517-49f3-8bdb-cb557211b8d5 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:23.220129 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d5511-e517-49f3-8bdb-cb557211b8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:23.220595 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d5511-e517-49f3-8bdb-cb557211b8d5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:23.221457 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d5511-e517-49f3-8bdb-cb557211b8d5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:23.223835 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d5511-e517-49f3-8bdb-cb557211b8d5 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:23.236494 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-b81d5511-e517-49f3-8bdb-cb557211b8d5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 31 01:03:23.236494 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:23.236494 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:03:23.236494 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:03:23.236494 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:03:23.236494 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:03:23.236494 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:03:23.236494 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:23.236494 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 31 01:03:23.236494 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:23.236494 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:03:23.236494 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:23.236494 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:23.236494 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:23.236494 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:23.236494 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:23.237473 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:23.237473 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:23.237473 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:23.237473 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:23.237473 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:23.237473 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:23.237473 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:23.237473 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:03:23.237473 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:03:23.237473 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:03:23.237473 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:03:23.237473 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:23.237473 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:23.237473 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:23.237473 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:23.237473 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:23.238322 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:23.238322 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:23.238322 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:23.238322 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:23.238322 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:23.238322 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:23.238322 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:23.238322 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:23.238322 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:23.238322 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:23.238322 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:23.238322 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:03:23.238322 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:23.238322 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 31 01:03:23.238322 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:23.241759 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 388/761] 10.222.0.60 () {56 vars in 1129 bytes} [Sun Jul 31 01:03:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:23.242713 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d5511-e517-49f3-8bdb-cb557211b8d5 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:23.249938 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:23.264701 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405f08b-9452-40a0-99e7-ec99ce8953e3 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:23.299857 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb8782-d04e-41af-9ab1-47ba875b45c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:23.300817 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb8782-d04e-41af-9ab1-47ba875b45c4 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:23.301258 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb8782-d04e-41af-9ab1-47ba875b45c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:23.301659 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb8782-d04e-41af-9ab1-47ba875b45c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:23.313211 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb8782-d04e-41af-9ab1-47ba875b45c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:23.314864 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb8782-d04e-41af-9ab1-47ba875b45c4 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:23.330032 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-1eeb8782-d04e-41af-9ab1-47ba875b45c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:23.330032 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:23.330032 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:23.330032 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:23.330032 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:23.330032 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:23.330032 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:23.330032 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:23.330032 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:23.330032 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:23.330032 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:23.330032 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:23.330032 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:23.330032 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:23.330032 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:23.331043 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:23.331043 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:23.331043 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:23.331043 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:23.331043 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:23.331043 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:23.331043 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:23.331043 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:23.331043 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:23.331043 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:23.331043 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:23.331043 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:23.331043 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:23.331043 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:23.331043 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:23.331043 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:23.331043 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:23.331957 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:23.331957 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:23.331957 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:23.331957 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:23.333724 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 374/762] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:23.334696 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb8782-d04e-41af-9ab1-47ba875b45c4 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:23.358880 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d5511-e517-49f3-8bdb-cb557211b8d5 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:23.393709 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574addc4-f6e8-48ce-bd20-331490e7f4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:23.394483 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574addc4-f6e8-48ce-bd20-331490e7f4f6 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:23.394826 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574addc4-f6e8-48ce-bd20-331490e7f4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:23.395212 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574addc4-f6e8-48ce-bd20-331490e7f4f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:23.402771 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574addc4-f6e8-48ce-bd20-331490e7f4f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:23.404384 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574addc4-f6e8-48ce-bd20-331490e7f4f6 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:23.416434 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-574addc4-f6e8-48ce-bd20-331490e7f4f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:23.416434 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:23.416434 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:23.416434 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:23.416434 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:23.416434 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:23.416434 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:23.416434 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:23.416434 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:23.416434 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:23.416434 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:23.416434 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:23.416434 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:03:23.416434 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:03:23.416434 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:03:23.417369 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:03:23.417369 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:23.417369 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:23.417369 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:23.417369 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:23.417369 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:23.417369 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:23.417369 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:23.417369 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:23.417369 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:23.417369 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:23.417369 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:23.417369 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:23.417369 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:23.417369 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:23.417369 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:23.417369 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:23.418265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:03:23.418265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:03:23.418265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:03:23.418265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:03:23.418265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:03:23.418265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:03:23.418265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:23.418265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:23.422889 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 389/763] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:03:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:23.423911 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574addc4-f6e8-48ce-bd20-331490e7f4f6 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:23.451275 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:23.453990 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb8782-d04e-41af-9ab1-47ba875b45c4 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:23.490208 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aaafc9-db92-4f2c-872e-3163741893e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:23.491232 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aaafc9-db92-4f2c-872e-3163741893e6 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:23.491739 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aaafc9-db92-4f2c-872e-3163741893e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:23.492207 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aaafc9-db92-4f2c-872e-3163741893e6 None admin] PATH_INFO: `/v3/services` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:23.493096 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aaafc9-db92-4f2c-872e-3163741893e6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:23.493624 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aaafc9-db92-4f2c-872e-3163741893e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:23.495225 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aaafc9-db92-4f2c-872e-3163741893e6 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:23.500894 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 375/764] 10.222.0.60 () {56 vars in 1124 bytes} [Sun Jul 31 01:03:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:23.502003 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aaafc9-db92-4f2c-872e-3163741893e6 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:23.526449 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:23.555551 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574addc4-f6e8-48ce-bd20-331490e7f4f6 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:23.600878 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1316c77b-007e-42d9-9708-2c23dabf3cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:23.601888 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316c77b-007e-42d9-9708-2c23dabf3cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:23.602361 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316c77b-007e-42d9-9708-2c23dabf3cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:23.602823 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316c77b-007e-42d9-9708-2c23dabf3cd3 None admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:23.603859 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1316c77b-007e-42d9-9708-2c23dabf3cd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:23.604372 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1316c77b-007e-42d9-9708-2c23dabf3cd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:23.606089 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1316c77b-007e-42d9-9708-2c23dabf3cd3 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:23.620210 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 390/765] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:23.621444 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1316c77b-007e-42d9-9708-2c23dabf3cd3 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:23.632720 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aaafc9-db92-4f2c-872e-3163741893e6 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:23.672373 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba8129-a078-4d59-898f-cdf1a5ce6a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:23.672887 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba8129-a078-4d59-898f-cdf1a5ce6a20 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:23.673168 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba8129-a078-4d59-898f-cdf1a5ce6a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:23.673492 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba8129-a078-4d59-898f-cdf1a5ce6a20 None admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:23.674326 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba8129-a078-4d59-898f-cdf1a5ce6a20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:23.674612 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba8129-a078-4d59-898f-cdf1a5ce6a20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:23.676223 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba8129-a078-4d59-898f-cdf1a5ce6a20 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:23.695819 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 376/766] 10.222.0.60 () {56 vars in 1148 bytes} [Sun Jul 31 01:03:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:23.696890 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba8129-a078-4d59-898f-cdf1a5ce6a20 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:23.719432 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:23.737574 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1316c77b-007e-42d9-9708-2c23dabf3cd3 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:23.771827 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:23.776383 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c5429-c13b-4041-b4d9-70e3c6502d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:23.777341 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c5429-c13b-4041-b4d9-70e3c6502d95 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:23.777838 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c5429-c13b-4041-b4d9-70e3c6502d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:23.778326 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c5429-c13b-4041-b4d9-70e3c6502d95 None admin] PATH_INFO: `/v3/services` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:23.779279 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c5429-c13b-4041-b4d9-70e3c6502d95 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:23.779848 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c5429-c13b-4041-b4d9-70e3c6502d95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:23.781429 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c5429-c13b-4041-b4d9-70e3c6502d95 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:23.788154 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 391/767] 10.222.0.60 () {56 vars in 1124 bytes} [Sun Jul 31 01:03:23 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:23.789391 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c5429-c13b-4041-b4d9-70e3c6502d95 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:23.816428 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba8129-a078-4d59-898f-cdf1a5ce6a20 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:23.861999 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd6cd4-8987-4422-ac5f-2000060e7e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:23.862656 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd6cd4-8987-4422-ac5f-2000060e7e16 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:23.862934 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd6cd4-8987-4422-ac5f-2000060e7e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:23.863472 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd6cd4-8987-4422-ac5f-2000060e7e16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:23.871236 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fd6cd4-8987-4422-ac5f-2000060e7e16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:23.872947 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fd6cd4-8987-4422-ac5f-2000060e7e16 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:23.886451 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-54fd6cd4-8987-4422-ac5f-2000060e7e16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:23.886451 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:23.886451 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:23.886451 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:23.886451 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:23.886451 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:23.886451 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:23.886451 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:23.886451 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:23.886451 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:23.886451 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:23.886451 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:23.886451 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:03:23.886451 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:03:23.886451 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:03:23.887411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:03:23.887411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:23.887411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:23.887411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:23.887411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:23.887411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:23.887411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:23.887411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:23.887411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:23.887411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:23.887411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:23.887411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:23.887411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:23.887411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:23.887411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:23.887411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:23.887411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:23.888327 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:03:23.888327 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:03:23.888327 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:03:23.888327 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:03:23.888327 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:03:23.888327 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:03:23.888327 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:23.888327 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:23.888327 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 377/768] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:03:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:23.888838 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd6cd4-8987-4422-ac5f-2000060e7e16 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:23.899890 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c5429-c13b-4041-b4d9-70e3c6502d95 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:23.936178 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea93e6d-044c-4a7e-a8b7-a1643942b6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:23.936807 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea93e6d-044c-4a7e-a8b7-a1643942b6ee None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:23.937078 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea93e6d-044c-4a7e-a8b7-a1643942b6ee None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:23.937345 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea93e6d-044c-4a7e-a8b7-a1643942b6ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:23.938130 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea93e6d-044c-4a7e-a8b7-a1643942b6ee None admin] RBAC: Adding query filter params (role.id=a5d1b78d4ec146848dfa667303603262, scope.project.id=b931b81a237949aa845891d4bb5aa1c0, user.id=02ed9040d575462db4b270a5b57063f2) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:23.938433 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea93e6d-044c-4a7e-a8b7-a1643942b6ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:23.939900 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea93e6d-044c-4a7e-a8b7-a1643942b6ee None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:23.951515 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 392/769] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:03:23 2022] GET /identity/v3/role_assignments?user.id=02ed9040d575462db4b270a5b57063f2&scope.project.id=b931b81a237949aa845891d4bb5aa1c0&role.id=a5d1b78d4ec146848dfa667303603262 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:23.951515 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea93e6d-044c-4a7e-a8b7-a1643942b6ee None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:23.968210 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:24.039628 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd6cd4-8987-4422-ac5f-2000060e7e16 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:24.057278 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea93e6d-044c-4a7e-a8b7-a1643942b6ee None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:24.073107 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:24.085309 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53ebeb-2bcb-4c88-bcd8-80eae875d8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:24.085964 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53ebeb-2bcb-4c88-bcd8-80eae875d8bf None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:24.086501 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53ebeb-2bcb-4c88-bcd8-80eae875d8bf None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:24.086777 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53ebeb-2bcb-4c88-bcd8-80eae875d8bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:24.088227 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d53ebeb-2bcb-4c88-bcd8-80eae875d8bf None admin] RBAC: Adding query filter params (interface=public, service_id=720abeddffe54d1792303e945024d812, region_id=RegionOne) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:24.088655 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d53ebeb-2bcb-4c88-bcd8-80eae875d8bf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:24.090825 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d53ebeb-2bcb-4c88-bcd8-80eae875d8bf None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:24.095689 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7326c4fa-26fe-40e1-b1db-c736c30de568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:24.096518 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326c4fa-26fe-40e1-b1db-c736c30de568 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:24.096859 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326c4fa-26fe-40e1-b1db-c736c30de568 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:24.097190 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326c4fa-26fe-40e1-b1db-c736c30de568 None admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:24.098058 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7326c4fa-26fe-40e1-b1db-c736c30de568 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:24.098468 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7326c4fa-26fe-40e1-b1db-c736c30de568 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:24.100104 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7326c4fa-26fe-40e1-b1db-c736c30de568 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:24.102404 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 378/770] 10.222.0.60 () {56 vars in 1251 bytes} [Sun Jul 31 01:03:23 2022] GET /identity/v3/endpoints?service_id=720abeddffe54d1792303e945024d812&interface=public®ion_id=RegionOne => generated 194 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:24.104296 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537e24f-a18b-4f9c-93d7-2e37caa77095 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:24.104580 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537e24f-a18b-4f9c-93d7-2e37caa77095 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:24.104853 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537e24f-a18b-4f9c-93d7-2e37caa77095 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:24.106146 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 379/771] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:24.111966 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537e24f-a18b-4f9c-93d7-2e37caa77095 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:24.118053 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 393/772] 10.222.0.60 () {56 vars in 1148 bytes} [Sun Jul 31 01:03:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:24.119446 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d98a7d-eaef-48a9-916f-f6dca4df2b56 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:24.119779 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d98a7d-eaef-48a9-916f-f6dca4df2b56 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:24.120050 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d98a7d-eaef-48a9-916f-f6dca4df2b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:24.139456 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-94d98a7d-eaef-48a9-916f-f6dca4df2b56 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:24.140705 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-94d98a7d-eaef-48a9-916f-f6dca4df2b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:24.226052 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 394/773] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:03:24.227027 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d98a7d-eaef-48a9-916f-f6dca4df2b56 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:24.229862 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:24.264284 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537e24f-a18b-4f9c-93d7-2e37caa77095 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:24.311435 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b30ea-1244-48a3-bdbc-1510254f76ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:24.313099 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b30ea-1244-48a3-bdbc-1510254f76ee None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:24.313617 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b30ea-1244-48a3-bdbc-1510254f76ee None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:24.314327 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b30ea-1244-48a3-bdbc-1510254f76ee None admin] PATH_INFO: `/v3/services` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:24.315925 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b30ea-1244-48a3-bdbc-1510254f76ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:24.317713 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b30ea-1244-48a3-bdbc-1510254f76ee None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:24.333828 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 380/774] 10.222.0.60 () {56 vars in 1087 bytes} [Sun Jul 31 01:03:24 2022] GET /identity/v3/services => generated 772 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:24.333828 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b30ea-1244-48a3-bdbc-1510254f76ee None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:24.388530 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d98a7d-eaef-48a9-916f-f6dca4df2b56 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:24.435570 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7bd86-b436-44da-8040-df634e3b6509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:24.436322 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7bd86-b436-44da-8040-df634e3b6509 None admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:24.436594 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7bd86-b436-44da-8040-df634e3b6509 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:24.436863 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7bd86-b436-44da-8040-df634e3b6509 None admin] PATH_INFO: `/v3/projects/b931b81a237949aa845891d4bb5aa1c0/users/04591cd035ef4961b8b7a93e294eb881/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:24.438995 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7bd86-b436-44da-8040-df634e3b6509 None admin] RBAC: Authorizing `identity:create_grant(project_id=b931b81a237949aa845891d4bb5aa1c0, user_id=04591cd035ef4961b8b7a93e294eb881, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:24.440502 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7bd86-b436-44da-8040-df634e3b6509 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:24.472223 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:24.475385 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 395/775] 10.222.0.60 () {58 vars in 1439 bytes} [Sun Jul 31 01:03:24 2022] PUT /identity/v3/projects/b931b81a237949aa845891d4bb5aa1c0/users/04591cd035ef4961b8b7a93e294eb881/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:03:24.550202 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b30ea-1244-48a3-bdbc-1510254f76ee None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:24.592718 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c5434-7f87-4e62-85c5-f26bfce86082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:24.593735 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c5434-7f87-4e62-85c5-f26bfce86082 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:24.594297 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c5434-7f87-4e62-85c5-f26bfce86082 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:24.594759 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c5434-7f87-4e62-85c5-f26bfce86082 None admin] PATH_INFO: `/v3/services/network` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:24.595849 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c5434-7f87-4e62-85c5-f26bfce86082 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:24.598523 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c5434-7f87-4e62-85c5-f26bfce86082 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:24.605704 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffb36e-799a-4f28-a2b3-2dddebd244a3 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:24.605975 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffb36e-799a-4f28-a2b3-2dddebd244a3 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:24.606241 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffb36e-799a-4f28-a2b3-2dddebd244a3 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:24.607932 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 396/776] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:24.613285 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-ab0c5434-7f87-4e62-85c5-f26bfce86082 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 31 01:03:24.613285 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:24.613285 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:03:24.613285 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:03:24.613285 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:03:24.613285 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:03:24.613285 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:03:24.613285 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:24.613285 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 31 01:03:24.613285 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:24.613285 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:03:24.613285 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:24.613285 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:24.613285 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:24.613285 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:24.613285 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:24.613285 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:24.614467 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:24.614467 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:24.614467 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:24.614467 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:24.614467 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:24.614467 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:24.614467 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:03:24.614467 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:03:24.614467 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:03:24.614467 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:03:24.614467 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:24.614467 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:24.614467 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:24.614467 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:24.614467 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:24.614467 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:24.615306 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:24.615306 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:24.615306 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:24.615306 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:24.615306 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:24.615306 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:24.615306 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:24.615306 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:24.615306 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:24.615306 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:24.615306 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:03:24.615306 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:24.615306 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 31 01:03:24.615306 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:24.616362 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04761275-e810-4bd8-9d9e-23a0bc171632 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:24.616362 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04761275-e810-4bd8-9d9e-23a0bc171632 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:24.616362 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04761275-e810-4bd8-9d9e-23a0bc171632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:24.616564 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 381/777] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:03:24 2022] GET /identity/v3/services/network => generated 88 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:24.622957 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c5434-7f87-4e62-85c5-f26bfce86082 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:24.640722 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-04761275-e810-4bd8-9d9e-23a0bc171632 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:24.642194 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-04761275-e810-4bd8-9d9e-23a0bc171632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:24.716984 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:24.732930 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 397/778] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:03:24.755623 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04761275-e810-4bd8-9d9e-23a0bc171632 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:24.760172 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c5434-7f87-4e62-85c5-f26bfce86082 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:24.789045 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:24.817641 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57c445-d4da-4d0b-8641-0f9313eee918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:24.818271 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57c445-d4da-4d0b-8641-0f9313eee918 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:24.818540 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57c445-d4da-4d0b-8641-0f9313eee918 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:24.818950 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57c445-d4da-4d0b-8641-0f9313eee918 None admin] PATH_INFO: `/v3/services` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:24.819517 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c57c445-d4da-4d0b-8641-0f9313eee918 None admin] RBAC: Adding query filter params (name=network) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:24.819838 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c57c445-d4da-4d0b-8641-0f9313eee918 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:24.821218 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c57c445-d4da-4d0b-8641-0f9313eee918 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:24.826920 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 382/779] 10.222.0.60 () {56 vars in 1112 bytes} [Sun Jul 31 01:03:24 2022] GET /identity/v3/services?name=network => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:24.832492 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57c445-d4da-4d0b-8641-0f9313eee918 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:24.889052 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04761275-e810-4bd8-9d9e-23a0bc171632 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:24.930894 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b51d13-7155-4e75-a047-189dc0ee7bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:24.931569 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b51d13-7155-4e75-a047-189dc0ee7bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:24.931924 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b51d13-7155-4e75-a047-189dc0ee7bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:24.932342 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b51d13-7155-4e75-a047-189dc0ee7bc5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:24.959012 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b51d13-7155-4e75-a047-189dc0ee7bc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:03:24.970572 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-c0b51d13-7155-4e75-a047-189dc0ee7bc5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:03:24.970572 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:24.970572 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:24.970572 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:24.970572 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:24.970572 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:24.970572 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:24.970572 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:24.970572 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:24.970572 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:24.970572 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:24.970572 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:24.970572 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:03:24.970572 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:03:24.970572 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:03:24.970572 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:03:24.971587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:03:24.971587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:03:24.971587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:03:24.971587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:03:24.971587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:24.971587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:24.971587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:24.971587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:24.971587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:24.971587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:24.971587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:24.971587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:24.971587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:24.971587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:24.971587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:24.971587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:24.972434 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:24.972434 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:24.972434 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:24.972434 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:24.972434 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:03:24.972434 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:03:24.972434 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:03:24.972434 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:03:24.972434 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:03:24.972434 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:03:24.972434 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:03:24.972434 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:24.972434 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 398/780] 10.222.0.60 () {56 vars in 1096 bytes} [Sun Jul 31 01:03:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:24.978793 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b51d13-7155-4e75-a047-189dc0ee7bc5 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:25.000423 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57c445-d4da-4d0b-8641-0f9313eee918 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:25.044586 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0647e44-a716-4573-a391-02c03ba79d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:25.045549 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0647e44-a716-4573-a391-02c03ba79d10 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:25.045977 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0647e44-a716-4573-a391-02c03ba79d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:25.046397 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0647e44-a716-4573-a391-02c03ba79d10 None admin] PATH_INFO: `/v3/services` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:25.047266 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0647e44-a716-4573-a391-02c03ba79d10 None admin] RBAC: Adding query filter params (type=network) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:25.047763 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0647e44-a716-4573-a391-02c03ba79d10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:25.049328 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0647e44-a716-4573-a391-02c03ba79d10 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:25.061753 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 383/781] 10.222.0.60 () {56 vars in 1112 bytes} [Sun Jul 31 01:03:24 2022] GET /identity/v3/services?type=network => generated 350 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:03:25.064007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:25.067637 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0647e44-a716-4573-a391-02c03ba79d10 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:25.144655 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b51d13-7155-4e75-a047-189dc0ee7bc5 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:25.163642 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:25.208399 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a486d9c8-082d-439b-ab48-97cf5eed4ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:25.209426 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486d9c8-082d-439b-ab48-97cf5eed4ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:25.209905 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486d9c8-082d-439b-ab48-97cf5eed4ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:25.210398 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486d9c8-082d-439b-ab48-97cf5eed4ee6 None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:25.211322 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a486d9c8-082d-439b-ab48-97cf5eed4ee6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:25.211861 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a486d9c8-082d-439b-ab48-97cf5eed4ee6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:25.213500 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a486d9c8-082d-439b-ab48-97cf5eed4ee6 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:25.229592 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 399/782] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:03:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:25.233702 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a486d9c8-082d-439b-ab48-97cf5eed4ee6 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:25.258886 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0647e44-a716-4573-a391-02c03ba79d10 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:25.326206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb1166-b4fa-48f9-bb5e-c38037bd2f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:25.327220 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb1166-b4fa-48f9-bb5e-c38037bd2f9a None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:25.327722 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb1166-b4fa-48f9-bb5e-c38037bd2f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:25.328231 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb1166-b4fa-48f9-bb5e-c38037bd2f9a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:25.329208 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb1166-b4fa-48f9-bb5e-c38037bd2f9a None admin] RBAC: Adding query filter params (interface=public, service_id=93ec34f31834453d9bccf2310cafafd6, region_id=RegionOne) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:25.329710 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb1166-b4fa-48f9-bb5e-c38037bd2f9a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:25.331268 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb1166-b4fa-48f9-bb5e-c38037bd2f9a None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:25.342231 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 384/783] 10.222.0.60 () {56 vars in 1251 bytes} [Sun Jul 31 01:03:25 2022] GET /identity/v3/endpoints?service_id=93ec34f31834453d9bccf2310cafafd6&interface=public®ion_id=RegionOne => generated 194 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:03:25.351539 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb1166-b4fa-48f9-bb5e-c38037bd2f9a None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:25.431573 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a486d9c8-082d-439b-ab48-97cf5eed4ee6 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:25.469748 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab4efc-2962-47e3-b704-c53764b96f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:25.470703 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab4efc-2962-47e3-b704-c53764b96f6e None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:25.471177 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab4efc-2962-47e3-b704-c53764b96f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:25.471658 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab4efc-2962-47e3-b704-c53764b96f6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:25.482461 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab4efc-2962-47e3-b704-c53764b96f6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:25.484256 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab4efc-2962-47e3-b704-c53764b96f6e None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:25.498771 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-3eab4efc-2962-47e3-b704-c53764b96f6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:25.498771 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:25.498771 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:25.498771 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:25.498771 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:25.498771 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:25.498771 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:25.498771 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:25.498771 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:25.498771 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:25.498771 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:25.498771 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:25.498771 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:25.498771 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:25.498771 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:25.499719 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:25.499719 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:25.499719 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:25.499719 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:25.499719 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:25.499719 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:25.499719 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:25.499719 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:25.499719 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:25.499719 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:25.499719 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:25.499719 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:25.499719 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:25.499719 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:25.499719 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:25.499719 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:25.499719 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:25.500607 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:25.500607 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:25.500607 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:25.500607 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:25.503213 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 400/784] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:25.507565 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:25.513779 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab4efc-2962-47e3-b704-c53764b96f6e None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:25.560890 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb1166-b4fa-48f9-bb5e-c38037bd2f9a None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:25.575878 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:25.602244 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bcd636-7735-43f5-885c-88ae3be2f79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:25.603241 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bcd636-7735-43f5-885c-88ae3be2f79c None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:25.603762 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bcd636-7735-43f5-885c-88ae3be2f79c None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:25.604696 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bcd636-7735-43f5-885c-88ae3be2f79c None admin] PATH_INFO: `/v3/services` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:25.605571 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bcd636-7735-43f5-885c-88ae3be2f79c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:25.607148 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bcd636-7735-43f5-885c-88ae3be2f79c None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:25.613190 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 385/785] 10.222.0.60 () {56 vars in 1087 bytes} [Sun Jul 31 01:03:25 2022] GET /identity/v3/services => generated 772 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:25.750422 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab4efc-2962-47e3-b704-c53764b96f6e None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:25.802142 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e376c0-cef1-4e2d-90a6-5ae046f95382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:25.802524 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e376c0-cef1-4e2d-90a6-5ae046f95382 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:25.802788 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e376c0-cef1-4e2d-90a6-5ae046f95382 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:25.803089 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e376c0-cef1-4e2d-90a6-5ae046f95382 None admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:25.803853 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e376c0-cef1-4e2d-90a6-5ae046f95382 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:25.805080 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e376c0-cef1-4e2d-90a6-5ae046f95382 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:25.805555 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e376c0-cef1-4e2d-90a6-5ae046f95382 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:25.823797 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 401/786] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:25.829879 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bcd636-7735-43f5-885c-88ae3be2f79c None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:26.008366 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bcd636-7735-43f5-885c-88ae3be2f79c None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:26.062762 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f7f00-50c5-41c8-b7ee-a9adf1519aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:26.063431 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f7f00-50c5-41c8-b7ee-a9adf1519aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:26.063741 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f7f00-50c5-41c8-b7ee-a9adf1519aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:26.064014 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f7f00-50c5-41c8-b7ee-a9adf1519aa5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:26.078226 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4f7f00-50c5-41c8-b7ee-a9adf1519aa5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:26.079720 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4f7f00-50c5-41c8-b7ee-a9adf1519aa5 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:26.095144 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-2b4f7f00-50c5-41c8-b7ee-a9adf1519aa5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 31 01:03:26.095144 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:26.095144 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:26.095144 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:26.095144 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:26.095144 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:26.095144 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:26.095144 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:26.095144 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:26.095144 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:26.095144 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:26.095144 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:26.095144 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:03:26.095144 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:03:26.095144 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:03:26.095144 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:03:26.096128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:26.096128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:26.096128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:03:26.096128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:26.096128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:03:26.096128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:26.096128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:26.096128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:26.096128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:26.096128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:26.096128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:26.096128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:26.096128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:26.096128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:26.096128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:26.096128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:26.096128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:26.096128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:26.097076 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:26.097076 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:26.097076 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:03:26.097076 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:03:26.097076 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:03:26.097076 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:03:26.097076 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:03:26.097076 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:03:26.097076 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 31 01:03:26.097076 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:26.097076 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 386/787] 10.222.0.60 () {56 vars in 1096 bytes} [Sun Jul 31 01:03:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:26.103868 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e376c0-cef1-4e2d-90a6-5ae046f95382 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:26.132807 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:26.230635 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e376c0-cef1-4e2d-90a6-5ae046f95382 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:26.281600 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc19e16b-57fe-4205-a109-41637069bfc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:26.282166 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19e16b-57fe-4205-a109-41637069bfc9 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:26.282447 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19e16b-57fe-4205-a109-41637069bfc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:26.282722 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19e16b-57fe-4205-a109-41637069bfc9 None admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:26.283563 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc19e16b-57fe-4205-a109-41637069bfc9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:26.283874 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc19e16b-57fe-4205-a109-41637069bfc9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:26.285324 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc19e16b-57fe-4205-a109-41637069bfc9 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:26.309534 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 402/788] 10.222.0.60 () {56 vars in 1135 bytes} [Sun Jul 31 01:03:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:26.315247 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f7f00-50c5-41c8-b7ee-a9adf1519aa5 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:26.324973 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bad7d-d255-4707-a974-ae042e5ce01f None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:26.325279 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bad7d-d255-4707-a974-ae042e5ce01f None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:26.325521 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bad7d-d255-4707-a974-ae042e5ce01f None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:26.327213 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 403/789] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:03:26.332421 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0b7e7-3c93-4f83-b453-0309a652f569 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:26.332703 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0b7e7-3c93-4f83-b453-0309a652f569 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:26.332980 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0b7e7-3c93-4f83-b453-0309a652f569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:26.351130 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-b5c0b7e7-3c93-4f83-b453-0309a652f569 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:26.352353 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-b5c0b7e7-3c93-4f83-b453-0309a652f569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:26.394587 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:26.475171 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 404/790] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:03:26.504432 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f7f00-50c5-41c8-b7ee-a9adf1519aa5 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:26.529417 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0b7e7-3c93-4f83-b453-0309a652f569 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:26.549233 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:26.566663 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80c368-47f9-4810-ae7b-44cbf42b50d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:26.567334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80c368-47f9-4810-ae7b-44cbf42b50d1 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:26.567640 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80c368-47f9-4810-ae7b-44cbf42b50d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:26.567911 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80c368-47f9-4810-ae7b-44cbf42b50d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:26.584754 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d80c368-47f9-4810-ae7b-44cbf42b50d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:26.586240 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d80c368-47f9-4810-ae7b-44cbf42b50d1 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:26.606541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-0d80c368-47f9-4810-ae7b-44cbf42b50d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:26.606541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:26.606541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:26.606541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:26.606541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:26.606541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:26.606541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:26.606541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:26.606541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:26.606541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:26.606541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:26.606541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:26.606541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:26.606541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:26.606541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:26.607616 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:26.607616 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:26.607616 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:26.607616 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:26.607616 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:26.607616 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:26.607616 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:26.607616 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:26.607616 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:26.607616 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:26.607616 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:26.607616 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:26.607616 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:26.607616 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:26.607616 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:26.607616 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:26.607616 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:26.608545 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:26.608545 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:26.608545 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:26.608545 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:26.609268 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 387/791] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:26.615112 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80c368-47f9-4810-ae7b-44cbf42b50d1 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:26.713762 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0b7e7-3c93-4f83-b453-0309a652f569 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:26.749156 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ad1b9-35b5-4d07-a18d-803a79160025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:26.749814 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ad1b9-35b5-4d07-a18d-803a79160025 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:26.750095 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ad1b9-35b5-4d07-a18d-803a79160025 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:26.750369 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ad1b9-35b5-4d07-a18d-803a79160025 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:26.762106 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ad1b9-35b5-4d07-a18d-803a79160025 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:03:26.767159 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-d54ad1b9-35b5-4d07-a18d-803a79160025 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:03:26.767159 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:26.767159 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:26.767159 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:26.767159 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:26.767159 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:26.767159 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:26.767159 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:26.767159 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:26.767159 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:26.767159 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:26.767159 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:26.767159 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:03:26.767159 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:03:26.767159 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:03:26.767159 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:03:26.768109 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:03:26.768109 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:03:26.768109 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:03:26.768109 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:03:26.768109 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:26.768109 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:26.768109 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:26.768109 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:26.768109 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:26.768109 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:26.768109 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:26.768109 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:26.768109 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:26.768109 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:26.768109 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:26.768109 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:26.768939 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:26.768939 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:26.768939 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:26.768939 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:26.768939 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:03:26.768939 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:03:26.768939 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:03:26.768939 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:03:26.768939 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:03:26.768939 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:03:26.768939 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:03:26.768939 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:26.768939 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 405/792] 10.222.0.60 () {56 vars in 1102 bytes} [Sun Jul 31 01:03:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:03:26.774642 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ad1b9-35b5-4d07-a18d-803a79160025 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:26.791854 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:26.815288 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80c368-47f9-4810-ae7b-44cbf42b50d1 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:26.887365 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb911c0f-3b23-4548-aa04-f36ceb18a827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:26.888039 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb911c0f-3b23-4548-aa04-f36ceb18a827 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:26.888304 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb911c0f-3b23-4548-aa04-f36ceb18a827 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:26.888615 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb911c0f-3b23-4548-aa04-f36ceb18a827 None admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:26.889335 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb911c0f-3b23-4548-aa04-f36ceb18a827 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:26.889641 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb911c0f-3b23-4548-aa04-f36ceb18a827 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:26.891038 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb911c0f-3b23-4548-aa04-f36ceb18a827 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:26.927891 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:26.932386 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 388/793] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:26.939897 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb911c0f-3b23-4548-aa04-f36ceb18a827 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:26.989804 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ad1b9-35b5-4d07-a18d-803a79160025 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:27.076251 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458756a9-1ff5-4f0c-b985-5bcec506070f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:27.076866 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458756a9-1ff5-4f0c-b985-5bcec506070f None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:27.077142 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458756a9-1ff5-4f0c-b985-5bcec506070f None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:27.077430 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458756a9-1ff5-4f0c-b985-5bcec506070f None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:27.078147 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458756a9-1ff5-4f0c-b985-5bcec506070f None admin] RBAC: Adding query filter params (name=service) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:27.078446 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458756a9-1ff5-4f0c-b985-5bcec506070f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:27.079861 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458756a9-1ff5-4f0c-b985-5bcec506070f None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:27.089130 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 406/794] 10.222.0.60 () {56 vars in 1103 bytes} [Sun Jul 31 01:03:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:03:27.090353 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e77081-3eea-4619-abaa-097676fc506b None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:27.090644 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e77081-3eea-4619-abaa-097676fc506b None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:27.090914 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e77081-3eea-4619-abaa-097676fc506b None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:27.092529 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 407/795] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:27.093752 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e66917-3f57-4498-aea5-04f06647dfc1 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:27.094038 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e66917-3f57-4498-aea5-04f06647dfc1 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:27.094304 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e66917-3f57-4498-aea5-04f06647dfc1 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:27.095685 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 408/796] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:27.096334 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e66917-3f57-4498-aea5-04f06647dfc1 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:27.123360 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb911c0f-3b23-4548-aa04-f36ceb18a827 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:27.170713 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e1ad6-f043-4cf3-838a-badce3d71716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:27.171713 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e1ad6-f043-4cf3-838a-badce3d71716 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:27.172138 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e1ad6-f043-4cf3-838a-badce3d71716 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:27.172551 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e1ad6-f043-4cf3-838a-badce3d71716 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:27.180036 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83e1ad6-f043-4cf3-838a-badce3d71716 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:27.181714 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83e1ad6-f043-4cf3-838a-badce3d71716 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:27.194819 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-c83e1ad6-f043-4cf3-838a-badce3d71716 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:27.194819 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:27.194819 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:27.194819 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:27.194819 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:27.194819 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:27.194819 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:27.194819 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:27.194819 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:27.194819 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:27.194819 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:27.194819 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:27.194819 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:03:27.194819 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:03:27.194819 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:03:27.195871 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:03:27.195871 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:27.195871 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:27.195871 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:27.195871 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:27.195871 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:27.195871 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:27.195871 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:27.195871 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:27.195871 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:27.195871 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:27.195871 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:27.195871 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:27.195871 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:27.195871 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:27.195871 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:27.195871 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:27.196939 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:03:27.196939 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:03:27.196939 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:03:27.196939 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:03:27.196939 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:03:27.196939 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:03:27.196939 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:27.196939 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:27.199036 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 389/797] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:03:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:03:27.200489 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d05eb-686b-49ec-915b-615cf949552a None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:27.200769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d05eb-686b-49ec-915b-615cf949552a None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:27.201098 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d05eb-686b-49ec-915b-615cf949552a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:27.214763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e66917-3f57-4498-aea5-04f06647dfc1 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:27.221584 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-821d05eb-686b-49ec-915b-615cf949552a None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:27.222774 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-821d05eb-686b-49ec-915b-615cf949552a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:27.225139 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:27.261256 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ad193-b2d5-416d-8fbe-b86f81b545d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:27.262375 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ad193-b2d5-416d-8fbe-b86f81b545d8 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:27.262666 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ad193-b2d5-416d-8fbe-b86f81b545d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:27.263081 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ad193-b2d5-416d-8fbe-b86f81b545d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:27.267573 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:27.280663 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ad193-b2d5-416d-8fbe-b86f81b545d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:27.282156 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ad193-b2d5-416d-8fbe-b86f81b545d8 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:27.297432 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-c57ad193-b2d5-416d-8fbe-b86f81b545d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:27.297432 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:27.297432 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:27.297432 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:27.297432 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:27.297432 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:27.297432 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:27.297432 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:27.297432 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:27.297432 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:27.297432 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:27.297432 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:27.297432 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:27.297432 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:27.297432 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:27.308323 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:27.308323 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:27.308323 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:27.308323 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:27.308323 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:27.308323 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:27.308323 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:27.308323 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:27.308323 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:27.308323 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:27.308323 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:27.308323 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:27.308323 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:27.308323 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:27.308323 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:27.308323 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:27.308323 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:27.309429 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:27.309429 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:27.309429 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:27.309429 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:27.309658 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 390/798] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:03:27.309658 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197882eb-943a-46e0-9759-127a27eba6b2 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:27.309658 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197882eb-943a-46e0-9759-127a27eba6b2 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:27.309658 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197882eb-943a-46e0-9759-127a27eba6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:27.309984 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 409/799] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:27.309984 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ad193-b2d5-416d-8fbe-b86f81b545d8 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:27.324917 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-197882eb-943a-46e0-9759-127a27eba6b2 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:27.326380 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-197882eb-943a-46e0-9759-127a27eba6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:27.427509 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 391/800] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:03:27.427509 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197882eb-943a-46e0-9759-127a27eba6b2 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:27.447375 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ad193-b2d5-416d-8fbe-b86f81b545d8 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:27.488550 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c508927-10fd-4c02-ad4f-bb7a50b95bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:27.489183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c508927-10fd-4c02-ad4f-bb7a50b95bfa None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:27.489460 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c508927-10fd-4c02-ad4f-bb7a50b95bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:27.489729 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c508927-10fd-4c02-ad4f-bb7a50b95bfa None admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:27.490487 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c508927-10fd-4c02-ad4f-bb7a50b95bfa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:27.490788 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c508927-10fd-4c02-ad4f-bb7a50b95bfa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:27.492272 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c508927-10fd-4c02-ad4f-bb7a50b95bfa None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:27.510786 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 410/801] 10.222.0.60 () {56 vars in 1148 bytes} [Sun Jul 31 01:03:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:27.510786 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c508927-10fd-4c02-ad4f-bb7a50b95bfa None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:27.518484 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:27.559867 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197882eb-943a-46e0-9759-127a27eba6b2 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:27.565124 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:27.601351 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a2588-9663-4c5e-85f3-c4e41930c0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:27.601933 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a2588-9663-4c5e-85f3-c4e41930c0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:27.602216 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a2588-9663-4c5e-85f3-c4e41930c0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:27.602491 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a2588-9663-4c5e-85f3-c4e41930c0e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:27.603224 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a2588-9663-4c5e-85f3-c4e41930c0e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:27.603560 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a2588-9663-4c5e-85f3-c4e41930c0e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:27.604977 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a2588-9663-4c5e-85f3-c4e41930c0e1 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:27.617375 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 392/802] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:27.618235 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a2588-9663-4c5e-85f3-c4e41930c0e1 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:27.619618 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c508927-10fd-4c02-ad4f-bb7a50b95bfa None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:27.658863 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c1476d-9e71-4bc7-889f-f67f009d5872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:27.659541 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1476d-9e71-4bc7-889f-f67f009d5872 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:27.659876 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1476d-9e71-4bc7-889f-f67f009d5872 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:27.660178 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1476d-9e71-4bc7-889f-f67f009d5872 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:27.660806 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c1476d-9e71-4bc7-889f-f67f009d5872 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:27.662231 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c1476d-9e71-4bc7-889f-f67f009d5872 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:27.672182 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-70c1476d-9e71-4bc7-889f-f67f009d5872 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 31 01:03:27.672182 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:27.672182 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:03:27.672182 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:03:27.672182 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:03:27.672182 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:03:27.672182 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:03:27.672182 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:27.672182 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 31 01:03:27.672182 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:27.672182 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:03:27.672182 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:27.672182 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:27.672182 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:27.672182 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:27.672182 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:27.673168 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:27.673168 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:27.673168 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:27.673168 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:27.673168 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:27.673168 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:27.673168 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:27.673168 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:03:27.673168 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:03:27.673168 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:03:27.673168 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:03:27.673168 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:27.673168 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:27.673168 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:27.673168 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:27.673168 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:27.674011 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:27.674011 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:27.674011 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:27.674011 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:27.674011 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:27.674011 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:27.674011 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:27.674011 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:27.674011 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:27.674011 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:27.674011 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:27.674011 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:03:27.674011 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:27.674011 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 31 01:03:27.674011 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:27.674011 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 411/803] 10.222.0.60 () {56 vars in 1129 bytes} [Sun Jul 31 01:03:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:27.675648 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c1476d-9e71-4bc7-889f-f67f009d5872 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:27.741514 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a2588-9663-4c5e-85f3-c4e41930c0e1 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:27.776976 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:27.789130 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c96cac7-297b-44c7-9692-648586b8fd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:27.790149 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96cac7-297b-44c7-9692-648586b8fd74 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:27.790621 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96cac7-297b-44c7-9692-648586b8fd74 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:27.791083 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96cac7-297b-44c7-9692-648586b8fd74 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:27.801429 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c1476d-9e71-4bc7-889f-f67f009d5872 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:27.808450 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c96cac7-297b-44c7-9692-648586b8fd74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:03:27.818479 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-3c96cac7-297b-44c7-9692-648586b8fd74 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:03:27.818479 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:27.818479 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:27.818479 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:27.818479 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:27.818479 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:27.818479 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:27.818479 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:27.818479 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:27.818479 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:27.818479 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:27.818479 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:27.818479 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:03:27.818479 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:03:27.818479 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:03:27.818479 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:03:27.820559 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:03:27.820559 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:03:27.820559 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:03:27.820559 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:03:27.820559 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:27.820559 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:27.820559 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:27.820559 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:27.820559 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:27.820559 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:27.820559 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:27.820559 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:27.820559 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:27.820559 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:27.820559 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:27.820559 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:27.822305 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:27.822305 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:27.822305 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:27.822305 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:27.822305 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:03:27.822305 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:03:27.822305 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:03:27.822305 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:03:27.822305 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:03:27.822305 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:03:27.822305 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:03:27.822305 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:27.822305 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 393/804] 10.222.0.60 () {56 vars in 1096 bytes} [Sun Jul 31 01:03:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:27.822305 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c96cac7-297b-44c7-9692-648586b8fd74 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:27.832252 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:27.868014 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb75de0b-4368-4bde-a48d-1bc9efd3e2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:27.868734 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75de0b-4368-4bde-a48d-1bc9efd3e2cb None admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:27.869012 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75de0b-4368-4bde-a48d-1bc9efd3e2cb None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:27.869281 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75de0b-4368-4bde-a48d-1bc9efd3e2cb None admin] PATH_INFO: `/v3/projects/b931b81a237949aa845891d4bb5aa1c0/users/0c8c98c1e2d24de89c7d07753fae02e5/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:27.871257 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb75de0b-4368-4bde-a48d-1bc9efd3e2cb None admin] RBAC: Authorizing `identity:create_grant(project_id=b931b81a237949aa845891d4bb5aa1c0, user_id=0c8c98c1e2d24de89c7d07753fae02e5, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:27.872952 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb75de0b-4368-4bde-a48d-1bc9efd3e2cb None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:27.888232 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 412/805] 10.222.0.60 () {58 vars in 1439 bytes} [Sun Jul 31 01:03:27 2022] PUT /identity/v3/projects/b931b81a237949aa845891d4bb5aa1c0/users/0c8c98c1e2d24de89c7d07753fae02e5/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:03:27.889165 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb75de0b-4368-4bde-a48d-1bc9efd3e2cb None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:27.972253 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c96cac7-297b-44c7-9692-648586b8fd74 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:28.011459 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb75de0b-4368-4bde-a48d-1bc9efd3e2cb None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:28.017554 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102c016-a6db-4827-839a-441f3bc6a722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:28.018294 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102c016-a6db-4827-839a-441f3bc6a722 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:28.018518 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102c016-a6db-4827-839a-441f3bc6a722 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:28.018786 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102c016-a6db-4827-839a-441f3bc6a722 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:28.029241 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4102c016-a6db-4827-839a-441f3bc6a722 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:28.030841 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4102c016-a6db-4827-839a-441f3bc6a722 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:28.047305 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-4102c016-a6db-4827-839a-441f3bc6a722 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 31 01:03:28.047305 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:28.047305 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:28.047305 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:28.047305 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:28.047305 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:28.047305 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:28.047305 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:28.047305 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:28.047305 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:28.047305 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:28.047305 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:28.047305 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:03:28.047305 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:03:28.047305 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:03:28.047305 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:03:28.049399 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:28.049399 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:28.049399 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:03:28.049399 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:28.049399 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:03:28.049399 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:28.049399 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:28.049399 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:28.049399 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:28.049399 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:28.049399 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:28.049399 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:28.049399 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:28.049399 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:28.049399 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:28.049399 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:28.049399 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:28.049399 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:28.050393 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:28.050393 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:28.050393 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:03:28.050393 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:03:28.050393 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:03:28.050393 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:03:28.050393 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:03:28.050393 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:03:28.050393 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 31 01:03:28.050393 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:28.050393 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 394/806] 10.222.0.60 () {56 vars in 1117 bytes} [Sun Jul 31 01:03:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:28.050393 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102c016-a6db-4827-839a-441f3bc6a722 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:28.062921 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b478b-db02-45c2-973a-6b51b2d8f1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:28.063588 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b478b-db02-45c2-973a-6b51b2d8f1d9 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:28.063930 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b478b-db02-45c2-973a-6b51b2d8f1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:28.064156 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b478b-db02-45c2-973a-6b51b2d8f1d9 None admin] PATH_INFO: `/v3/services` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:28.064821 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b478b-db02-45c2-973a-6b51b2d8f1d9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:28.065135 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b478b-db02-45c2-973a-6b51b2d8f1d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:28.066508 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b478b-db02-45c2-973a-6b51b2d8f1d9 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:28.072598 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 413/807] 10.222.0.60 () {56 vars in 1124 bytes} [Sun Jul 31 01:03:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:28.073644 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db063936-0cae-419e-97bb-037a441b061b None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:28.073929 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db063936-0cae-419e-97bb-037a441b061b None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:28.074203 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db063936-0cae-419e-97bb-037a441b061b None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:28.075709 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 414/808] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:28.079150 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db063936-0cae-419e-97bb-037a441b061b None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:28.110228 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:28.124347 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:28.167324 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102c016-a6db-4827-839a-441f3bc6a722 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:28.195464 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db063936-0cae-419e-97bb-037a441b061b None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:28.203029 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba1b6e-73d4-409e-ba0f-83124e205ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:28.203685 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba1b6e-73d4-409e-ba0f-83124e205ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:28.203962 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba1b6e-73d4-409e-ba0f-83124e205ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:28.204343 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba1b6e-73d4-409e-ba0f-83124e205ca3 None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:28.205063 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba1b6e-73d4-409e-ba0f-83124e205ca3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:28.205364 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba1b6e-73d4-409e-ba0f-83124e205ca3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:28.206867 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba1b6e-73d4-409e-ba0f-83124e205ca3 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:28.220537 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 395/809] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:03:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:28.220537 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba1b6e-73d4-409e-ba0f-83124e205ca3 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:28.235723 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1836e237-1aaa-45e5-8359-98da2a54647f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:28.236196 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836e237-1aaa-45e5-8359-98da2a54647f None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:28.238124 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836e237-1aaa-45e5-8359-98da2a54647f None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:28.238124 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836e237-1aaa-45e5-8359-98da2a54647f None admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:28.238124 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1836e237-1aaa-45e5-8359-98da2a54647f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:28.238124 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1836e237-1aaa-45e5-8359-98da2a54647f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:28.239262 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1836e237-1aaa-45e5-8359-98da2a54647f None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:28.262651 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 415/810] 10.222.0.60 () {56 vars in 1149 bytes} [Sun Jul 31 01:03:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:28.262651 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e547fe-89bd-4e7d-a6ad-26ff98234b2d None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:28.262651 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e547fe-89bd-4e7d-a6ad-26ff98234b2d None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:28.262651 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e547fe-89bd-4e7d-a6ad-26ff98234b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:28.278314 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-d0e547fe-89bd-4e7d-a6ad-26ff98234b2d None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:28.279603 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-d0e547fe-89bd-4e7d-a6ad-26ff98234b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:28.337684 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba1b6e-73d4-409e-ba0f-83124e205ca3 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:28.349421 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:28.372843 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 416/811] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:03:28.372843 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e547fe-89bd-4e7d-a6ad-26ff98234b2d None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:28.380219 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef44fb-6ba6-4c89-9b88-c3d75e0f0903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:28.380785 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef44fb-6ba6-4c89-9b88-c3d75e0f0903 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:28.381061 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef44fb-6ba6-4c89-9b88-c3d75e0f0903 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:28.381328 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef44fb-6ba6-4c89-9b88-c3d75e0f0903 None admin] PATH_INFO: `/v3/services` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:28.382027 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef44fb-6ba6-4c89-9b88-c3d75e0f0903 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:28.382326 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef44fb-6ba6-4c89-9b88-c3d75e0f0903 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:28.383728 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef44fb-6ba6-4c89-9b88-c3d75e0f0903 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:28.390235 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 396/812] 10.222.0.60 () {56 vars in 1124 bytes} [Sun Jul 31 01:03:28 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:28.391073 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef44fb-6ba6-4c89-9b88-c3d75e0f0903 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:28.404152 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:28.486685 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e547fe-89bd-4e7d-a6ad-26ff98234b2d None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:28.521146 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef44fb-6ba6-4c89-9b88-c3d75e0f0903 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:28.535668 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66657c2-7743-4a2d-8a6b-0971cdde5767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:28.536521 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66657c2-7743-4a2d-8a6b-0971cdde5767 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:28.536798 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66657c2-7743-4a2d-8a6b-0971cdde5767 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:28.537068 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66657c2-7743-4a2d-8a6b-0971cdde5767 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:28.552371 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66657c2-7743-4a2d-8a6b-0971cdde5767 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:28.554991 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66657c2-7743-4a2d-8a6b-0971cdde5767 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:28.570933 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f821666-e08f-434e-b510-0d433e3495ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:28.571666 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f821666-e08f-434e-b510-0d433e3495ca None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:28.571936 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f821666-e08f-434e-b510-0d433e3495ca None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:28.572206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f821666-e08f-434e-b510-0d433e3495ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:28.578759 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-a66657c2-7743-4a2d-8a6b-0971cdde5767 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:28.578759 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:28.578759 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:28.578759 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:28.578759 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:28.578759 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:28.578759 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:28.578759 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:28.578759 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:28.578759 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:28.578759 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:28.578759 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:28.578759 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:28.578759 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:28.578759 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:28.579761 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:28.579761 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:28.579761 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:28.579761 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:28.579761 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:28.579761 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:28.579761 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:28.579761 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:28.579761 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:28.579761 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:28.579761 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:28.579761 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:28.579761 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:28.579761 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:28.579761 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:28.579761 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:28.579761 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:28.580661 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:28.580661 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:28.580661 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:28.580661 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:28.582109 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 417/813] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:28.582895 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66657c2-7743-4a2d-8a6b-0971cdde5767 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:28.587080 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f821666-e08f-434e-b510-0d433e3495ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:28.590142 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f821666-e08f-434e-b510-0d433e3495ca None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:28.608660 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-6f821666-e08f-434e-b510-0d433e3495ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:28.608660 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:28.608660 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:28.608660 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:28.608660 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:28.608660 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:28.608660 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:28.608660 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:28.608660 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:28.608660 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:28.608660 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:28.608660 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:28.608660 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:28.608660 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:28.608660 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:28.609769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:28.609769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:28.609769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:28.609769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:28.609769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:28.609769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:28.609769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:28.609769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:28.609769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:28.609769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:28.609769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:28.609769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:28.609769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:28.609769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:28.609769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:28.609769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:28.609769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:28.610831 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:28.610831 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:28.610831 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:28.610831 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:28.612410 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 397/814] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:28.613502 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f821666-e08f-434e-b510-0d433e3495ca None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:28.646833 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:28.696428 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:28.722270 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66657c2-7743-4a2d-8a6b-0971cdde5767 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:28.728329 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f821666-e08f-434e-b510-0d433e3495ca None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:28.759762 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c500963-f85f-4d32-bd7e-3fa02e0bcd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:28.760413 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c500963-f85f-4d32-bd7e-3fa02e0bcd7e None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:28.760687 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c500963-f85f-4d32-bd7e-3fa02e0bcd7e None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:28.760959 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c500963-f85f-4d32-bd7e-3fa02e0bcd7e None admin] PATH_INFO: `/v3/services/network` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:28.761581 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c500963-f85f-4d32-bd7e-3fa02e0bcd7e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:28.762949 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c500963-f85f-4d32-bd7e-3fa02e0bcd7e None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:28.764438 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a58f2-b535-4783-8f6f-e7a26d4c9207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:28.765067 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a58f2-b535-4783-8f6f-e7a26d4c9207 None admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:28.765342 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a58f2-b535-4783-8f6f-e7a26d4c9207 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:28.765608 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a58f2-b535-4783-8f6f-e7a26d4c9207 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:28.766320 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a58f2-b535-4783-8f6f-e7a26d4c9207 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:28.767711 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a58f2-b535-4783-8f6f-e7a26d4c9207 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:28.772705 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-6c500963-f85f-4d32-bd7e-3fa02e0bcd7e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 31 01:03:28.772705 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:28.772705 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:03:28.772705 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:03:28.772705 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:03:28.772705 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:03:28.772705 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:03:28.772705 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:28.772705 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 31 01:03:28.772705 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:28.772705 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:03:28.772705 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:28.772705 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:28.772705 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:28.772705 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:28.772705 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:28.772705 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:28.773715 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:28.773715 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:28.773715 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:28.773715 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:28.773715 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:28.773715 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:28.773715 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:03:28.773715 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:03:28.773715 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:03:28.773715 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:03:28.773715 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:28.773715 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:28.773715 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:28.773715 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:28.773715 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:28.773715 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:28.774534 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:28.774534 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:28.774534 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:28.774534 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:28.774534 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:28.774534 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:28.774534 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:28.774534 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:28.774534 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:28.774534 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:28.774534 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:03:28.774534 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:28.774534 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 31 01:03:28.774534 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:28.774534 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 418/815] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:03:28 2022] GET /identity/v3/services/network => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:28.775990 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c500963-f85f-4d32-bd7e-3fa02e0bcd7e None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:28.800572 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 398/816] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:03:28 2022] POST /identity/v3/endpoints => generated 346 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:03:28.801743 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a58f2-b535-4783-8f6f-e7a26d4c9207 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:28.900678 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:28.924752 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c500963-f85f-4d32-bd7e-3fa02e0bcd7e None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:28.938674 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a58f2-b535-4783-8f6f-e7a26d4c9207 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:28.978178 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80af1a6-a87e-45b6-ad17-0e910e8e3ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:28.979350 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80af1a6-a87e-45b6-ad17-0e910e8e3ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:28.979893 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80af1a6-a87e-45b6-ad17-0e910e8e3ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:28.980352 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80af1a6-a87e-45b6-ad17-0e910e8e3ce3 None admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:28.981390 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80af1a6-a87e-45b6-ad17-0e910e8e3ce3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:28.981847 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80af1a6-a87e-45b6-ad17-0e910e8e3ce3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:28.982521 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09dc2e4-9012-4fef-928a-5e3ff0e11b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:28.983265 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09dc2e4-9012-4fef-928a-5e3ff0e11b57 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:28.983670 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09dc2e4-9012-4fef-928a-5e3ff0e11b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:28.984389 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80af1a6-a87e-45b6-ad17-0e910e8e3ce3 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:28.984800 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09dc2e4-9012-4fef-928a-5e3ff0e11b57 None admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:28.985918 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09dc2e4-9012-4fef-928a-5e3ff0e11b57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:28.986344 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09dc2e4-9012-4fef-928a-5e3ff0e11b57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:28.987862 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09dc2e4-9012-4fef-928a-5e3ff0e11b57 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:28.995611 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:29.001057 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 419/817] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:29.002128 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80af1a6-a87e-45b6-ad17-0e910e8e3ce3 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:29.004446 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 399/818] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:29.007303 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09dc2e4-9012-4fef-928a-5e3ff0e11b57 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:29.138340 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09dc2e4-9012-4fef-928a-5e3ff0e11b57 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:29.138552 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80af1a6-a87e-45b6-ad17-0e910e8e3ce3 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:29.174970 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a8618-fc67-4943-b813-c1ef60e936e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:29.175538 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a8618-fc67-4943-b813-c1ef60e936e4 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:29.175834 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a8618-fc67-4943-b813-c1ef60e936e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:29.176091 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a8618-fc67-4943-b813-c1ef60e936e4 None admin] PATH_INFO: `/v3/services` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:29.176773 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a8618-fc67-4943-b813-c1ef60e936e4 None admin] RBAC: Adding query filter params (name=network) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:29.177078 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a8618-fc67-4943-b813-c1ef60e936e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:29.178010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779fbb3-ae5c-4ded-956a-d30a550edf4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:29.178529 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a8618-fc67-4943-b813-c1ef60e936e4 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:29.179035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779fbb3-ae5c-4ded-956a-d30a550edf4f None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:29.179586 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779fbb3-ae5c-4ded-956a-d30a550edf4f None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:29.179999 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779fbb3-ae5c-4ded-956a-d30a550edf4f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:29.188384 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 420/819] 10.222.0.60 () {56 vars in 1112 bytes} [Sun Jul 31 01:03:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:29.189023 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a8618-fc67-4943-b813-c1ef60e936e4 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:29.189670 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b779fbb3-ae5c-4ded-956a-d30a550edf4f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:29.191280 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b779fbb3-ae5c-4ded-956a-d30a550edf4f None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:29.193627 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:29.206962 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-b779fbb3-ae5c-4ded-956a-d30a550edf4f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:03:29.206962 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:29.206962 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:29.206962 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:29.206962 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:29.206962 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:29.206962 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:29.206962 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:29.206962 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:29.206962 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:29.206962 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:29.206962 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:29.206962 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:03:29.206962 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:03:29.206962 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:03:29.206962 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:03:29.208206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:29.208206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:29.208206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:03:29.208206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:29.208206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:03:29.208206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:29.208206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:29.208206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:29.208206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:29.208206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:29.208206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:29.208206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:29.208206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:29.208206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:29.208206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:29.208206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:29.208206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:29.208206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:29.209300 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:29.209300 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:29.209300 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:03:29.209300 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:03:29.209300 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:03:29.209300 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:03:29.209300 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:03:29.209300 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:03:29.209300 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:03:29.209300 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:29.211533 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 400/820] 10.222.0.60 () {56 vars in 1093 bytes} [Sun Jul 31 01:03:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:29.212533 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779fbb3-ae5c-4ded-956a-d30a550edf4f None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:29.260779 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:29.303200 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a8618-fc67-4943-b813-c1ef60e936e4 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:29.330118 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779fbb3-ae5c-4ded-956a-d30a550edf4f None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:29.340818 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dde9e2-0402-4337-b7d4-2a6e0fc6a412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:29.341522 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dde9e2-0402-4337-b7d4-2a6e0fc6a412 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:29.341855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dde9e2-0402-4337-b7d4-2a6e0fc6a412 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:29.342328 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dde9e2-0402-4337-b7d4-2a6e0fc6a412 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:29.354376 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dde9e2-0402-4337-b7d4-2a6e0fc6a412 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:29.356249 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dde9e2-0402-4337-b7d4-2a6e0fc6a412 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:29.371133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-b4dde9e2-0402-4337-b7d4-2a6e0fc6a412 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:29.371133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:29.371133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:29.371133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:29.371133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:29.371133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:29.371133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:29.371133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:29.371133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:29.371133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:29.371133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:29.371133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:29.371133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:03:29.371133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:03:29.371133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:03:29.372133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:03:29.372133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:29.372133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:29.372133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:29.372133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:29.372133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:29.372133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:29.372133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:29.372133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:29.372133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:29.372133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:29.372133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:29.372133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:29.372133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:29.372133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:29.372133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:29.372133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:29.373070 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:03:29.373070 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:03:29.373070 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:03:29.373070 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:03:29.373070 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:03:29.373070 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:03:29.373070 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:29.373070 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:29.373070 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 421/821] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:03:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:29.374033 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dde9e2-0402-4337-b7d4-2a6e0fc6a412 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:29.385664 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e793afe-18a7-4f0f-8da4-9122e9b2355f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:29.386667 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e793afe-18a7-4f0f-8da4-9122e9b2355f None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:29.387212 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e793afe-18a7-4f0f-8da4-9122e9b2355f None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:29.387712 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e793afe-18a7-4f0f-8da4-9122e9b2355f None admin] PATH_INFO: `/v3/services` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:29.388687 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e793afe-18a7-4f0f-8da4-9122e9b2355f None admin] RBAC: Adding query filter params (type=network) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:29.389192 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e793afe-18a7-4f0f-8da4-9122e9b2355f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:29.390970 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e793afe-18a7-4f0f-8da4-9122e9b2355f None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:29.397263 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 401/822] 10.222.0.60 () {56 vars in 1112 bytes} [Sun Jul 31 01:03:29 2022] GET /identity/v3/services?type=network => generated 350 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:29.398487 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e793afe-18a7-4f0f-8da4-9122e9b2355f None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:29.468912 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:29.491108 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dde9e2-0402-4337-b7d4-2a6e0fc6a412 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:29.516032 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e793afe-18a7-4f0f-8da4-9122e9b2355f None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:29.516880 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:29.528576 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6513bfd4-7a6f-484d-8bb3-034b6a1dcb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:29.529577 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513bfd4-7a6f-484d-8bb3-034b6a1dcb28 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:29.529690 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513bfd4-7a6f-484d-8bb3-034b6a1dcb28 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:29.529875 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513bfd4-7a6f-484d-8bb3-034b6a1dcb28 None admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:29.530680 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6513bfd4-7a6f-484d-8bb3-034b6a1dcb28 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:29.531029 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6513bfd4-7a6f-484d-8bb3-034b6a1dcb28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:29.532667 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6513bfd4-7a6f-484d-8bb3-034b6a1dcb28 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:29.555678 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 422/823] 10.222.0.60 () {56 vars in 1133 bytes} [Sun Jul 31 01:03:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:29.557346 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6513bfd4-7a6f-484d-8bb3-034b6a1dcb28 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:29.561197 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e0d53-358c-46b4-b1f5-c6d33ec59234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:29.562704 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e0d53-358c-46b4-b1f5-c6d33ec59234 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:29.562704 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e0d53-358c-46b4-b1f5-c6d33ec59234 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:29.562704 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e0d53-358c-46b4-b1f5-c6d33ec59234 None admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:29.563587 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e0d53-358c-46b4-b1f5-c6d33ec59234 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:29.563901 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e0d53-358c-46b4-b1f5-c6d33ec59234 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:29.565343 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e0d53-358c-46b4-b1f5-c6d33ec59234 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:29.583640 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 402/824] 10.222.0.60 () {56 vars in 1148 bytes} [Sun Jul 31 01:03:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:29.584575 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e0d53-358c-46b4-b1f5-c6d33ec59234 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:29.668686 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6513bfd4-7a6f-484d-8bb3-034b6a1dcb28 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:29.697155 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e0d53-358c-46b4-b1f5-c6d33ec59234 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:29.705564 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b0ae1-b4fd-45b5-8410-6b9a2efe8e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:29.706577 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b0ae1-b4fd-45b5-8410-6b9a2efe8e7a None admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:29.707105 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b0ae1-b4fd-45b5-8410-6b9a2efe8e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:29.707773 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b0ae1-b4fd-45b5-8410-6b9a2efe8e7a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:29.708693 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b0ae1-b4fd-45b5-8410-6b9a2efe8e7a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:29.710380 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b0ae1-b4fd-45b5-8410-6b9a2efe8e7a None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:29.723098 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:29.745332 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 423/825] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:03:29 2022] POST /identity/v3/endpoints => generated 327 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:03:29.745332 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b0ae1-b4fd-45b5-8410-6b9a2efe8e7a None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:29.763606 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f0cf2-1729-4a6d-a403-dede19330308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:29.764272 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f0cf2-1729-4a6d-a403-dede19330308 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:29.764548 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f0cf2-1729-4a6d-a403-dede19330308 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:29.764821 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f0cf2-1729-4a6d-a403-dede19330308 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:29.824745 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:29.923799 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11f0cf2-1729-4a6d-a403-dede19330308 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:29.928438 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11f0cf2-1729-4a6d-a403-dede19330308 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:29.957608 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b0ae1-b4fd-45b5-8410-6b9a2efe8e7a None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:30.006392 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac028ca4-e530-48f5-8290-02b93b08a581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:30.007310 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac028ca4-e530-48f5-8290-02b93b08a581 None admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:30.007634 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac028ca4-e530-48f5-8290-02b93b08a581 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:30.007905 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac028ca4-e530-48f5-8290-02b93b08a581 None admin] PATH_INFO: `/v3/projects/b931b81a237949aa845891d4bb5aa1c0/users/02ed9040d575462db4b270a5b57063f2/roles/a5d1b78d4ec146848dfa667303603262` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:30.025919 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac028ca4-e530-48f5-8290-02b93b08a581 None admin] RBAC: Authorizing `identity:create_grant(project_id=b931b81a237949aa845891d4bb5aa1c0, user_id=02ed9040d575462db4b270a5b57063f2, role_id=a5d1b78d4ec146848dfa667303603262)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:30.027521 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac028ca4-e530-48f5-8290-02b93b08a581 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:30.048182 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 424/826] 10.222.0.60 () {58 vars in 1439 bytes} [Sun Jul 31 01:03:29 2022] PUT /identity/v3/projects/b931b81a237949aa845891d4bb5aa1c0/users/02ed9040d575462db4b270a5b57063f2/roles/a5d1b78d4ec146848dfa667303603262 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:03:30.048970 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac38fa-cd5b-4c3a-9346-fe1d642f27e1 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:30.048970 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac38fa-cd5b-4c3a-9346-fe1d642f27e1 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:30.049147 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac38fa-cd5b-4c3a-9346-fe1d642f27e1 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:30.055372 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 425/827] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:30.057476 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306931d1-76b5-45c9-afd7-9ef8042bca8b None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:30.057765 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306931d1-76b5-45c9-afd7-9ef8042bca8b None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:30.058034 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306931d1-76b5-45c9-afd7-9ef8042bca8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:30.084740 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-306931d1-76b5-45c9-afd7-9ef8042bca8b None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:30.085958 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 403/828] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:03:29 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:03:30.086429 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-306931d1-76b5-45c9-afd7-9ef8042bca8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:30.092384 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f0cf2-1729-4a6d-a403-dede19330308 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:30.114283 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:30.179461 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 426/829] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:03:30.208219 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306931d1-76b5-45c9-afd7-9ef8042bca8b None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:30.228301 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f0cf2-1729-4a6d-a403-dede19330308 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:30.230335 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:30.277869 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4551af-2385-4fb7-8212-e1ea6cb77b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:30.278453 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4551af-2385-4fb7-8212-e1ea6cb77b8a None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:30.278729 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4551af-2385-4fb7-8212-e1ea6cb77b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:30.279034 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4551af-2385-4fb7-8212-e1ea6cb77b8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:30.291446 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4551af-2385-4fb7-8212-e1ea6cb77b8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:30.293268 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4551af-2385-4fb7-8212-e1ea6cb77b8a None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:30.316713 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-8a4551af-2385-4fb7-8212-e1ea6cb77b8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:30.316713 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:30.316713 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:30.316713 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:30.316713 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:30.316713 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:30.316713 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:30.316713 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:30.316713 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:30.316713 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:30.316713 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:30.316713 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:30.316713 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:30.316713 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:30.316713 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:30.317680 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:30.317680 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:30.317680 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:30.317680 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:30.317680 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:30.317680 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:30.317680 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:30.317680 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:30.317680 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:30.317680 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:30.317680 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:30.317680 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:30.317680 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:30.317680 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:30.317680 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:30.317680 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:30.317680 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:30.318569 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:30.318569 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:30.318569 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:30.318569 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:30.319351 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 404/830] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:03:30.324238 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4551af-2385-4fb7-8212-e1ea6cb77b8a None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:30.346020 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306931d1-76b5-45c9-afd7-9ef8042bca8b None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:30.390040 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181c1d2-55fc-4775-9eb8-1afb998f1674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:30.390797 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181c1d2-55fc-4775-9eb8-1afb998f1674 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:30.391083 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181c1d2-55fc-4775-9eb8-1afb998f1674 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:30.391345 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181c1d2-55fc-4775-9eb8-1afb998f1674 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:30.402768 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7181c1d2-55fc-4775-9eb8-1afb998f1674 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:03:30.408504 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-7181c1d2-55fc-4775-9eb8-1afb998f1674 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:03:30.408504 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:30.408504 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:30.408504 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:30.408504 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:30.408504 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:30.408504 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:30.408504 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:30.408504 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:30.408504 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:30.408504 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:30.408504 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:30.408504 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:03:30.408504 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:03:30.408504 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:03:30.408504 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:03:30.409462 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:03:30.409462 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:03:30.409462 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:03:30.409462 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:03:30.409462 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:30.409462 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:30.409462 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:30.409462 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:30.409462 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:30.409462 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:30.409462 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:30.409462 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:30.409462 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:30.409462 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:30.409462 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:30.409462 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:30.410299 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:30.410299 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:30.410299 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:30.410299 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:30.410299 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:03:30.410299 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:03:30.410299 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:03:30.410299 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:03:30.410299 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:03:30.410299 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:03:30.410299 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:03:30.410299 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:30.410299 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 427/831] 10.222.0.60 () {56 vars in 1096 bytes} [Sun Jul 31 01:03:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:03:30.415806 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181c1d2-55fc-4775-9eb8-1afb998f1674 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:30.424107 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:30.470585 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4551af-2385-4fb7-8212-e1ea6cb77b8a None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:30.500584 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:30.520386 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc150c0-f838-4e4a-82ff-d3fd55042b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:30.522136 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc150c0-f838-4e4a-82ff-d3fd55042b36 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:30.522618 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc150c0-f838-4e4a-82ff-d3fd55042b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:30.523331 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc150c0-f838-4e4a-82ff-d3fd55042b36 None admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:30.524671 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc150c0-f838-4e4a-82ff-d3fd55042b36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:30.525416 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc150c0-f838-4e4a-82ff-d3fd55042b36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:30.528195 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc150c0-f838-4e4a-82ff-d3fd55042b36 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:30.529944 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181c1d2-55fc-4775-9eb8-1afb998f1674 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:30.547879 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 405/832] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:03:30.551144 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc150c0-f838-4e4a-82ff-d3fd55042b36 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:30.572079 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050347fb-3dd4-4c9e-929c-f39a6f07a113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:30.572719 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050347fb-3dd4-4c9e-929c-f39a6f07a113 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:30.573001 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050347fb-3dd4-4c9e-929c-f39a6f07a113 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:30.573530 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050347fb-3dd4-4c9e-929c-f39a6f07a113 None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:30.574069 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050347fb-3dd4-4c9e-929c-f39a6f07a113 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:30.574380 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050347fb-3dd4-4c9e-929c-f39a6f07a113 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:30.575840 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050347fb-3dd4-4c9e-929c-f39a6f07a113 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:30.585163 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 428/833] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:03:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:30.592559 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050347fb-3dd4-4c9e-929c-f39a6f07a113 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:30.664688 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc150c0-f838-4e4a-82ff-d3fd55042b36 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:30.708885 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:30.716930 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f92f4e8-cae5-4fa9-b510-8b98068fecf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:30.717904 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92f4e8-cae5-4fa9-b510-8b98068fecf6 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:30.718389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92f4e8-cae5-4fa9-b510-8b98068fecf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:30.718888 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92f4e8-cae5-4fa9-b510-8b98068fecf6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:30.726474 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f92f4e8-cae5-4fa9-b510-8b98068fecf6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:30.727544 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050347fb-3dd4-4c9e-929c-f39a6f07a113 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:30.728535 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f92f4e8-cae5-4fa9-b510-8b98068fecf6 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:30.741136 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-3f92f4e8-cae5-4fa9-b510-8b98068fecf6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:30.741136 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:30.741136 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:30.741136 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:30.741136 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:30.741136 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:30.741136 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:30.741136 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:30.741136 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:30.741136 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:30.741136 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:30.741136 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:30.741136 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:03:30.741136 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:03:30.741136 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:03:30.742125 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:03:30.742125 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:30.742125 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:30.742125 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:30.742125 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:30.742125 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:30.742125 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:30.742125 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:30.742125 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:30.742125 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:30.742125 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:30.742125 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:30.742125 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:30.742125 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:30.742125 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:30.742125 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:30.742125 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:30.743016 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:03:30.743016 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:03:30.743016 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:03:30.743016 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:03:30.743016 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:03:30.743016 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:03:30.743016 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:30.743016 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:30.750212 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 406/834] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:03:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:30.751447 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f92f4e8-cae5-4fa9-b510-8b98068fecf6 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:30.767848 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c84cba-f5ba-43c9-bde4-d200be35c717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:30.768558 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c84cba-f5ba-43c9-bde4-d200be35c717 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:30.768833 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c84cba-f5ba-43c9-bde4-d200be35c717 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:30.769100 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c84cba-f5ba-43c9-bde4-d200be35c717 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:30.782639 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:30.786985 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c84cba-f5ba-43c9-bde4-d200be35c717 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:30.789224 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c84cba-f5ba-43c9-bde4-d200be35c717 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:30.809082 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-55c84cba-f5ba-43c9-bde4-d200be35c717 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:30.809082 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:30.809082 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:30.809082 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:30.809082 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:30.809082 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:30.809082 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:30.809082 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:30.809082 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:30.809082 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:30.809082 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:30.809082 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:30.809082 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:30.809082 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:30.809082 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:30.810039 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:30.810039 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:30.810039 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:30.810039 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:30.810039 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:30.810039 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:30.810039 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:30.810039 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:30.810039 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:30.810039 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:30.810039 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:30.810039 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:30.810039 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:30.810039 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:30.810039 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:30.810039 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:30.810039 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:30.810985 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:30.810985 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:30.810985 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:30.810985 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:30.815585 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 429/835] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:30.817870 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c84cba-f5ba-43c9-bde4-d200be35c717 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:30.870090 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f92f4e8-cae5-4fa9-b510-8b98068fecf6 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:30.908135 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae4fc5e-daa1-489a-9955-ee50cc8f8243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:30.909148 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4fc5e-daa1-489a-9955-ee50cc8f8243 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:30.909482 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4fc5e-daa1-489a-9955-ee50cc8f8243 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:30.909927 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4fc5e-daa1-489a-9955-ee50cc8f8243 None admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:30.910711 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae4fc5e-daa1-489a-9955-ee50cc8f8243 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:30.911019 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae4fc5e-daa1-489a-9955-ee50cc8f8243 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:30.912501 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae4fc5e-daa1-489a-9955-ee50cc8f8243 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:30.927718 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c84cba-f5ba-43c9-bde4-d200be35c717 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:30.931506 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 407/836] 10.222.0.60 () {56 vars in 1148 bytes} [Sun Jul 31 01:03:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:30.932447 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae4fc5e-daa1-489a-9955-ee50cc8f8243 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:30.964009 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340ddae-9de7-4b94-bfea-64e535febc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:30.965339 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340ddae-9de7-4b94-bfea-64e535febc05 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:30.965807 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340ddae-9de7-4b94-bfea-64e535febc05 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:30.966283 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340ddae-9de7-4b94-bfea-64e535febc05 None admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:30.967210 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8340ddae-9de7-4b94-bfea-64e535febc05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:30.967726 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8340ddae-9de7-4b94-bfea-64e535febc05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:30.969372 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8340ddae-9de7-4b94-bfea-64e535febc05 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:30.985840 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:30.986790 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 430/837] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:30.988423 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340ddae-9de7-4b94-bfea-64e535febc05 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:31.047406 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:31.050412 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae4fc5e-daa1-489a-9955-ee50cc8f8243 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:31.092064 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a8fe4-886c-497d-9a01-9efac9235430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:31.092844 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a8fe4-886c-497d-9a01-9efac9235430 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:31.093039 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a8fe4-886c-497d-9a01-9efac9235430 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:31.093311 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a8fe4-886c-497d-9a01-9efac9235430 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:31.094067 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340ddae-9de7-4b94-bfea-64e535febc05 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:31.094169 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a8fe4-886c-497d-9a01-9efac9235430 None admin] RBAC: Adding query filter params (role.id=fef526a7d2e741ce995d107f3ac934ae, scope.project.id=b931b81a237949aa845891d4bb5aa1c0, user.id=04591cd035ef4961b8b7a93e294eb881) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:31.094414 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a8fe4-886c-497d-9a01-9efac9235430 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:31.095875 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a8fe4-886c-497d-9a01-9efac9235430 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:31.102083 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 408/838] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:03:30 2022] GET /identity/v3/role_assignments?user.id=04591cd035ef4961b8b7a93e294eb881&scope.project.id=b931b81a237949aa845891d4bb5aa1c0&role.id=fef526a7d2e741ce995d107f3ac934ae => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:03:31.103373 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e466b2-b6d6-4c6b-a96f-ab102c7d5658 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:31.103756 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e466b2-b6d6-4c6b-a96f-ab102c7d5658 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:31.104023 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e466b2-b6d6-4c6b-a96f-ab102c7d5658 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:31.109657 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 409/839] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:31.111445 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cb878-9adc-42b8-831d-829e85d0bd82 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:31.111788 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cb878-9adc-42b8-831d-829e85d0bd82 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:31.112019 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cb878-9adc-42b8-831d-829e85d0bd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:31.133713 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-a60cb878-9adc-42b8-831d-829e85d0bd82 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:31.135034 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-a60cb878-9adc-42b8-831d-829e85d0bd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:31.150727 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211a1cc-0c03-439d-ae3b-c5853ba10a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:31.152421 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211a1cc-0c03-439d-ae3b-c5853ba10a49 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:31.153237 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211a1cc-0c03-439d-ae3b-c5853ba10a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:31.153753 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211a1cc-0c03-439d-ae3b-c5853ba10a49 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:31.165607 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a211a1cc-0c03-439d-ae3b-c5853ba10a49 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:31.168617 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a211a1cc-0c03-439d-ae3b-c5853ba10a49 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:31.186402 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-a211a1cc-0c03-439d-ae3b-c5853ba10a49 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 31 01:03:31.186402 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:31.186402 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:31.186402 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:31.186402 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:31.186402 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:31.186402 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:31.186402 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:31.186402 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:31.186402 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:31.186402 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:31.186402 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:31.186402 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:03:31.186402 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:03:31.186402 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:03:31.186402 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:03:31.187521 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:31.187521 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:31.187521 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:03:31.187521 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:31.187521 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:03:31.187521 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:31.187521 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:31.187521 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:31.187521 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:31.187521 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:31.187521 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:31.187521 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:31.187521 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:31.187521 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:31.187521 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:31.187521 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:31.187521 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:31.187521 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:31.188462 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:31.188462 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:31.188462 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:03:31.188462 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:03:31.188462 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:03:31.188462 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:03:31.188462 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:03:31.188462 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:03:31.188462 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 31 01:03:31.188462 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:31.193496 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 431/840] 10.222.0.60 () {56 vars in 1096 bytes} [Sun Jul 31 01:03:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:31.194525 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211a1cc-0c03-439d-ae3b-c5853ba10a49 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:31.221251 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 410/841] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:03:31.248994 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60cb878-9adc-42b8-831d-829e85d0bd82 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:31.304995 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:31.342600 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211a1cc-0c03-439d-ae3b-c5853ba10a49 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:31.363026 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:31.397087 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf0ef7-d8e7-47c3-83a5-5a2bd900b4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:31.397516 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf0ef7-d8e7-47c3-83a5-5a2bd900b4a0 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:31.397848 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf0ef7-d8e7-47c3-83a5-5a2bd900b4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:31.398121 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf0ef7-d8e7-47c3-83a5-5a2bd900b4a0 None admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:31.398916 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf0ef7-d8e7-47c3-83a5-5a2bd900b4a0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:31.399219 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf0ef7-d8e7-47c3-83a5-5a2bd900b4a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:31.400698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf0ef7-d8e7-47c3-83a5-5a2bd900b4a0 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:31.400955 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60cb878-9adc-42b8-831d-829e85d0bd82 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:31.419329 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 432/842] 10.222.0.60 () {56 vars in 1135 bytes} [Sun Jul 31 01:03:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:31.425153 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf0ef7-d8e7-47c3-83a5-5a2bd900b4a0 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:31.449267 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28401f8a-ed69-45cf-93b6-f78ded0337d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:31.450326 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28401f8a-ed69-45cf-93b6-f78ded0337d3 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:31.450723 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28401f8a-ed69-45cf-93b6-f78ded0337d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:31.451067 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28401f8a-ed69-45cf-93b6-f78ded0337d3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:31.452065 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28401f8a-ed69-45cf-93b6-f78ded0337d3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:31.454897 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28401f8a-ed69-45cf-93b6-f78ded0337d3 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:31.468825 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-28401f8a-ed69-45cf-93b6-f78ded0337d3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 31 01:03:31.468825 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:31.468825 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:03:31.468825 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:03:31.468825 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:03:31.468825 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:03:31.468825 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:03:31.468825 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:31.468825 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 31 01:03:31.468825 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:31.468825 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:03:31.468825 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:31.468825 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:31.468825 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:31.468825 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:31.468825 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:31.468825 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:31.470197 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:31.470197 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:31.470197 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:31.470197 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:31.470197 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:31.470197 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:31.470197 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:03:31.470197 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:03:31.470197 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:03:31.470197 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:03:31.470197 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:31.470197 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:31.470197 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:31.470197 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:31.470197 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:31.470197 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:31.471107 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:31.471107 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:31.471107 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:31.471107 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:31.471107 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:31.471107 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:31.471107 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:31.471107 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:31.471107 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:31.471107 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:31.471107 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:03:31.471107 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:31.471107 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 31 01:03:31.471107 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:31.471932 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 411/843] 10.222.0.60 () {56 vars in 1114 bytes} [Sun Jul 31 01:03:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:03:31.478899 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28401f8a-ed69-45cf-93b6-f78ded0337d3 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:31.552213 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf0ef7-d8e7-47c3-83a5-5a2bd900b4a0 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:31.598327 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693307de-9914-4718-8e75-a38a2f568729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:31.598884 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693307de-9914-4718-8e75-a38a2f568729 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:31.599164 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693307de-9914-4718-8e75-a38a2f568729 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:31.599437 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693307de-9914-4718-8e75-a38a2f568729 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:31.612409 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28401f8a-ed69-45cf-93b6-f78ded0337d3 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:31.621805 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:31.649694 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d305c-2bab-4fa7-ac31-06ad555ffab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:31.650673 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d305c-2bab-4fa7-ac31-06ad555ffab1 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:31.651087 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d305c-2bab-4fa7-ac31-06ad555ffab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:31.651512 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d305c-2bab-4fa7-ac31-06ad555ffab1 None admin] PATH_INFO: `/v3/services` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:31.652156 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:31.652563 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d305c-2bab-4fa7-ac31-06ad555ffab1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:31.653067 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d305c-2bab-4fa7-ac31-06ad555ffab1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:31.654755 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d305c-2bab-4fa7-ac31-06ad555ffab1 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:31.666401 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 412/844] 10.222.0.60 () {56 vars in 1114 bytes} [Sun Jul 31 01:03:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:31.667541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d305c-2bab-4fa7-ac31-06ad555ffab1 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:31.687073 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693307de-9914-4718-8e75-a38a2f568729 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:31.688772 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693307de-9914-4718-8e75-a38a2f568729 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:31.784645 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d305c-2bab-4fa7-ac31-06ad555ffab1 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:31.808069 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 433/845] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:03:31 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 31 01:03:31.813483 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693307de-9914-4718-8e75-a38a2f568729 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:31.832266 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d0f04-0735-4e12-98aa-53ee72270f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:31.833326 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d0f04-0735-4e12-98aa-53ee72270f9f None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:31.833820 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d0f04-0735-4e12-98aa-53ee72270f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:31.834281 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d0f04-0735-4e12-98aa-53ee72270f9f None admin] PATH_INFO: `/v3/services` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:31.835255 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8d0f04-0735-4e12-98aa-53ee72270f9f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:31.835877 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8d0f04-0735-4e12-98aa-53ee72270f9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:31.837426 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8d0f04-0735-4e12-98aa-53ee72270f9f None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:31.847818 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 413/846] 10.222.0.60 () {56 vars in 1114 bytes} [Sun Jul 31 01:03:31 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:31.895742 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:31.934937 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693307de-9914-4718-8e75-a38a2f568729 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:31.975072 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff593594-b8e8-4265-a926-e646654e36a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:31.975893 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff593594-b8e8-4265-a926-e646654e36a5 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:31.976088 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff593594-b8e8-4265-a926-e646654e36a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:31.976359 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff593594-b8e8-4265-a926-e646654e36a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:31.988681 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff593594-b8e8-4265-a926-e646654e36a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:31.990204 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff593594-b8e8-4265-a926-e646654e36a5 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:32.008206 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-ff593594-b8e8-4265-a926-e646654e36a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:32.008206 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:32.008206 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:32.008206 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:32.008206 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:32.008206 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:32.008206 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:32.008206 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:32.008206 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:32.008206 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:32.008206 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:32.008206 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:32.008206 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:32.008206 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:32.008206 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:32.009183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:32.009183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:32.009183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:32.009183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:32.009183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:32.009183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:32.009183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:32.009183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:32.009183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:32.009183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:32.009183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:32.009183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:32.009183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:32.009183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:32.009183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:32.009183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:32.009183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:32.010059 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:32.010059 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:32.010059 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:32.010059 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:32.010059 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 434/847] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:03:32.015769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d0f04-0735-4e12-98aa-53ee72270f9f None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:32.057883 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:32.137450 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d0f04-0735-4e12-98aa-53ee72270f9f None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:32.153092 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0123e-b2d7-458b-b093-19a4e8245b6b None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:32.153267 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0123e-b2d7-458b-b093-19a4e8245b6b None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:32.153548 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0123e-b2d7-458b-b093-19a4e8245b6b None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:32.156389 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 435/848] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:32.160511 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57026a-c455-498e-af26-bd89eb5353fe None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:32.160790 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57026a-c455-498e-af26-bd89eb5353fe None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:32.161062 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57026a-c455-498e-af26-bd89eb5353fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:32.181596 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c588e-c063-4173-b828-cf58af8e019b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:32.182291 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c588e-c063-4173-b828-cf58af8e019b None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:32.182569 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c588e-c063-4173-b828-cf58af8e019b None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:32.182836 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c588e-c063-4173-b828-cf58af8e019b None admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:32.183548 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c588e-c063-4173-b828-cf58af8e019b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:32.183738 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-da57026a-c455-498e-af26-bd89eb5353fe None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:32.183838 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c588e-c063-4173-b828-cf58af8e019b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:32.185272 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c588e-c063-4173-b828-cf58af8e019b None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:32.185397 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-da57026a-c455-498e-af26-bd89eb5353fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:32.198438 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 414/849] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:32.207554 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c588e-c063-4173-b828-cf58af8e019b None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:32.259930 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 436/850] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:32 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:03:32.283333 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57026a-c455-498e-af26-bd89eb5353fe None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:32.336487 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:32.344276 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c588e-c063-4173-b828-cf58af8e019b None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:32.351914 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:32.397776 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f6378-926d-4507-b27f-7a37c7e3a009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:32.399551 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f6378-926d-4507-b27f-7a37c7e3a009 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:32.400129 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f6378-926d-4507-b27f-7a37c7e3a009 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:32.400839 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f6378-926d-4507-b27f-7a37c7e3a009 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:32.410219 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f6378-926d-4507-b27f-7a37c7e3a009 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:32.412813 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f6378-926d-4507-b27f-7a37c7e3a009 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:32.420556 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57026a-c455-498e-af26-bd89eb5353fe None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:32.428057 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-078f6378-926d-4507-b27f-7a37c7e3a009 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:32.428057 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:32.428057 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:32.428057 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:32.428057 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:32.428057 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:32.428057 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:32.428057 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:32.428057 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:32.428057 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:32.428057 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:32.428057 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:32.428057 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:03:32.428057 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:03:32.428057 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:03:32.428968 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:03:32.428968 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:32.428968 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:32.428968 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:32.428968 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:32.428968 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:32.428968 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:32.428968 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:32.428968 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:32.428968 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:32.428968 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:32.428968 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:32.428968 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:32.428968 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:32.428968 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:32.428968 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:32.428968 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:32.429948 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:03:32.429948 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:03:32.429948 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:03:32.429948 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:03:32.429948 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:03:32.429948 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:03:32.429948 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:32.429948 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:32.432566 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 415/851] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:03:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:32.438717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f6378-926d-4507-b27f-7a37c7e3a009 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:32.471360 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015451a-e962-4aae-86c3-116288370769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:32.472210 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015451a-e962-4aae-86c3-116288370769 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:32.472584 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015451a-e962-4aae-86c3-116288370769 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:32.473203 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015451a-e962-4aae-86c3-116288370769 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:32.496362 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c015451a-e962-4aae-86c3-116288370769 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:03:32.508636 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-c015451a-e962-4aae-86c3-116288370769 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:03:32.508636 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:32.508636 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:32.508636 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:32.508636 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:32.508636 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:32.508636 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:32.508636 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:32.508636 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:32.508636 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:32.508636 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:32.508636 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:32.508636 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:03:32.508636 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:03:32.508636 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:03:32.508636 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:03:32.509735 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:03:32.509735 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:03:32.509735 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:03:32.509735 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:03:32.509735 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:32.509735 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:32.509735 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:32.509735 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:32.509735 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:32.509735 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:32.509735 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:32.509735 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:32.509735 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:32.509735 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:32.509735 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:32.509735 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:32.510635 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:32.510635 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:32.510635 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:32.510635 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:32.510635 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:03:32.510635 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:03:32.510635 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:03:32.510635 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:03:32.510635 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:03:32.510635 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:03:32.510635 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:03:32.510635 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:32.511374 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 437/852] 10.222.0.60 () {56 vars in 1102 bytes} [Sun Jul 31 01:03:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:03:32.516913 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015451a-e962-4aae-86c3-116288370769 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:32.577419 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f6378-926d-4507-b27f-7a37c7e3a009 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:32.623824 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92664a-07a8-4b15-8380-bf55c01139cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:32.624460 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92664a-07a8-4b15-8380-bf55c01139cf None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:32.624736 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92664a-07a8-4b15-8380-bf55c01139cf None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:32.625013 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92664a-07a8-4b15-8380-bf55c01139cf None admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:32.626404 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da92664a-07a8-4b15-8380-bf55c01139cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:32.626828 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da92664a-07a8-4b15-8380-bf55c01139cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:32.628690 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da92664a-07a8-4b15-8380-bf55c01139cf None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:32.644094 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 416/853] 10.222.0.60 () {56 vars in 1148 bytes} [Sun Jul 31 01:03:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:03:32.656744 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92664a-07a8-4b15-8380-bf55c01139cf None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:32.665950 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015451a-e962-4aae-86c3-116288370769 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:32.679631 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:32.688353 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:32.722178 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8672e-6a98-479b-a241-ec26075480ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:32.726161 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8672e-6a98-479b-a241-ec26075480ec None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:32.726432 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8672e-6a98-479b-a241-ec26075480ec None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:32.726709 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8672e-6a98-479b-a241-ec26075480ec None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:32.727949 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8672e-6a98-479b-a241-ec26075480ec None admin] RBAC: Adding query filter params (name=service) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:32.729606 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8672e-6a98-479b-a241-ec26075480ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:32.731026 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8672e-6a98-479b-a241-ec26075480ec None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:32.744417 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 438/854] 10.222.0.60 () {56 vars in 1103 bytes} [Sun Jul 31 01:03:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:32.751531 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8672e-6a98-479b-a241-ec26075480ec None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:32.797579 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92664a-07a8-4b15-8380-bf55c01139cf None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:32.840775 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd22fe-3c69-4cec-9c29-8d367c27c71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:32.842772 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd22fe-3c69-4cec-9c29-8d367c27c71f None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:32.843277 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd22fe-3c69-4cec-9c29-8d367c27c71f None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:32.843779 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd22fe-3c69-4cec-9c29-8d367c27c71f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:32.844842 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcd22fe-3c69-4cec-9c29-8d367c27c71f None admin] RBAC: Adding query filter params (role.id=fef526a7d2e741ce995d107f3ac934ae, scope.project.id=b931b81a237949aa845891d4bb5aa1c0, user.id=0c8c98c1e2d24de89c7d07753fae02e5) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:32.845363 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcd22fe-3c69-4cec-9c29-8d367c27c71f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:32.847651 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcd22fe-3c69-4cec-9c29-8d367c27c71f None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:32.858126 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 417/855] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:03:32 2022] GET /identity/v3/role_assignments?user.id=0c8c98c1e2d24de89c7d07753fae02e5&scope.project.id=b931b81a237949aa845891d4bb5aa1c0&role.id=fef526a7d2e741ce995d107f3ac934ae => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:32.879782 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8672e-6a98-479b-a241-ec26075480ec None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:32.920170 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1841e3-4f7a-4918-87b5-0af2eb1a846f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:32.920775 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1841e3-4f7a-4918-87b5-0af2eb1a846f None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:32.921052 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1841e3-4f7a-4918-87b5-0af2eb1a846f None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:32.921326 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1841e3-4f7a-4918-87b5-0af2eb1a846f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:32.934676 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1841e3-4f7a-4918-87b5-0af2eb1a846f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:32.936528 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1841e3-4f7a-4918-87b5-0af2eb1a846f None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:32.954065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-be1841e3-4f7a-4918-87b5-0af2eb1a846f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:32.954065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:32.954065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:32.954065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:32.954065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:32.954065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:32.954065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:32.954065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:32.954065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:32.954065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:32.954065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:32.954065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:32.954065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:32.954065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:32.954065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:32.955046 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:32.955046 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:32.955046 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:32.955046 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:32.955046 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:32.955046 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:32.955046 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:32.955046 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:32.955046 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:32.955046 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:32.955046 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:32.955046 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:32.955046 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:32.955046 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:32.955046 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:32.955046 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:32.955046 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:32.956214 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:32.956214 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:32.956214 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:32.956214 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:32.956214 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 439/856] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:03:32.962570 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd22fe-3c69-4cec-9c29-8d367c27c71f None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:33.053489 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:33.078022 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd22fe-3c69-4cec-9c29-8d367c27c71f None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:33.115000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f9f80-0138-46a7-8f85-c686b79fb803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:33.115659 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f9f80-0138-46a7-8f85-c686b79fb803 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:33.115986 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f9f80-0138-46a7-8f85-c686b79fb803 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:33.116261 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f9f80-0138-46a7-8f85-c686b79fb803 None admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:33.116972 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f9f80-0138-46a7-8f85-c686b79fb803 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:33.117270 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f9f80-0138-46a7-8f85-c686b79fb803 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:33.118654 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f9f80-0138-46a7-8f85-c686b79fb803 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:33.137022 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 418/857] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:33.138633 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1841e3-4f7a-4918-87b5-0af2eb1a846f None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:33.168618 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:33.248704 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1841e3-4f7a-4918-87b5-0af2eb1a846f None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:33.285164 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc519e49-3d3f-4b5f-af05-dd796e48d9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:33.286233 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc519e49-3d3f-4b5f-af05-dd796e48d9ae None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:33.286711 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc519e49-3d3f-4b5f-af05-dd796e48d9ae None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:33.287177 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc519e49-3d3f-4b5f-af05-dd796e48d9ae None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:33.295960 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc519e49-3d3f-4b5f-af05-dd796e48d9ae None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:33.297739 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc519e49-3d3f-4b5f-af05-dd796e48d9ae None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:33.309826 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-bc519e49-3d3f-4b5f-af05-dd796e48d9ae None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 31 01:03:33.309826 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:33.309826 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:33.309826 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:33.309826 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:33.309826 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:33.309826 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:33.309826 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:33.309826 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:33.309826 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:33.309826 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:33.309826 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:33.309826 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:03:33.309826 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:03:33.309826 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:03:33.309826 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:03:33.310832 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:33.310832 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:33.310832 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:03:33.310832 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:33.310832 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:03:33.310832 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:33.310832 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:33.310832 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:33.310832 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:33.310832 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:33.310832 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:33.310832 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:33.310832 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:33.310832 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:33.310832 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:33.310832 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:33.310832 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:33.310832 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:33.311804 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:33.311804 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:33.311804 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:03:33.311804 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:03:33.311804 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:03:33.311804 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:03:33.311804 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:03:33.311804 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:03:33.311804 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 31 01:03:33.311804 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:33.314382 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 440/858] 10.222.0.60 () {56 vars in 1117 bytes} [Sun Jul 31 01:03:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:33.319908 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f9f80-0138-46a7-8f85-c686b79fb803 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:33.347741 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a97e3-f773-403e-aba8-215ddbba45b9 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:33.348375 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a97e3-f773-403e-aba8-215ddbba45b9 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:33.348841 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a97e3-f773-403e-aba8-215ddbba45b9 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:33.350556 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 441/859] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:03:33.367706 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabec021-1985-4f5c-8a42-4f5e36fc80c8 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:33.367987 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabec021-1985-4f5c-8a42-4f5e36fc80c8 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:33.368255 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabec021-1985-4f5c-8a42-4f5e36fc80c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:33.392059 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-aabec021-1985-4f5c-8a42-4f5e36fc80c8 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:33.393856 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-aabec021-1985-4f5c-8a42-4f5e36fc80c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:33.439575 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f9f80-0138-46a7-8f85-c686b79fb803 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:33.483535 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 442/860] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:33 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:03:33.492903 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb2de1-7ce1-4c23-8cb6-7fbfd3c1ee49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:33.493760 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb2de1-7ce1-4c23-8cb6-7fbfd3c1ee49 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:33.494175 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb2de1-7ce1-4c23-8cb6-7fbfd3c1ee49 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:33.494637 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb2de1-7ce1-4c23-8cb6-7fbfd3c1ee49 None admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:33.495633 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abb2de1-7ce1-4c23-8cb6-7fbfd3c1ee49 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:33.496169 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abb2de1-7ce1-4c23-8cb6-7fbfd3c1ee49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:33.497446 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabec021-1985-4f5c-8a42-4f5e36fc80c8 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:33.498051 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abb2de1-7ce1-4c23-8cb6-7fbfd3c1ee49 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:33.508828 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:33.516253 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:33.523727 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 419/861] 10.222.0.60 () {56 vars in 1149 bytes} [Sun Jul 31 01:03:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:33.525004 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb2de1-7ce1-4c23-8cb6-7fbfd3c1ee49 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:33.601391 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabec021-1985-4f5c-8a42-4f5e36fc80c8 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:33.635816 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb2de1-7ce1-4c23-8cb6-7fbfd3c1ee49 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:33.639859 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801a5eb-f0c7-46dc-b730-83cd160fc9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:33.640767 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801a5eb-f0c7-46dc-b730-83cd160fc9ba None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:33.641242 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801a5eb-f0c7-46dc-b730-83cd160fc9ba None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:33.641729 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801a5eb-f0c7-46dc-b730-83cd160fc9ba None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:33.642552 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f801a5eb-f0c7-46dc-b730-83cd160fc9ba None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:33.644171 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f801a5eb-f0c7-46dc-b730-83cd160fc9ba None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:33.654111 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-f801a5eb-f0c7-46dc-b730-83cd160fc9ba None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 31 01:03:33.654111 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:33.654111 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:03:33.654111 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:03:33.654111 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:03:33.654111 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:03:33.654111 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:03:33.654111 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:33.654111 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 31 01:03:33.654111 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:33.654111 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:03:33.654111 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:33.654111 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:33.654111 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:33.654111 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:33.654111 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:33.655079 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:33.655079 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:33.655079 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:33.655079 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:33.655079 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:33.655079 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:33.655079 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:33.655079 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:03:33.655079 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:03:33.655079 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:03:33.655079 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:03:33.655079 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:33.655079 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:33.655079 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:33.655079 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:33.655079 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:33.655941 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:33.655941 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:33.655941 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:33.655941 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:33.655941 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:33.655941 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:33.655941 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:33.655941 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:33.655941 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:33.655941 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:33.655941 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:33.655941 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:03:33.655941 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:33.655941 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 31 01:03:33.655941 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:33.663679 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 443/862] 10.222.0.60 () {56 vars in 1132 bytes} [Sun Jul 31 01:03:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:03:33.664762 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801a5eb-f0c7-46dc-b730-83cd160fc9ba None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:33.675429 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d03cc-efde-4634-8987-ea22a8e553c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:33.676127 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d03cc-efde-4634-8987-ea22a8e553c6 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:33.676402 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d03cc-efde-4634-8987-ea22a8e553c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:33.676678 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d03cc-efde-4634-8987-ea22a8e553c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:33.756815 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:33.763594 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d03cc-efde-4634-8987-ea22a8e553c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:33.764346 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:33.765509 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d03cc-efde-4634-8987-ea22a8e553c6 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:33.788321 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801a5eb-f0c7-46dc-b730-83cd160fc9ba None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:33.823035 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1932e1e-31c8-445e-b8ff-397cc736abd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:33.824037 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1932e1e-31c8-445e-b8ff-397cc736abd9 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:33.824515 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1932e1e-31c8-445e-b8ff-397cc736abd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:33.824999 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1932e1e-31c8-445e-b8ff-397cc736abd9 None admin] PATH_INFO: `/v3/services` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:33.825925 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1932e1e-31c8-445e-b8ff-397cc736abd9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:33.826506 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1932e1e-31c8-445e-b8ff-397cc736abd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:33.828124 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1932e1e-31c8-445e-b8ff-397cc736abd9 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:33.837731 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 444/863] 10.222.0.60 () {56 vars in 1126 bytes} [Sun Jul 31 01:03:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:33.838799 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1932e1e-31c8-445e-b8ff-397cc736abd9 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:33.887382 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 420/864] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:03:33 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 31 01:03:33.888709 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d03cc-efde-4634-8987-ea22a8e553c6 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:33.943426 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1932e1e-31c8-445e-b8ff-397cc736abd9 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:33.979073 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3755b-4d21-40f6-ae42-4117bc1eb8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:33.980199 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3755b-4d21-40f6-ae42-4117bc1eb8f1 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:33.980784 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3755b-4d21-40f6-ae42-4117bc1eb8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:33.981227 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3755b-4d21-40f6-ae42-4117bc1eb8f1 None admin] PATH_INFO: `/v3/services` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:33.982106 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f3755b-4d21-40f6-ae42-4117bc1eb8f1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:33.982635 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f3755b-4d21-40f6-ae42-4117bc1eb8f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:33.984377 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f3755b-4d21-40f6-ae42-4117bc1eb8f1 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:33.987280 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:33.995059 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d03cc-efde-4634-8987-ea22a8e553c6 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:33.995412 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 445/865] 10.222.0.60 () {56 vars in 1126 bytes} [Sun Jul 31 01:03:33 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:34.032101 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00a8f6-e3b1-4609-9893-00a6c7a12e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:34.032691 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00a8f6-e3b1-4609-9893-00a6c7a12e6e None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:34.032963 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00a8f6-e3b1-4609-9893-00a6c7a12e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:34.033233 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00a8f6-e3b1-4609-9893-00a6c7a12e6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:34.039787 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09901446-4156-43cd-8c30-ac8b8146b71a None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:34.040060 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09901446-4156-43cd-8c30-ac8b8146b71a None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:34.040336 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09901446-4156-43cd-8c30-ac8b8146b71a None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:34.041978 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 446/866] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:34.045671 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e00a8f6-e3b1-4609-9893-00a6c7a12e6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:34.047244 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e00a8f6-e3b1-4609-9893-00a6c7a12e6e None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:34.048023 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446ea6f-6903-4ae6-8a32-03eef9f0b20f None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:34.048309 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446ea6f-6903-4ae6-8a32-03eef9f0b20f None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:34.048587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446ea6f-6903-4ae6-8a32-03eef9f0b20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:34.064541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-3e00a8f6-e3b1-4609-9893-00a6c7a12e6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:34.064541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:34.064541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:34.064541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:34.064541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:34.064541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:34.064541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:34.064541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:34.064541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:34.064541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:34.064541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:34.064541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:34.064541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:34.064541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:34.064541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:34.065502 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:34.065502 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:34.065502 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:34.065502 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:34.065502 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:34.065502 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:34.065502 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:34.065502 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:34.065502 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:34.065502 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:34.065502 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:34.065502 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:34.065502 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:34.065502 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:34.065502 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:34.065502 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:34.065502 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:34.066385 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:34.066385 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:34.066385 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:34.066385 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:34.070440 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 421/867] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:34.072038 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-e446ea6f-6903-4ae6-8a32-03eef9f0b20f None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:34.072580 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00a8f6-e3b1-4609-9893-00a6c7a12e6e None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:34.073335 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-e446ea6f-6903-4ae6-8a32-03eef9f0b20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:34.077785 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:34.167647 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 447/868] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:34 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:03:34.186543 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00a8f6-e3b1-4609-9893-00a6c7a12e6e None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:34.193052 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446ea6f-6903-4ae6-8a32-03eef9f0b20f None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:34.228877 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be26678-6bb6-4893-b731-d3ed5e8a02ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:34.229506 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be26678-6bb6-4893-b731-d3ed5e8a02ec None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:34.229783 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be26678-6bb6-4893-b731-d3ed5e8a02ec None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:34.230050 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be26678-6bb6-4893-b731-d3ed5e8a02ec None admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:34.230742 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be26678-6bb6-4893-b731-d3ed5e8a02ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:34.231040 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be26678-6bb6-4893-b731-d3ed5e8a02ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:34.232641 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be26678-6bb6-4893-b731-d3ed5e8a02ec None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:34.250136 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 422/869] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:34.251360 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be26678-6bb6-4893-b731-d3ed5e8a02ec None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:34.265337 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:34.313584 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446ea6f-6903-4ae6-8a32-03eef9f0b20f None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:34.359179 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be26678-6bb6-4893-b731-d3ed5e8a02ec None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:34.366246 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8fd5d-a6e5-493a-8031-92f72363f81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:34.366889 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8fd5d-a6e5-493a-8031-92f72363f81b None admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:34.367195 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8fd5d-a6e5-493a-8031-92f72363f81b None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:34.367428 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8fd5d-a6e5-493a-8031-92f72363f81b None admin] PATH_INFO: `/v3/services` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:34.369070 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa8fd5d-a6e5-493a-8031-92f72363f81b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:34.370432 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa8fd5d-a6e5-493a-8031-92f72363f81b None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:34.387507 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:34.403857 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 448/870] 10.222.0.60 () {60 vars in 1141 bytes} [Sun Jul 31 01:03:34 2022] POST /identity/v3/services => generated 251 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:03:34.426905 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfe7d4-590f-4af2-9a25-7909791b1fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:34.427614 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfe7d4-590f-4af2-9a25-7909791b1fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:34.427890 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfe7d4-590f-4af2-9a25-7909791b1fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:34.428213 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfe7d4-590f-4af2-9a25-7909791b1fe7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:34.436801 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabfe7d4-590f-4af2-9a25-7909791b1fe7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:34.438329 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabfe7d4-590f-4af2-9a25-7909791b1fe7 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:34.451589 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-eabfe7d4-590f-4af2-9a25-7909791b1fe7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:34.451589 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:34.451589 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:34.451589 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:34.451589 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:34.451589 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:34.451589 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:34.451589 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:34.451589 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:34.451589 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:34.451589 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:34.451589 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:34.451589 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:03:34.451589 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:03:34.451589 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:03:34.452581 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:03:34.452581 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:34.452581 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:34.452581 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:34.452581 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:34.452581 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:34.452581 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:34.452581 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:34.452581 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:34.452581 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:34.452581 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:34.452581 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:34.452581 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:34.452581 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:34.452581 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:34.452581 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:34.452581 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:34.453476 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:03:34.453476 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:03:34.453476 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:03:34.453476 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:03:34.453476 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:03:34.453476 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:03:34.453476 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:34.453476 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:34.457970 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 423/871] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:03:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:34.459514 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8fd5d-a6e5-493a-8031-92f72363f81b None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:34.573912 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8fd5d-a6e5-493a-8031-92f72363f81b None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:34.617839 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23823853-62cb-45b2-a232-1a07d6452b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:34.618473 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23823853-62cb-45b2-a232-1a07d6452b78 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:34.618749 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23823853-62cb-45b2-a232-1a07d6452b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:34.619022 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23823853-62cb-45b2-a232-1a07d6452b78 None admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:34.619813 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23823853-62cb-45b2-a232-1a07d6452b78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:34.620119 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23823853-62cb-45b2-a232-1a07d6452b78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:34.621570 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23823853-62cb-45b2-a232-1a07d6452b78 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:34.635206 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 449/872] 10.222.0.60 () {56 vars in 1148 bytes} [Sun Jul 31 01:03:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:34.641074 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfe7d4-590f-4af2-9a25-7909791b1fe7 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:34.710732 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:34.749783 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfe7d4-590f-4af2-9a25-7909791b1fe7 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:34.784925 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf969e42-e603-45d7-a417-1db810ea7798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:34.785558 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf969e42-e603-45d7-a417-1db810ea7798 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:34.785877 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf969e42-e603-45d7-a417-1db810ea7798 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:34.786148 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf969e42-e603-45d7-a417-1db810ea7798 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:34.786957 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf969e42-e603-45d7-a417-1db810ea7798 None admin] RBAC: Adding query filter params (role.id=a5d1b78d4ec146848dfa667303603262, scope.project.id=b931b81a237949aa845891d4bb5aa1c0, user.id=02ed9040d575462db4b270a5b57063f2) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:34.787260 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf969e42-e603-45d7-a417-1db810ea7798 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:34.788729 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf969e42-e603-45d7-a417-1db810ea7798 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:34.795459 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 424/873] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:03:34 2022] GET /identity/v3/role_assignments?user.id=02ed9040d575462db4b270a5b57063f2&scope.project.id=b931b81a237949aa845891d4bb5aa1c0&role.id=a5d1b78d4ec146848dfa667303603262 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:34.995630 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710537bf-7304-4c40-a407-8c4a4352b56a None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:34.996009 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710537bf-7304-4c40-a407-8c4a4352b56a None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:34.996213 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710537bf-7304-4c40-a407-8c4a4352b56a None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:34.997747 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 450/874] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:35.003694 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01333d8-9387-48e8-ba0d-0fe813944737 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:35.003984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01333d8-9387-48e8-ba0d-0fe813944737 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:35.004262 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01333d8-9387-48e8-ba0d-0fe813944737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:35.023441 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-c01333d8-9387-48e8-ba0d-0fe813944737 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:35.024686 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-c01333d8-9387-48e8-ba0d-0fe813944737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:35.099910 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 425/875] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:35 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:03:35.122973 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710537bf-7304-4c40-a407-8c4a4352b56a None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:35.187975 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:35.235620 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710537bf-7304-4c40-a407-8c4a4352b56a None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:35.272026 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f7605-12f3-481b-a2fa-8e796b7cbb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:35.272975 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f7605-12f3-481b-a2fa-8e796b7cbb96 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:35.273427 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f7605-12f3-481b-a2fa-8e796b7cbb96 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:35.273870 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f7605-12f3-481b-a2fa-8e796b7cbb96 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:35.274663 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f7605-12f3-481b-a2fa-8e796b7cbb96 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:35.276250 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f7605-12f3-481b-a2fa-8e796b7cbb96 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:35.285860 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-389f7605-12f3-481b-a2fa-8e796b7cbb96 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 01:03:35.285860 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:35.285860 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:03:35.285860 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:03:35.285860 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:03:35.285860 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:03:35.285860 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:03:35.285860 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:35.285860 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 01:03:35.285860 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:35.285860 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:03:35.285860 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:35.285860 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:35.285860 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:35.285860 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:35.285860 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:35.285860 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:35.286851 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:35.286851 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:35.286851 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:35.286851 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:35.286851 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:35.286851 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:35.286851 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:03:35.286851 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:03:35.286851 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:03:35.286851 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:03:35.286851 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:35.286851 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:35.286851 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:35.286851 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:35.286851 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:35.286851 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:35.287697 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:35.287697 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:35.287697 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:35.287697 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:35.287697 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:35.287697 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:35.287697 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:35.287697 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:35.287697 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:35.287697 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:35.287697 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:03:35.287697 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:35.287697 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 01:03:35.287697 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:35.290098 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 451/876] 10.222.0.60 () {56 vars in 1126 bytes} [Sun Jul 31 01:03:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:35.296923 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01333d8-9387-48e8-ba0d-0fe813944737 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:35.359546 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:35.408891 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01333d8-9387-48e8-ba0d-0fe813944737 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:35.445394 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93938e3a-0bb8-46c3-af36-f408a2c18569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:35.446027 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93938e3a-0bb8-46c3-af36-f408a2c18569 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:35.446306 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93938e3a-0bb8-46c3-af36-f408a2c18569 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:35.446580 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93938e3a-0bb8-46c3-af36-f408a2c18569 None admin] PATH_INFO: `/v3/services` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:35.447265 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93938e3a-0bb8-46c3-af36-f408a2c18569 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:35.447597 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93938e3a-0bb8-46c3-af36-f408a2c18569 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:35.449033 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93938e3a-0bb8-46c3-af36-f408a2c18569 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:35.454202 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 426/877] 10.222.0.60 () {56 vars in 1122 bytes} [Sun Jul 31 01:03:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:35.460955 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f7605-12f3-481b-a2fa-8e796b7cbb96 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:35.564756 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f7605-12f3-481b-a2fa-8e796b7cbb96 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:35.592871 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:35.604750 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569c023-2f04-4ae9-9893-32f368b1ad40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:35.605835 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569c023-2f04-4ae9-9893-32f368b1ad40 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:35.606366 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569c023-2f04-4ae9-9893-32f368b1ad40 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:35.607083 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569c023-2f04-4ae9-9893-32f368b1ad40 None admin] PATH_INFO: `/v3/services` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:35.607796 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5569c023-2f04-4ae9-9893-32f368b1ad40 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:35.608104 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5569c023-2f04-4ae9-9893-32f368b1ad40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:35.609477 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5569c023-2f04-4ae9-9893-32f368b1ad40 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:35.614536 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 452/878] 10.222.0.60 () {56 vars in 1122 bytes} [Sun Jul 31 01:03:35 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:36.172030 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38372f89-e72b-4ac0-a05b-31620ccb9ae2 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:36.172462 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38372f89-e72b-4ac0-a05b-31620ccb9ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:36.172579 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38372f89-e72b-4ac0-a05b-31620ccb9ae2 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:36.174241 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 427/879] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:36.179862 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323be5a1-de5d-4bb3-929c-3627760ec698 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:36.180162 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323be5a1-de5d-4bb3-929c-3627760ec698 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:36.180416 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323be5a1-de5d-4bb3-929c-3627760ec698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:36.199246 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-323be5a1-de5d-4bb3-929c-3627760ec698 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:36.200478 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-323be5a1-de5d-4bb3-929c-3627760ec698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:36.269659 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 453/880] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:36 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:03:36.291752 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38372f89-e72b-4ac0-a05b-31620ccb9ae2 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:36.408563 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38372f89-e72b-4ac0-a05b-31620ccb9ae2 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:36.433818 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:36.444879 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533e6e4-5c6f-43bb-8671-54ddb75c3f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:36.445790 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533e6e4-5c6f-43bb-8671-54ddb75c3f86 None admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:36.446247 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533e6e4-5c6f-43bb-8671-54ddb75c3f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:36.446584 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533e6e4-5c6f-43bb-8671-54ddb75c3f86 None admin] PATH_INFO: `/v3/services` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:36.447512 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3533e6e4-5c6f-43bb-8671-54ddb75c3f86 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:36.448910 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3533e6e4-5c6f-43bb-8671-54ddb75c3f86 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:36.473784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 428/881] 10.222.0.60 () {60 vars in 1141 bytes} [Sun Jul 31 01:03:36 2022] POST /identity/v3/services => generated 269 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:03:36.558592 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f716159-12bd-4e8f-bf44-6e8a14b13a62 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:36.558912 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f716159-12bd-4e8f-bf44-6e8a14b13a62 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:36.559132 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f716159-12bd-4e8f-bf44-6e8a14b13a62 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:36.561039 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 454/882] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:36.566783 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990acecc-ee45-48ee-b95f-25f7cb8598bb None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:36.567082 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990acecc-ee45-48ee-b95f-25f7cb8598bb None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:36.567345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990acecc-ee45-48ee-b95f-25f7cb8598bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:36.588174 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-990acecc-ee45-48ee-b95f-25f7cb8598bb None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:36.589413 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-990acecc-ee45-48ee-b95f-25f7cb8598bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:36.670204 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 429/883] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:36 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:03:36.692796 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f716159-12bd-4e8f-bf44-6e8a14b13a62 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:36.799888 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f716159-12bd-4e8f-bf44-6e8a14b13a62 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:36.822288 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:36.847223 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017870f-04ff-41b9-a1b1-5a9ce47c2d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:36.848300 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017870f-04ff-41b9-a1b1-5a9ce47c2d5e None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:36.848585 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017870f-04ff-41b9-a1b1-5a9ce47c2d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:36.848860 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017870f-04ff-41b9-a1b1-5a9ce47c2d5e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:36.849508 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0017870f-04ff-41b9-a1b1-5a9ce47c2d5e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:36.850905 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0017870f-04ff-41b9-a1b1-5a9ce47c2d5e None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:36.862262 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-0017870f-04ff-41b9-a1b1-5a9ce47c2d5e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 31 01:03:36.862262 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:36.862262 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:03:36.862262 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:03:36.862262 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:03:36.862262 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:03:36.862262 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:03:36.862262 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:36.862262 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 31 01:03:36.862262 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:36.862262 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:03:36.862262 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:36.862262 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:36.862262 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:36.862262 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:36.862262 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:36.862262 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:36.863308 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:36.863308 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:36.863308 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:36.863308 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:36.863308 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:36.863308 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:36.863308 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:03:36.863308 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:03:36.863308 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:03:36.863308 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:03:36.863308 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:36.863308 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:36.863308 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:36.863308 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:36.863308 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:36.863308 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:36.864169 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:36.864169 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:36.864169 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:36.864169 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:36.864169 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:36.864169 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:36.864169 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:36.864169 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:36.864169 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:36.864169 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:36.864169 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:03:36.864169 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:36.864169 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 31 01:03:36.864169 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:36.864169 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 455/884] 10.222.0.60 () {56 vars in 1114 bytes} [Sun Jul 31 01:03:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:36.870048 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990acecc-ee45-48ee-b95f-25f7cb8598bb None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:36.987134 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990acecc-ee45-48ee-b95f-25f7cb8598bb None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:36.998403 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:37.013424 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42340d-229c-47fa-a758-31b33c6be6f2 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:37.014304 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42340d-229c-47fa-a758-31b33c6be6f2 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:37.014585 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42340d-229c-47fa-a758-31b33c6be6f2 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:37.017131 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 456/885] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:03:37.023857 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34bd5da-e34a-42f2-ba5f-0cdf4d9d6362 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:37.024235 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34bd5da-e34a-42f2-ba5f-0cdf4d9d6362 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:37.024514 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34bd5da-e34a-42f2-ba5f-0cdf4d9d6362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:37.024698 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074561f-7dfb-4ace-9df5-151bc67c79c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:37.025255 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074561f-7dfb-4ace-9df5-151bc67c79c0 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:37.025532 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074561f-7dfb-4ace-9df5-151bc67c79c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:37.025802 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074561f-7dfb-4ace-9df5-151bc67c79c0 None admin] PATH_INFO: `/v3/services` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:37.026487 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074561f-7dfb-4ace-9df5-151bc67c79c0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:37.026785 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074561f-7dfb-4ace-9df5-151bc67c79c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:37.028183 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074561f-7dfb-4ace-9df5-151bc67c79c0 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:37.038074 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 430/886] 10.222.0.60 () {56 vars in 1114 bytes} [Sun Jul 31 01:03:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:37.039370 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074561f-7dfb-4ace-9df5-151bc67c79c0 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:37.044622 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-b34bd5da-e34a-42f2-ba5f-0cdf4d9d6362 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:37.045823 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-b34bd5da-e34a-42f2-ba5f-0cdf4d9d6362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:37.116698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 457/887] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:37 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:03:37.139401 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074561f-7dfb-4ace-9df5-151bc67c79c0 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:37.144362 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34bd5da-e34a-42f2-ba5f-0cdf4d9d6362 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:37.184927 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c1307-e73f-4d95-a1f2-f5f01e033d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:37.185682 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c1307-e73f-4d95-a1f2-f5f01e033d58 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:37.185958 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c1307-e73f-4d95-a1f2-f5f01e033d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:37.186226 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c1307-e73f-4d95-a1f2-f5f01e033d58 None admin] PATH_INFO: `/v3/services` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:37.186914 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c1307-e73f-4d95-a1f2-f5f01e033d58 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:37.187214 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c1307-e73f-4d95-a1f2-f5f01e033d58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:37.188618 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c1307-e73f-4d95-a1f2-f5f01e033d58 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:37.199683 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 431/888] 10.222.0.60 () {56 vars in 1114 bytes} [Sun Jul 31 01:03:37 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:37.200784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c1307-e73f-4d95-a1f2-f5f01e033d58 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:37.242276 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:37.278910 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34bd5da-e34a-42f2-ba5f-0cdf4d9d6362 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:37.292229 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:37.318165 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabf0d9-bd7e-49c2-af6d-69153bf545f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:37.318591 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c1307-e73f-4d95-a1f2-f5f01e033d58 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:37.319035 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabf0d9-bd7e-49c2-af6d-69153bf545f3 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:37.319564 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabf0d9-bd7e-49c2-af6d-69153bf545f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:37.320028 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabf0d9-bd7e-49c2-af6d-69153bf545f3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:37.331198 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adabf0d9-bd7e-49c2-af6d-69153bf545f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:03:37.336406 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-adabf0d9-bd7e-49c2-af6d-69153bf545f3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 31 01:03:37.336406 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:37.336406 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:37.336406 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:37.336406 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:37.336406 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:37.336406 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:37.336406 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:37.336406 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:37.336406 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:37.336406 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:37.336406 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:37.336406 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:03:37.336406 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:03:37.336406 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:03:37.336406 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:03:37.337330 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:03:37.337330 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:03:37.337330 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:03:37.337330 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:03:37.337330 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:37.337330 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:37.337330 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:37.337330 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:37.337330 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:37.337330 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:37.337330 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:37.337330 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:37.337330 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:37.337330 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:37.337330 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:37.337330 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:37.338189 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:37.338189 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:37.338189 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:37.338189 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:37.338189 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:03:37.338189 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:03:37.338189 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:03:37.338189 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:03:37.338189 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:03:37.338189 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:03:37.338189 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 31 01:03:37.338189 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:37.340891 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 458/889] 10.222.0.60 () {56 vars in 1120 bytes} [Sun Jul 31 01:03:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:37.346419 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabf0d9-bd7e-49c2-af6d-69153bf545f3 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:37.369764 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e8731-48f4-405b-82bc-8b47e6d0f62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:37.369764 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e8731-48f4-405b-82bc-8b47e6d0f62b None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:37.370114 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e8731-48f4-405b-82bc-8b47e6d0f62b None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:37.370556 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e8731-48f4-405b-82bc-8b47e6d0f62b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:37.371586 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e8731-48f4-405b-82bc-8b47e6d0f62b None admin] RBAC: Adding query filter params (interface=public, service_id=9023e5c0d32f4901ad1d0d2cc5a86098, region_id=RegionOne) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:37.372041 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e8731-48f4-405b-82bc-8b47e6d0f62b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:37.373754 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e8731-48f4-405b-82bc-8b47e6d0f62b None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:37.383831 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 432/890] 10.222.0.60 () {56 vars in 1251 bytes} [Sun Jul 31 01:03:37 2022] GET /identity/v3/endpoints?service_id=9023e5c0d32f4901ad1d0d2cc5a86098&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:37.386104 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e8731-48f4-405b-82bc-8b47e6d0f62b None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:37.467201 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabf0d9-bd7e-49c2-af6d-69153bf545f3 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:37.489755 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e8731-48f4-405b-82bc-8b47e6d0f62b None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:37.492020 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:37.506499 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5b93a-c821-496c-952a-92453552d4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:37.507186 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5b93a-c821-496c-952a-92453552d4a1 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:37.507464 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5b93a-c821-496c-952a-92453552d4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:37.507760 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5b93a-c821-496c-952a-92453552d4a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:37.508478 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c5b93a-c821-496c-952a-92453552d4a1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:37.509143 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c5b93a-c821-496c-952a-92453552d4a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:37.510255 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c5b93a-c821-496c-952a-92453552d4a1 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:37.523948 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 459/891] 10.222.0.60 () {56 vars in 1115 bytes} [Sun Jul 31 01:03:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:03:37.525219 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5b93a-c821-496c-952a-92453552d4a1 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:37.530831 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce45cd8-0f27-4204-abdb-5d2fc6784a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:37.531793 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce45cd8-0f27-4204-abdb-5d2fc6784a7d None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:37.532280 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce45cd8-0f27-4204-abdb-5d2fc6784a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:37.532774 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce45cd8-0f27-4204-abdb-5d2fc6784a7d None admin] PATH_INFO: `/v3/services` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:37.533699 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce45cd8-0f27-4204-abdb-5d2fc6784a7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:37.535344 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce45cd8-0f27-4204-abdb-5d2fc6784a7d None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:37.547672 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 433/892] 10.222.0.60 () {56 vars in 1087 bytes} [Sun Jul 31 01:03:37 2022] GET /identity/v3/services => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:03:37.560724 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:37.641875 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5b93a-c821-496c-952a-92453552d4a1 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:37.680030 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11e7d8-cadb-48db-ae0d-e38a064dfc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:37.680702 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11e7d8-cadb-48db-ae0d-e38a064dfc8f None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:37.680971 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11e7d8-cadb-48db-ae0d-e38a064dfc8f None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:37.681240 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11e7d8-cadb-48db-ae0d-e38a064dfc8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:37.694509 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb11e7d8-cadb-48db-ae0d-e38a064dfc8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:37.696440 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb11e7d8-cadb-48db-ae0d-e38a064dfc8f None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:37.713177 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-fb11e7d8-cadb-48db-ae0d-e38a064dfc8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:37.713177 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:37.713177 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:37.713177 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:37.713177 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:37.713177 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:37.713177 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:37.713177 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:37.713177 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:37.713177 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:37.713177 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:37.713177 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:37.713177 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:37.713177 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:37.713177 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:37.714122 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:37.714122 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:37.714122 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:37.714122 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:37.714122 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:37.714122 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:37.714122 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:37.714122 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:37.714122 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:37.714122 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:37.714122 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:37.714122 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:37.714122 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:37.714122 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:37.714122 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:37.714122 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:37.714122 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:37.715010 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:37.715010 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:37.715010 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:37.715010 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:37.719153 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 460/893] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:37.721282 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce45cd8-0f27-4204-abdb-5d2fc6784a7d None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:37.742068 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8775fb7-2778-4f4b-8aab-0bacd3c66485 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:37.742343 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8775fb7-2778-4f4b-8aab-0bacd3c66485 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:37.742617 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8775fb7-2778-4f4b-8aab-0bacd3c66485 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:37.744242 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 461/894] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:03:37.749780 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688d5d9-fb9d-4000-82a3-f321cdeb6bdb None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:37.750132 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688d5d9-fb9d-4000-82a3-f321cdeb6bdb None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:37.750512 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688d5d9-fb9d-4000-82a3-f321cdeb6bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:37.770903 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-a688d5d9-fb9d-4000-82a3-f321cdeb6bdb None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:37.772003 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-a688d5d9-fb9d-4000-82a3-f321cdeb6bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:37.831423 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce45cd8-0f27-4204-abdb-5d2fc6784a7d None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:37.850333 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 462/895] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:37 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:03:37.870259 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70380abe-92fc-45eb-ba05-a33e0c88e5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:37.870448 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688d5d9-fb9d-4000-82a3-f321cdeb6bdb None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:37.871312 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70380abe-92fc-45eb-ba05-a33e0c88e5b6 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:37.871791 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70380abe-92fc-45eb-ba05-a33e0c88e5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:37.872207 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70380abe-92fc-45eb-ba05-a33e0c88e5b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:37.873202 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70380abe-92fc-45eb-ba05-a33e0c88e5b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:37.873649 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70380abe-92fc-45eb-ba05-a33e0c88e5b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:37.875266 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70380abe-92fc-45eb-ba05-a33e0c88e5b6 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:37.886901 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:37.890674 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 434/896] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:37.900823 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70380abe-92fc-45eb-ba05-a33e0c88e5b6 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:37.931385 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:37.976121 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688d5d9-fb9d-4000-82a3-f321cdeb6bdb None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:38.010992 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd585eba-80b4-4453-a450-90f8f15692e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:38.011810 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd585eba-80b4-4453-a450-90f8f15692e2 None admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:38.012181 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd585eba-80b4-4453-a450-90f8f15692e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:38.012538 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd585eba-80b4-4453-a450-90f8f15692e2 None admin] PATH_INFO: `/v3/services` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:38.013411 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd585eba-80b4-4453-a450-90f8f15692e2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:38.014872 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd585eba-80b4-4453-a450-90f8f15692e2 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:38.016365 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70380abe-92fc-45eb-ba05-a33e0c88e5b6 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:38.040047 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 463/897] 10.222.0.60 () {60 vars in 1141 bytes} [Sun Jul 31 01:03:37 2022] POST /identity/v3/services => generated 241 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:03:38.065592 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5bf81c-1491-49e9-99ec-bee11a5f7811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:38.066532 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5bf81c-1491-49e9-99ec-bee11a5f7811 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:38.066996 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5bf81c-1491-49e9-99ec-bee11a5f7811 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:38.067440 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5bf81c-1491-49e9-99ec-bee11a5f7811 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:38.077210 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5bf81c-1491-49e9-99ec-bee11a5f7811 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:38.078935 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5bf81c-1491-49e9-99ec-bee11a5f7811 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:38.092335 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-bd5bf81c-1491-49e9-99ec-bee11a5f7811 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 31 01:03:38.092335 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:38.092335 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:38.092335 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:38.092335 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:38.092335 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:38.092335 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:38.092335 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:38.092335 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:38.092335 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:38.092335 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:38.092335 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:38.092335 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:03:38.092335 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:03:38.092335 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:03:38.092335 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:03:38.093584 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:38.093584 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:38.093584 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:03:38.093584 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:38.093584 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:03:38.093584 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:38.093584 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:38.093584 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:38.093584 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:38.093584 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:38.093584 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:38.093584 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:38.093584 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:38.093584 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:38.093584 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:38.093584 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:38.093584 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:38.093584 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:38.094746 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:38.094746 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:38.094746 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:03:38.094746 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:03:38.094746 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:03:38.094746 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:03:38.094746 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:03:38.094746 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:03:38.094746 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 31 01:03:38.094746 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:38.097252 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 435/898] 10.222.0.60 () {56 vars in 1117 bytes} [Sun Jul 31 01:03:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:03:38.103372 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd585eba-80b4-4453-a450-90f8f15692e2 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:38.192784 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:38.221395 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd585eba-80b4-4453-a450-90f8f15692e2 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:38.260818 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbfdbd8-f271-46cb-a591-319b711ff854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:38.261789 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbfdbd8-f271-46cb-a591-319b711ff854 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:38.262071 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbfdbd8-f271-46cb-a591-319b711ff854 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:38.262342 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbfdbd8-f271-46cb-a591-319b711ff854 None admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:38.263354 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbfdbd8-f271-46cb-a591-319b711ff854 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:38.263681 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbfdbd8-f271-46cb-a591-319b711ff854 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:38.265203 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbfdbd8-f271-46cb-a591-319b711ff854 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:38.285706 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 464/899] 10.222.0.60 () {56 vars in 1149 bytes} [Sun Jul 31 01:03:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:38.291940 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5bf81c-1491-49e9-99ec-bee11a5f7811 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:38.379873 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:38.400902 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5bf81c-1491-49e9-99ec-bee11a5f7811 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:38.436508 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11670189-e2a1-4539-8a69-6be131128a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:38.437140 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11670189-e2a1-4539-8a69-6be131128a33 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:38.437421 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11670189-e2a1-4539-8a69-6be131128a33 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:38.437695 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11670189-e2a1-4539-8a69-6be131128a33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:38.509662 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11670189-e2a1-4539-8a69-6be131128a33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:38.511140 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11670189-e2a1-4539-8a69-6be131128a33 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:38.558899 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65833331-079a-44cb-a426-2e6fbf5beb23 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:38.559079 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65833331-079a-44cb-a426-2e6fbf5beb23 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:38.559353 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65833331-079a-44cb-a426-2e6fbf5beb23 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:38.561835 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 465/900] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:38.567159 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bbab2-4bf9-49bd-b1c8-20e5b7fedaab None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:38.567818 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bbab2-4bf9-49bd-b1c8-20e5b7fedaab None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:38.568292 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bbab2-4bf9-49bd-b1c8-20e5b7fedaab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:38.591323 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-700bbab2-4bf9-49bd-b1c8-20e5b7fedaab None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:38.592643 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-700bbab2-4bf9-49bd-b1c8-20e5b7fedaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:38.608320 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:38.639299 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 436/901] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:03:38 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:03:38.640541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11670189-e2a1-4539-8a69-6be131128a33 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:38.693003 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 466/902] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:03:38.715779 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700bbab2-4bf9-49bd-b1c8-20e5b7fedaab None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:38.779506 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11670189-e2a1-4539-8a69-6be131128a33 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:38.786707 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:38.825418 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba067aa9-8b0a-4266-a43f-3b344ec8e119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:38.826579 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba067aa9-8b0a-4266-a43f-3b344ec8e119 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:38.827147 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba067aa9-8b0a-4266-a43f-3b344ec8e119 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:38.827643 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba067aa9-8b0a-4266-a43f-3b344ec8e119 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:38.830128 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700bbab2-4bf9-49bd-b1c8-20e5b7fedaab None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:38.839371 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba067aa9-8b0a-4266-a43f-3b344ec8e119 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:38.841254 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba067aa9-8b0a-4266-a43f-3b344ec8e119 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:38.858095 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-ba067aa9-8b0a-4266-a43f-3b344ec8e119 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:38.858095 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:38.858095 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:38.858095 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:38.858095 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:38.858095 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:38.858095 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:38.858095 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:38.858095 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:38.858095 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:38.858095 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:38.858095 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:38.858095 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:38.858095 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:38.858095 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:38.859063 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:38.859063 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:38.859063 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:38.859063 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:38.859063 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:38.859063 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:38.859063 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:38.859063 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:38.859063 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:38.859063 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:38.859063 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:38.859063 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:38.859063 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:38.859063 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:38.859063 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:38.859063 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:38.859063 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:38.859970 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:38.859970 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:38.859970 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:38.859970 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:38.868146 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06cd019-5ff6-47ad-954e-159f3c373ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:38.868477 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 437/903] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:03:38.868658 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06cd019-5ff6-47ad-954e-159f3c373ceb None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:38.868937 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06cd019-5ff6-47ad-954e-159f3c373ceb None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:38.869452 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06cd019-5ff6-47ad-954e-159f3c373ceb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:38.870175 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba067aa9-8b0a-4266-a43f-3b344ec8e119 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:38.870287 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06cd019-5ff6-47ad-954e-159f3c373ceb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:38.871917 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06cd019-5ff6-47ad-954e-159f3c373ceb None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:38.882269 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-c06cd019-5ff6-47ad-954e-159f3c373ceb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 31 01:03:38.882269 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:38.882269 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:03:38.882269 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:03:38.882269 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:03:38.882269 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:03:38.882269 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:03:38.882269 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:38.882269 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 31 01:03:38.882269 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:38.882269 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:03:38.882269 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:38.882269 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:38.882269 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:38.882269 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:38.882269 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:38.883275 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:38.883275 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:38.883275 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:38.883275 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:38.883275 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:38.883275 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:38.883275 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:38.883275 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:03:38.883275 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:03:38.883275 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:03:38.883275 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:03:38.883275 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:38.883275 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:38.883275 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:38.883275 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:38.883275 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:38.884420 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:38.884420 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:38.884420 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:38.884420 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:38.884420 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:38.884420 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:38.884420 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:38.884420 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:38.884420 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:38.884420 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:38.884420 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:38.884420 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:03:38.884420 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:38.884420 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 31 01:03:38.884420 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:38.884420 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 467/904] 10.222.0.60 () {56 vars in 1132 bytes} [Sun Jul 31 01:03:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:03:38.890040 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06cd019-5ff6-47ad-954e-159f3c373ceb None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:38.912462 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:38.987025 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba067aa9-8b0a-4266-a43f-3b344ec8e119 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:39.012969 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06cd019-5ff6-47ad-954e-159f3c373ceb None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:39.026088 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea77df-8108-49c8-bece-2ba44ea742e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:39.027239 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea77df-8108-49c8-bece-2ba44ea742e8 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:39.027795 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea77df-8108-49c8-bece-2ba44ea742e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:39.028373 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea77df-8108-49c8-bece-2ba44ea742e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:39.029694 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea77df-8108-49c8-bece-2ba44ea742e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:39.030359 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea77df-8108-49c8-bece-2ba44ea742e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:39.032245 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea77df-8108-49c8-bece-2ba44ea742e8 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:39.041949 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:39.053173 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9b088-c72b-4b7f-9554-9a13d7c03bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:39.053173 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9b088-c72b-4b7f-9554-9a13d7c03bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:39.053173 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9b088-c72b-4b7f-9554-9a13d7c03bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:39.053173 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9b088-c72b-4b7f-9554-9a13d7c03bc8 None admin] PATH_INFO: `/v3/services` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:39.053585 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c9b088-c72b-4b7f-9554-9a13d7c03bc8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:39.053585 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c9b088-c72b-4b7f-9554-9a13d7c03bc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:39.054176 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 438/905] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:39.054998 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c9b088-c72b-4b7f-9554-9a13d7c03bc8 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:39.055512 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea77df-8108-49c8-bece-2ba44ea742e8 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:39.060941 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 468/906] 10.222.0.60 () {56 vars in 1126 bytes} [Sun Jul 31 01:03:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:03:39.066313 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9b088-c72b-4b7f-9554-9a13d7c03bc8 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:39.166539 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:39.175984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea77df-8108-49c8-bece-2ba44ea742e8 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:39.199277 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9b088-c72b-4b7f-9554-9a13d7c03bc8 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:39.223672 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a5f30-bf3d-4550-9d30-79aeebfdbf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:39.224502 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a5f30-bf3d-4550-9d30-79aeebfdbf62 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:39.224876 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a5f30-bf3d-4550-9d30-79aeebfdbf62 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:39.225422 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a5f30-bf3d-4550-9d30-79aeebfdbf62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:39.235207 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a5f30-bf3d-4550-9d30-79aeebfdbf62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:39.237245 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a5f30-bf3d-4550-9d30-79aeebfdbf62 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:39.242799 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344f363-30b3-47b1-b5b4-a3d13cb8272b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:39.243755 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344f363-30b3-47b1-b5b4-a3d13cb8272b None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:39.244174 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344f363-30b3-47b1-b5b4-a3d13cb8272b None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:39.244586 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344f363-30b3-47b1-b5b4-a3d13cb8272b None admin] PATH_INFO: `/v3/services` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:39.245506 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344f363-30b3-47b1-b5b4-a3d13cb8272b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:39.245984 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344f363-30b3-47b1-b5b4-a3d13cb8272b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:39.247769 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344f363-30b3-47b1-b5b4-a3d13cb8272b None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:39.252844 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-c44a5f30-bf3d-4550-9d30-79aeebfdbf62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:39.252844 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:39.252844 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:39.252844 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:39.252844 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:39.252844 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:39.252844 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:39.252844 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:39.252844 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:39.252844 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:39.252844 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:39.252844 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:39.252844 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:03:39.252844 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:03:39.252844 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:03:39.253775 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:03:39.253775 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:39.253775 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:39.253775 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:39.253775 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:39.253775 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:39.253775 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:39.253775 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:39.253775 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:39.253775 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:39.253775 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:39.253775 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:39.253775 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:39.253775 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:39.253775 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:39.253775 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:39.253775 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:39.254705 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:03:39.254705 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:03:39.254705 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:03:39.254705 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:03:39.254705 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:03:39.254705 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:03:39.254705 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:39.254705 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:39.261434 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 439/908] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:03:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:39.261434 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a5f30-bf3d-4550-9d30-79aeebfdbf62 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:39.261793 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 469/908] 10.222.0.60 () {56 vars in 1126 bytes} [Sun Jul 31 01:03:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:39.263127 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344f363-30b3-47b1-b5b4-a3d13cb8272b None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:39.336736 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:39.384494 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a5f30-bf3d-4550-9d30-79aeebfdbf62 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:39.397259 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344f363-30b3-47b1-b5b4-a3d13cb8272b None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:39.422404 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9ea01-1cb7-4143-97ee-145c6874487f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:39.423588 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9ea01-1cb7-4143-97ee-145c6874487f None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:39.424083 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9ea01-1cb7-4143-97ee-145c6874487f None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:39.424549 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9ea01-1cb7-4143-97ee-145c6874487f None admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:39.425524 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9ea01-1cb7-4143-97ee-145c6874487f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:39.426035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9ea01-1cb7-4143-97ee-145c6874487f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:39.427905 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9ea01-1cb7-4143-97ee-145c6874487f None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:39.447545 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 440/909] 10.222.0.60 () {56 vars in 1148 bytes} [Sun Jul 31 01:03:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:39.448930 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9ea01-1cb7-4143-97ee-145c6874487f None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:39.449106 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f9665-f8c1-4e32-92e1-1e06d614977f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:39.450108 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f9665-f8c1-4e32-92e1-1e06d614977f None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:39.450597 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f9665-f8c1-4e32-92e1-1e06d614977f None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:39.451059 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f9665-f8c1-4e32-92e1-1e06d614977f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:39.452370 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f9665-f8c1-4e32-92e1-1e06d614977f None admin] RBAC: Adding query filter params (interface=public, service_id=d0f46286d5514151ad3d6041dcdbf8f6, region_id=RegionOne) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:39.452880 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f9665-f8c1-4e32-92e1-1e06d614977f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:39.456927 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f9665-f8c1-4e32-92e1-1e06d614977f None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:39.468477 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:39.477809 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 470/910] 10.222.0.60 () {56 vars in 1251 bytes} [Sun Jul 31 01:03:39 2022] GET /identity/v3/endpoints?service_id=d0f46286d5514151ad3d6041dcdbf8f6&interface=public®ion_id=RegionOne => generated 194 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:39.478940 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f9665-f8c1-4e32-92e1-1e06d614977f None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:39.588802 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9ea01-1cb7-4143-97ee-145c6874487f None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:39.590758 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f9665-f8c1-4e32-92e1-1e06d614977f None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:39.611405 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:39.627941 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d920a-1bf7-4651-9d63-a5d1288ac151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:39.628899 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d920a-1bf7-4651-9d63-a5d1288ac151 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:39.629226 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d920a-1bf7-4651-9d63-a5d1288ac151 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:39.629582 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d920a-1bf7-4651-9d63-a5d1288ac151 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:39.630640 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d920a-1bf7-4651-9d63-a5d1288ac151 None admin] RBAC: Adding query filter params (role.id=9687bf70551b48aaaef3e0187bb47d06, scope.project.id=b931b81a237949aa845891d4bb5aa1c0, user.id=02ed9040d575462db4b270a5b57063f2) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:39.631088 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d920a-1bf7-4651-9d63-a5d1288ac151 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:39.633077 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d920a-1bf7-4651-9d63-a5d1288ac151 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:39.636943 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e85d46-2d77-4dc3-b276-06dfdea376b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:39.637600 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e85d46-2d77-4dc3-b276-06dfdea376b5 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:39.637966 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e85d46-2d77-4dc3-b276-06dfdea376b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:39.638166 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e85d46-2d77-4dc3-b276-06dfdea376b5 None admin] PATH_INFO: `/v3/services` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:39.638805 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e85d46-2d77-4dc3-b276-06dfdea376b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:39.645542 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 441/911] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:03:39 2022] GET /identity/v3/role_assignments?user.id=02ed9040d575462db4b270a5b57063f2&scope.project.id=b931b81a237949aa845891d4bb5aa1c0&role.id=9687bf70551b48aaaef3e0187bb47d06 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:39.645784 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e85d46-2d77-4dc3-b276-06dfdea376b5 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:39.645917 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b4aec-8be8-43cd-804c-5e20dc087611 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:39.645917 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b4aec-8be8-43cd-804c-5e20dc087611 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:39.645917 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b4aec-8be8-43cd-804c-5e20dc087611 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:39.647143 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 442/912] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:39.655525 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ba33a-d433-4bf8-a412-3bb6927cfbe8 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:39.655525 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ba33a-d433-4bf8-a412-3bb6927cfbe8 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:39.655525 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ba33a-d433-4bf8-a412-3bb6927cfbe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:39.664641 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 471/913] 10.222.0.60 () {56 vars in 1087 bytes} [Sun Jul 31 01:03:39 2022] GET /identity/v3/services => generated 1497 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:03:39.678344 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-025ba33a-d433-4bf8-a412-3bb6927cfbe8 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:39.681674 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-025ba33a-d433-4bf8-a412-3bb6927cfbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:39.767564 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 443/914] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:03:39.791123 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e85d46-2d77-4dc3-b276-06dfdea376b5 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:39.911145 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e85d46-2d77-4dc3-b276-06dfdea376b5 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:39.948460 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f002b-fe13-4c94-ba3d-3465f9c94adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:39.949033 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f002b-fe13-4c94-ba3d-3465f9c94adc None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:39.949306 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f002b-fe13-4c94-ba3d-3465f9c94adc None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:39.949575 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f002b-fe13-4c94-ba3d-3465f9c94adc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:39.950202 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5f002b-fe13-4c94-ba3d-3465f9c94adc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:39.951723 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5f002b-fe13-4c94-ba3d-3465f9c94adc None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:39.961160 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-8b5f002b-fe13-4c94-ba3d-3465f9c94adc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 31 01:03:39.961160 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:39.961160 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:03:39.961160 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:03:39.961160 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:03:39.961160 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:03:39.961160 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:03:39.961160 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:39.961160 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 31 01:03:39.961160 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:39.961160 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:03:39.961160 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:39.961160 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:39.961160 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:39.961160 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:39.961160 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:39.961160 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:39.962194 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:39.962194 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:39.962194 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:39.962194 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:39.962194 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:39.962194 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:39.962194 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:03:39.962194 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:03:39.962194 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:03:39.962194 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:03:39.962194 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:39.962194 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:39.962194 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:39.962194 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:39.962194 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:39.962194 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:39.963044 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:39.963044 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:39.963044 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:39.963044 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:39.963044 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:39.963044 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:39.963044 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:39.963044 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:39.963044 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:39.963044 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:39.963044 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:03:39.963044 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:39.963044 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 31 01:03:39.963044 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:39.963044 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 472/915] 10.222.0.60 () {56 vars in 1114 bytes} [Sun Jul 31 01:03:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:39.968994 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ba33a-d433-4bf8-a412-3bb6927cfbe8 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:39.980210 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:40.075269 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ba33a-d433-4bf8-a412-3bb6927cfbe8 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:40.110313 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390899c-94eb-4342-861f-c563ba35b2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:40.110947 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390899c-94eb-4342-861f-c563ba35b2a1 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:40.111221 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390899c-94eb-4342-861f-c563ba35b2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:40.111507 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390899c-94eb-4342-861f-c563ba35b2a1 None admin] PATH_INFO: `/v3/services` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:40.112201 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e390899c-94eb-4342-861f-c563ba35b2a1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:40.112501 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e390899c-94eb-4342-861f-c563ba35b2a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:40.114025 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e390899c-94eb-4342-861f-c563ba35b2a1 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:40.119516 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 444/916] 10.222.0.60 () {56 vars in 1114 bytes} [Sun Jul 31 01:03:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:40.125223 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f002b-fe13-4c94-ba3d-3465f9c94adc None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:40.177597 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:40.240378 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f002b-fe13-4c94-ba3d-3465f9c94adc None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:40.246931 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f161a-b3bd-4b1a-9089-ddc1f0c193bc None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:40.247204 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f161a-b3bd-4b1a-9089-ddc1f0c193bc None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:40.247566 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f161a-b3bd-4b1a-9089-ddc1f0c193bc None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:40.249174 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 445/917] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:03:40.255998 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d30d8b-fded-48df-b97f-bf2ce8b3fce0 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:40.256421 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d30d8b-fded-48df-b97f-bf2ce8b3fce0 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:40.256883 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d30d8b-fded-48df-b97f-bf2ce8b3fce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:40.281958 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-96d30d8b-fded-48df-b97f-bf2ce8b3fce0 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:40.284163 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-96d30d8b-fded-48df-b97f-bf2ce8b3fce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:40.288394 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaffb5f-8c42-4095-8623-bac2f00947bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:40.289135 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaffb5f-8c42-4095-8623-bac2f00947bc None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:40.289505 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaffb5f-8c42-4095-8623-bac2f00947bc None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:40.289878 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaffb5f-8c42-4095-8623-bac2f00947bc None admin] PATH_INFO: `/v3/services` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:40.290697 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaffb5f-8c42-4095-8623-bac2f00947bc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:40.291125 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaffb5f-8c42-4095-8623-bac2f00947bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:40.292666 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaffb5f-8c42-4095-8623-bac2f00947bc None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:40.303531 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 473/918] 10.222.0.60 () {56 vars in 1114 bytes} [Sun Jul 31 01:03:40 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:40.305971 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaffb5f-8c42-4095-8623-bac2f00947bc None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:40.371522 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 446/919] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:03:40.391435 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d30d8b-fded-48df-b97f-bf2ce8b3fce0 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:40.393691 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:40.429434 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaffb5f-8c42-4095-8623-bac2f00947bc None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:40.441680 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:40.468281 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7a527-7072-4f34-9b94-76bde399f347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:40.469265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7a527-7072-4f34-9b94-76bde399f347 None admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:40.469765 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7a527-7072-4f34-9b94-76bde399f347 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:40.470361 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7a527-7072-4f34-9b94-76bde399f347 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:40.471267 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f7a527-7072-4f34-9b94-76bde399f347 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:40.472992 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f7a527-7072-4f34-9b94-76bde399f347 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:40.497908 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d30d8b-fded-48df-b97f-bf2ce8b3fce0 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:40.508532 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 474/920] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:03:40 2022] POST /identity/v3/endpoints => generated 346 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:03:40.553540 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0b5de-6a56-4688-8a6e-47cbd02c8e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:40.554209 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0b5de-6a56-4688-8a6e-47cbd02c8e7b None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:40.554490 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0b5de-6a56-4688-8a6e-47cbd02c8e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:40.554762 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0b5de-6a56-4688-8a6e-47cbd02c8e7b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:40.555401 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb0b5de-6a56-4688-8a6e-47cbd02c8e7b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:40.556817 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb0b5de-6a56-4688-8a6e-47cbd02c8e7b None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:40.567627 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-8fb0b5de-6a56-4688-8a6e-47cbd02c8e7b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 01:03:40.567627 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:40.567627 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:03:40.567627 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:03:40.567627 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:03:40.567627 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:03:40.567627 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:03:40.567627 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:40.567627 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 01:03:40.567627 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:40.567627 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:03:40.567627 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:40.567627 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:40.567627 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:40.567627 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:40.567627 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:40.567627 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:40.568706 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:40.568706 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:40.568706 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:40.568706 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:40.568706 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:40.568706 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:40.568706 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:03:40.568706 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:03:40.568706 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:03:40.568706 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:03:40.568706 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:40.568706 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:40.568706 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:40.568706 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:40.568706 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:40.568706 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:40.569528 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:40.569528 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:40.569528 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:40.569528 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:40.569528 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:40.569528 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:40.569528 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:40.569528 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:40.569528 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:40.569528 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:40.569528 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:03:40.569528 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:40.569528 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 01:03:40.569528 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:40.569528 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 447/921] 10.222.0.60 () {56 vars in 1126 bytes} [Sun Jul 31 01:03:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:40.575770 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7a527-7072-4f34-9b94-76bde399f347 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:40.697292 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7a527-7072-4f34-9b94-76bde399f347 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:40.733850 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153de2fd-0e73-4b35-b700-c71697702e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:40.734482 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153de2fd-0e73-4b35-b700-c71697702e42 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:40.735091 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153de2fd-0e73-4b35-b700-c71697702e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:40.735091 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153de2fd-0e73-4b35-b700-c71697702e42 None admin] PATH_INFO: `/v3/services` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:40.735779 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153de2fd-0e73-4b35-b700-c71697702e42 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:40.736086 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153de2fd-0e73-4b35-b700-c71697702e42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:40.737506 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153de2fd-0e73-4b35-b700-c71697702e42 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:40.742687 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 475/922] 10.222.0.60 () {56 vars in 1122 bytes} [Sun Jul 31 01:03:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:40.748432 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0b5de-6a56-4688-8a6e-47cbd02c8e7b None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:40.821712 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:40.863865 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0b5de-6a56-4688-8a6e-47cbd02c8e7b None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:40.899370 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bedb0d-8d50-4921-95c8-f86b3d175c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:40.900030 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bedb0d-8d50-4921-95c8-f86b3d175c8f None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:40.900304 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bedb0d-8d50-4921-95c8-f86b3d175c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:40.900568 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bedb0d-8d50-4921-95c8-f86b3d175c8f None admin] PATH_INFO: `/v3/services` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:40.901253 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bedb0d-8d50-4921-95c8-f86b3d175c8f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:40.901550 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bedb0d-8d50-4921-95c8-f86b3d175c8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:40.902923 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bedb0d-8d50-4921-95c8-f86b3d175c8f None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:40.909157 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 448/923] 10.222.0.60 () {56 vars in 1122 bytes} [Sun Jul 31 01:03:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:40.914971 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153de2fd-0e73-4b35-b700-c71697702e42 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:40.948159 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:41.025282 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153de2fd-0e73-4b35-b700-c71697702e42 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:41.063355 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8bac2d-e349-419c-af5f-635a95dd60f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:41.064405 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8bac2d-e349-419c-af5f-635a95dd60f0 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:41.064882 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8bac2d-e349-419c-af5f-635a95dd60f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:41.065518 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8bac2d-e349-419c-af5f-635a95dd60f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:41.066476 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8bac2d-e349-419c-af5f-635a95dd60f0 None admin] RBAC: Adding query filter params (interface=public, service_id=6a938cd00d994daaa48a659359fffe55, region_id=RegionOne) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:41.067000 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8bac2d-e349-419c-af5f-635a95dd60f0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:41.068595 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8bac2d-e349-419c-af5f-635a95dd60f0 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:41.079724 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 476/924] 10.222.0.60 () {56 vars in 1251 bytes} [Sun Jul 31 01:03:40 2022] GET /identity/v3/endpoints?service_id=6a938cd00d994daaa48a659359fffe55&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:41.085593 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bedb0d-8d50-4921-95c8-f86b3d175c8f None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:41.199250 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bedb0d-8d50-4921-95c8-f86b3d175c8f None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:41.228546 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:41.239336 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f51b92-8165-4424-8d65-aadee1383886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:41.240006 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f51b92-8165-4424-8d65-aadee1383886 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:41.240716 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f51b92-8165-4424-8d65-aadee1383886 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:41.240988 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f51b92-8165-4424-8d65-aadee1383886 None admin] PATH_INFO: `/v3/services` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:41.241658 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f51b92-8165-4424-8d65-aadee1383886 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:41.243119 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f51b92-8165-4424-8d65-aadee1383886 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:41.250929 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 449/925] 10.222.0.60 () {56 vars in 1087 bytes} [Sun Jul 31 01:03:41 2022] GET /identity/v3/services => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:03:41.835226 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1df40-9268-4d60-abc6-f95eb50a0737 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:41.835815 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1df40-9268-4d60-abc6-f95eb50a0737 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:41.835815 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1df40-9268-4d60-abc6-f95eb50a0737 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:41.837443 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 477/926] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:41.842787 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3f82f-d1f5-4c31-bff2-dd23be7925c0 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:41.843194 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3f82f-d1f5-4c31-bff2-dd23be7925c0 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:41.843375 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3f82f-d1f5-4c31-bff2-dd23be7925c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:41.861845 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-59e3f82f-d1f5-4c31-bff2-dd23be7925c0 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:41.863145 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-59e3f82f-d1f5-4c31-bff2-dd23be7925c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:41.869411 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b364e81-0ced-43c9-918c-93f77fec758d None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:41.869703 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b364e81-0ced-43c9-918c-93f77fec758d None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:41.869998 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b364e81-0ced-43c9-918c-93f77fec758d None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:41.871836 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 478/927] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:03:41.877661 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808c0de-e477-43d2-a23a-6d42805f52c5 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:41.877930 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808c0de-e477-43d2-a23a-6d42805f52c5 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:41.878204 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808c0de-e477-43d2-a23a-6d42805f52c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:41.898532 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-d808c0de-e477-43d2-a23a-6d42805f52c5 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:41.900046 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-d808c0de-e477-43d2-a23a-6d42805f52c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:41.947245 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 450/928] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:03:41.971219 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e3f82f-d1f5-4c31-bff2-dd23be7925c0 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:41.986318 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 479/929] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:03:42.009709 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808c0de-e477-43d2-a23a-6d42805f52c5 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:42.042955 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:42.086608 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e3f82f-d1f5-4c31-bff2-dd23be7925c0 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:42.108992 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:42.126751 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588a62f-eaa0-41b7-8c06-7b78e20d6d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:42.128042 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588a62f-eaa0-41b7-8c06-7b78e20d6d36 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:42.128414 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588a62f-eaa0-41b7-8c06-7b78e20d6d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:42.128777 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588a62f-eaa0-41b7-8c06-7b78e20d6d36 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:42.129601 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c588a62f-eaa0-41b7-8c06-7b78e20d6d36 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:42.131156 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c588a62f-eaa0-41b7-8c06-7b78e20d6d36 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:42.132359 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808c0de-e477-43d2-a23a-6d42805f52c5 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:42.141142 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-c588a62f-eaa0-41b7-8c06-7b78e20d6d36 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 31 01:03:42.141142 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:42.141142 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:03:42.141142 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:03:42.141142 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:03:42.141142 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:03:42.141142 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:03:42.141142 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:42.141142 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 31 01:03:42.141142 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:42.141142 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:03:42.141142 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:42.141142 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:42.141142 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:42.141142 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:42.141142 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:42.142345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:42.142345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:42.142345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:42.142345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:42.142345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:42.142345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:42.142345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:42.142345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:03:42.142345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:03:42.142345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:03:42.142345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:03:42.142345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:42.142345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:42.142345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:42.142345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:42.142345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:42.143398 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:42.143398 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:42.143398 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:42.143398 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:42.143398 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:42.143398 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:42.143398 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:42.143398 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:42.143398 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:42.143398 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:42.143398 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:42.143398 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:03:42.143398 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:42.143398 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 31 01:03:42.143398 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:42.150408 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 451/930] 10.222.0.60 () {56 vars in 1132 bytes} [Sun Jul 31 01:03:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:42.151376 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588a62f-eaa0-41b7-8c06-7b78e20d6d36 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:42.174524 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e52b58-dde6-43af-a5ee-bc36ae2a37e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:42.175682 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e52b58-dde6-43af-a5ee-bc36ae2a37e8 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:42.176164 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e52b58-dde6-43af-a5ee-bc36ae2a37e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:42.176610 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e52b58-dde6-43af-a5ee-bc36ae2a37e8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:42.188190 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e52b58-dde6-43af-a5ee-bc36ae2a37e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:03:42.193567 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-53e52b58-dde6-43af-a5ee-bc36ae2a37e8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 31 01:03:42.193567 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:42.193567 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:42.193567 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:42.193567 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:42.193567 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:42.193567 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:42.193567 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:42.193567 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:42.193567 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:42.193567 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:42.193567 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:42.193567 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:03:42.193567 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:03:42.193567 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:03:42.193567 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:03:42.194504 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:03:42.194504 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:03:42.194504 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:03:42.194504 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:03:42.194504 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:42.194504 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:42.194504 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:42.194504 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:42.194504 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:42.194504 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:42.194504 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:42.194504 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:42.194504 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:42.194504 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:42.194504 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:42.194504 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:42.195380 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:42.195380 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:42.195380 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:42.195380 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:42.195380 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:03:42.195380 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:03:42.195380 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:03:42.195380 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:03:42.195380 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:03:42.195380 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:03:42.195380 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 31 01:03:42.195380 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:42.198028 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 480/931] 10.222.0.60 () {56 vars in 1120 bytes} [Sun Jul 31 01:03:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:03:42.203594 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e52b58-dde6-43af-a5ee-bc36ae2a37e8 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:42.264330 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588a62f-eaa0-41b7-8c06-7b78e20d6d36 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:42.295606 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:42.302642 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07482fcc-88cc-4302-9bf2-1c07c633360c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:42.303371 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07482fcc-88cc-4302-9bf2-1c07c633360c None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:42.303735 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07482fcc-88cc-4302-9bf2-1c07c633360c None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:42.304071 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07482fcc-88cc-4302-9bf2-1c07c633360c None admin] PATH_INFO: `/v3/services` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:42.304832 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07482fcc-88cc-4302-9bf2-1c07c633360c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:42.305285 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07482fcc-88cc-4302-9bf2-1c07c633360c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:42.307016 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07482fcc-88cc-4302-9bf2-1c07c633360c None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:42.315865 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e52b58-dde6-43af-a5ee-bc36ae2a37e8 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:42.317458 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 452/932] 10.222.0.60 () {56 vars in 1126 bytes} [Sun Jul 31 01:03:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:42.318471 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07482fcc-88cc-4302-9bf2-1c07c633360c None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:42.358877 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79261629-1e3a-4d69-9bb8-e205b8c540a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:42.359926 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79261629-1e3a-4d69-9bb8-e205b8c540a2 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:42.360429 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79261629-1e3a-4d69-9bb8-e205b8c540a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:42.360893 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79261629-1e3a-4d69-9bb8-e205b8c540a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:42.361840 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79261629-1e3a-4d69-9bb8-e205b8c540a2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:42.362337 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79261629-1e3a-4d69-9bb8-e205b8c540a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:42.363949 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79261629-1e3a-4d69-9bb8-e205b8c540a2 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:42.374450 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 481/933] 10.222.0.60 () {56 vars in 1115 bytes} [Sun Jul 31 01:03:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:03:42.381511 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79261629-1e3a-4d69-9bb8-e205b8c540a2 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:42.390536 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:42.471622 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07482fcc-88cc-4302-9bf2-1c07c633360c None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:42.499007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79261629-1e3a-4d69-9bb8-e205b8c540a2 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:42.507533 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ee55b-9079-455d-bef2-925a1033227a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:42.507899 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ee55b-9079-455d-bef2-925a1033227a None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:42.508176 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ee55b-9079-455d-bef2-925a1033227a None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:42.508440 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ee55b-9079-455d-bef2-925a1033227a None admin] PATH_INFO: `/v3/services` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:42.509180 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ee55b-9079-455d-bef2-925a1033227a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:42.509481 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ee55b-9079-455d-bef2-925a1033227a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:42.510928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ee55b-9079-455d-bef2-925a1033227a None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:42.521816 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 453/934] 10.222.0.60 () {56 vars in 1126 bytes} [Sun Jul 31 01:03:42 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:42.522727 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ee55b-9079-455d-bef2-925a1033227a None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:42.537933 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc6c88-0a72-4217-85df-3dd99a1296b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:42.538948 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc6c88-0a72-4217-85df-3dd99a1296b4 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:42.539420 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc6c88-0a72-4217-85df-3dd99a1296b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:42.539913 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc6c88-0a72-4217-85df-3dd99a1296b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:42.551393 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc6c88-0a72-4217-85df-3dd99a1296b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:42.553333 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc6c88-0a72-4217-85df-3dd99a1296b4 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:42.560631 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:42.570864 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-f1fc6c88-0a72-4217-85df-3dd99a1296b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:42.570864 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:42.570864 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:42.570864 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:42.570864 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:42.570864 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:42.570864 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:42.570864 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:42.570864 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:42.570864 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:42.570864 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:42.570864 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:42.570864 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:42.570864 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:42.570864 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:42.572036 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:42.572036 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:42.572036 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:42.572036 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:42.572036 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:42.572036 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:42.572036 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:42.572036 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:42.572036 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:42.572036 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:42.572036 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:42.572036 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:42.572036 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:42.572036 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:42.572036 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:42.572036 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:42.572036 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:42.572930 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:42.572930 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:42.572930 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:42.572930 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:42.575068 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 482/935] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:03:42.581276 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc6c88-0a72-4217-85df-3dd99a1296b4 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:42.653372 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ee55b-9079-455d-bef2-925a1033227a None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:42.675092 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:42.705640 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4893fc-a981-46c5-af23-588accedf24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:42.707234 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4893fc-a981-46c5-af23-588accedf24d None admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:42.707722 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4893fc-a981-46c5-af23-588accedf24d None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:42.708400 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4893fc-a981-46c5-af23-588accedf24d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:42.709674 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4893fc-a981-46c5-af23-588accedf24d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:42.711987 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4893fc-a981-46c5-af23-588accedf24d None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:42.716351 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc6c88-0a72-4217-85df-3dd99a1296b4 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:42.744609 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 454/936] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:03:42 2022] POST /identity/v3/endpoints => generated 347 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:03:42.744609 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095ffff-26b0-468c-86de-eac0b1875acc None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:42.744609 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095ffff-26b0-468c-86de-eac0b1875acc None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:42.744609 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095ffff-26b0-468c-86de-eac0b1875acc None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:42.744609 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 455/937] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:42.750748 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653b92f-3f64-44ee-805e-2d5d1fca41cb None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:42.751046 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653b92f-3f64-44ee-805e-2d5d1fca41cb None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:42.751302 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653b92f-3f64-44ee-805e-2d5d1fca41cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:42.773966 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e002ab-7d9f-4d6e-8806-5d2ea16b20a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:42.774670 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e002ab-7d9f-4d6e-8806-5d2ea16b20a7 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:42.774947 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e002ab-7d9f-4d6e-8806-5d2ea16b20a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:42.775220 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e002ab-7d9f-4d6e-8806-5d2ea16b20a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:42.775916 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-3653b92f-3f64-44ee-805e-2d5d1fca41cb None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:42.776038 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e002ab-7d9f-4d6e-8806-5d2ea16b20a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:42.776272 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e002ab-7d9f-4d6e-8806-5d2ea16b20a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:42.777137 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-3653b92f-3f64-44ee-805e-2d5d1fca41cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:42.777689 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e002ab-7d9f-4d6e-8806-5d2ea16b20a7 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:42.799821 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 483/938] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:03:42.800954 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e002ab-7d9f-4d6e-8806-5d2ea16b20a7 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:42.858643 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 456/939] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:03:42.879704 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:42.888365 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653b92f-3f64-44ee-805e-2d5d1fca41cb None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:42.939876 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e002ab-7d9f-4d6e-8806-5d2ea16b20a7 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:42.984952 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67c897-a6a7-4c45-957b-d66048f48707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:42.985168 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67c897-a6a7-4c45-957b-d66048f48707 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:42.985417 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67c897-a6a7-4c45-957b-d66048f48707 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:42.985602 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67c897-a6a7-4c45-957b-d66048f48707 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:42.995749 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de67c897-a6a7-4c45-957b-d66048f48707 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:42.997242 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de67c897-a6a7-4c45-957b-d66048f48707 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:43.010151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-de67c897-a6a7-4c45-957b-d66048f48707 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 31 01:03:43.010151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:43.010151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:43.010151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:43.010151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:43.010151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:43.010151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:43.010151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:43.010151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:43.010151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:43.010151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:43.010151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:43.010151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:03:43.010151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:03:43.010151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:03:43.010151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:03:43.011425 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:43.011425 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:43.011425 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:03:43.011425 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:43.011425 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:03:43.011425 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:43.011425 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:43.011425 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:43.011425 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:43.011425 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:43.011425 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:43.011425 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:43.011425 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:43.011425 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:43.011425 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:43.011425 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:43.011425 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:43.011425 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:43.012466 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:43.012466 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:43.012466 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:03:43.012466 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:03:43.012466 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:03:43.012466 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:03:43.012466 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:03:43.012466 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:03:43.012466 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 31 01:03:43.012466 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:43.013162 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:43.013292 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 484/940] 10.222.0.60 () {56 vars in 1117 bytes} [Sun Jul 31 01:03:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:43.018319 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67c897-a6a7-4c45-957b-d66048f48707 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:43.018469 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653b92f-3f64-44ee-805e-2d5d1fca41cb None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:43.071311 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5651e6-01ae-499b-88ec-214a09d44bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:43.072045 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5651e6-01ae-499b-88ec-214a09d44bad None admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:43.072324 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5651e6-01ae-499b-88ec-214a09d44bad None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:43.072598 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5651e6-01ae-499b-88ec-214a09d44bad None admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:43.073302 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5651e6-01ae-499b-88ec-214a09d44bad None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:43.075407 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5651e6-01ae-499b-88ec-214a09d44bad None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:43.079261 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: WARNING keystone.server.flask.common [None req-2b5651e6-01ae-499b-88ec-214a09d44bad None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 31 01:03:43.105111 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.sql.core [None req-2b5651e6-01ae-499b-88ec-214a09d44bad None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 31 01:03:43.105111 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 31 01:03:43.105111 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [parameters: {'id': 'b87c2a86ac9140d7b458869ae133df43', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 31 01:03:43.105111 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80703) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 31 01:03:43.113195 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-2b5651e6-01ae-499b-88ec-214a09d44bad None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b87c2a86ac9140d7b458869ae133df43.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b87c2a86ac9140d7b458869ae133df43. Jul 31 01:03:43.113195 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:43.113195 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 31 01:03:43.113195 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 31 01:03:43.113195 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 31 01:03:43.113195 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 31 01:03:43.113195 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 31 01:03:43.113195 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application result = self._query(query) Jul 31 01:03:43.113195 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 31 01:03:43.113195 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application conn.query(q) Jul 31 01:03:43.113195 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 31 01:03:43.113195 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 31 01:03:43.113195 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 31 01:03:43.114075 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application result.read() Jul 31 01:03:43.114075 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 31 01:03:43.114075 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 31 01:03:43.114075 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 31 01:03:43.114075 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 31 01:03:43.114075 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 31 01:03:43.114075 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 31 01:03:43.114075 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 31 01:03:43.114075 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 31 01:03:43.114075 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 31 01:03:43.114075 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:43.114075 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 31 01:03:43.114075 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:43.114075 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:43.114075 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 31 01:03:43.114075 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 31 01:03:43.114075 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 31 01:03:43.114075 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 31 01:03:43.115309 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 31 01:03:43.115309 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application next(self.gen) Jul 31 01:03:43.115309 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 31 01:03:43.115309 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application yield resource Jul 31 01:03:43.115309 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 31 01:03:43.115309 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application next(self.gen) Jul 31 01:03:43.115309 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 31 01:03:43.115309 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application self.session.rollback() Jul 31 01:03:43.115309 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:03:43.115309 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application self.force_reraise() Jul 31 01:03:43.115309 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:03:43.115309 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise self.value Jul 31 01:03:43.115309 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 31 01:03:43.115309 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 31 01:03:43.115309 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 31 01:03:43.115309 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application session.commit() Jul 31 01:03:43.115309 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 31 01:03:43.116454 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 31 01:03:43.116454 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 31 01:03:43.116454 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application self._prepare_impl() Jul 31 01:03:43.116454 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 31 01:03:43.116454 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application self.session.flush() Jul 31 01:03:43.116454 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 31 01:03:43.116454 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application self._flush(objects) Jul 31 01:03:43.116454 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 31 01:03:43.116454 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 31 01:03:43.116454 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 31 01:03:43.116454 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application compat.raise_( Jul 31 01:03:43.116454 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 31 01:03:43.116454 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception Jul 31 01:03:43.116454 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 31 01:03:43.116454 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application flush_context.execute() Jul 31 01:03:43.116454 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 31 01:03:43.116454 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rec.execute(self) Jul 31 01:03:43.117390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 31 01:03:43.117390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 31 01:03:43.117390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 31 01:03:43.117390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 31 01:03:43.117390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 31 01:03:43.117390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 31 01:03:43.117390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 31 01:03:43.117390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 31 01:03:43.117390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 31 01:03:43.117390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 31 01:03:43.117390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 31 01:03:43.117390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 31 01:03:43.117390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 31 01:03:43.117390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 31 01:03:43.117390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 31 01:03:43.118188 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 31 01:03:43.118188 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 31 01:03:43.118188 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception Jul 31 01:03:43.118188 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 31 01:03:43.118188 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 31 01:03:43.118188 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 31 01:03:43.118188 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 31 01:03:43.118188 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 31 01:03:43.118188 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application result = self._query(query) Jul 31 01:03:43.118188 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 31 01:03:43.118188 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application conn.query(q) Jul 31 01:03:43.118188 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 31 01:03:43.118188 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 31 01:03:43.118188 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 31 01:03:43.118188 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application result.read() Jul 31 01:03:43.118188 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 31 01:03:43.118188 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 31 01:03:43.119937 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 31 01:03:43.119937 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 31 01:03:43.119937 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 31 01:03:43.119937 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 31 01:03:43.119937 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 31 01:03:43.119937 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 31 01:03:43.119937 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 31 01:03:43.119937 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 31 01:03:43.119937 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [parameters: {'id': 'b87c2a86ac9140d7b458869ae133df43', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 31 01:03:43.119937 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 31 01:03:43.119937 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:43.119937 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:03:43.119937 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:43.119937 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:43.119937 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 31 01:03:43.122407 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 31 01:03:43.122407 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 31 01:03:43.122407 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 31 01:03:43.122407 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 31 01:03:43.122407 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:43.122407 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:03:43.122407 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:43.122407 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:43.122407 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:43.122407 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:43.122407 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:43.122407 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:43.122407 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:43.122407 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:43.122407 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:43.122407 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:43.122407 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:43.124874 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:43.124874 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 31 01:03:43.124874 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 31 01:03:43.124874 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:43.124874 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:43.124874 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 31 01:03:43.124874 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 31 01:03:43.124874 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b87c2a86ac9140d7b458869ae133df43. Jul 31 01:03:43.124874 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:43.124874 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 457/941] 10.222.0.60 () {60 vars in 1140 bytes} [Sun Jul 31 01:03:42 2022] POST /identity/v3/projects => generated 262 bytes in 227 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:03:43.124874 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5651e6-01ae-499b-88ec-214a09d44bad None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:43.163681 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67c897-a6a7-4c45-957b-d66048f48707 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:43.183994 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:43.214277 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174ee70-e140-498c-8cb9-82d2f9d74fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:43.215534 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174ee70-e140-498c-8cb9-82d2f9d74fa8 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:43.216101 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174ee70-e140-498c-8cb9-82d2f9d74fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:43.216568 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174ee70-e140-498c-8cb9-82d2f9d74fa8 None admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:43.218202 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0174ee70-e140-498c-8cb9-82d2f9d74fa8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:43.218815 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0174ee70-e140-498c-8cb9-82d2f9d74fa8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:43.221106 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0174ee70-e140-498c-8cb9-82d2f9d74fa8 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:43.238057 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5651e6-01ae-499b-88ec-214a09d44bad None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:43.249955 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 485/942] 10.222.0.60 () {56 vars in 1149 bytes} [Sun Jul 31 01:03:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:43.251977 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174ee70-e140-498c-8cb9-82d2f9d74fa8 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:43.287194 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb143c-22df-47bd-b9d1-fba964e8c8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:43.288424 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb143c-22df-47bd-b9d1-fba964e8c8dd None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:43.288936 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb143c-22df-47bd-b9d1-fba964e8c8dd None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:43.290190 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb143c-22df-47bd-b9d1-fba964e8c8dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:43.299224 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb143c-22df-47bd-b9d1-fba964e8c8dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:43.301726 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb143c-22df-47bd-b9d1-fba964e8c8dd None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:43.315783 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-aafb143c-22df-47bd-b9d1-fba964e8c8dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:43.315783 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:43.315783 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:43.315783 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:43.315783 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:43.315783 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:43.315783 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:43.315783 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:43.315783 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:43.315783 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:43.315783 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:43.315783 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:43.315783 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:03:43.315783 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:03:43.315783 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:03:43.316748 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:03:43.316748 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:43.316748 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:43.316748 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:43.316748 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:43.316748 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:43.316748 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:43.316748 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:43.316748 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:43.316748 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:43.316748 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:43.316748 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:43.316748 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:43.316748 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:43.316748 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:43.316748 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:43.316748 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:43.317646 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:03:43.317646 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:03:43.317646 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:03:43.317646 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:03:43.317646 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:03:43.317646 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:03:43.317646 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:43.317646 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:43.319441 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 458/943] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:03:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:43.321138 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d543fbd-a85e-4865-b3fc-5ca738cdb9e3 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:43.321418 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d543fbd-a85e-4865-b3fc-5ca738cdb9e3 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:43.321687 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d543fbd-a85e-4865-b3fc-5ca738cdb9e3 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:43.327557 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 459/944] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:43.327557 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d543fbd-a85e-4865-b3fc-5ca738cdb9e3 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:43.351285 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:43.378084 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174ee70-e140-498c-8cb9-82d2f9d74fa8 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:43.423918 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf11ea-c38b-4a0b-97db-f440cb36e8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:43.424576 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf11ea-c38b-4a0b-97db-f440cb36e8db None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:43.424855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf11ea-c38b-4a0b-97db-f440cb36e8db None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:43.425127 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf11ea-c38b-4a0b-97db-f440cb36e8db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:43.437670 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf11ea-c38b-4a0b-97db-f440cb36e8db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:43.439675 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf11ea-c38b-4a0b-97db-f440cb36e8db None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:43.463122 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d543fbd-a85e-4865-b3fc-5ca738cdb9e3 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:43.467183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-e4cf11ea-c38b-4a0b-97db-f440cb36e8db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:43.467183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:43.467183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:43.467183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:43.467183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:43.467183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:43.467183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:43.467183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:43.467183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:43.467183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:43.467183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:43.467183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:43.467183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:43.467183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:43.467183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:43.468290 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:43.468290 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:43.468290 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:43.468290 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:43.468290 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:43.468290 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:43.468290 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:43.468290 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:43.468290 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:43.468290 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:43.468290 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:43.468290 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:43.468290 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:43.468290 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:43.468290 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:43.468290 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:43.468290 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:43.469538 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:43.469538 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:43.469538 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:43.469538 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:43.473395 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 486/945] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:43.474805 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226fe831-aef6-4e5a-accb-3f849ca03105 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:43.475307 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226fe831-aef6-4e5a-accb-3f849ca03105 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:43.475438 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226fe831-aef6-4e5a-accb-3f849ca03105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:43.494689 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-226fe831-aef6-4e5a-accb-3f849ca03105 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:43.495941 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-226fe831-aef6-4e5a-accb-3f849ca03105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:43.501082 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee514e81-1aff-451d-890c-f14b1247adae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:43.501729 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee514e81-1aff-451d-890c-f14b1247adae None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:43.502002 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee514e81-1aff-451d-890c-f14b1247adae None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:43.502631 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee514e81-1aff-451d-890c-f14b1247adae None admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:43.503359 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee514e81-1aff-451d-890c-f14b1247adae None admin] RBAC: Adding query filter params (name=service) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:43.503685 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee514e81-1aff-451d-890c-f14b1247adae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:43.505117 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee514e81-1aff-451d-890c-f14b1247adae None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:43.516054 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:43.531522 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 460/946] 10.222.0.60 () {56 vars in 1112 bytes} [Sun Jul 31 01:03:43 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:43.531522 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee514e81-1aff-451d-890c-f14b1247adae None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:43.606558 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 487/947] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:03:43.629645 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226fe831-aef6-4e5a-accb-3f849ca03105 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:43.637239 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:43.667999 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee514e81-1aff-451d-890c-f14b1247adae None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:43.719580 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d750f6-8308-44f4-b335-0e87635b2614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:43.720139 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d750f6-8308-44f4-b335-0e87635b2614 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:43.720413 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d750f6-8308-44f4-b335-0e87635b2614 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:43.721287 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d750f6-8308-44f4-b335-0e87635b2614 None admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:43.721420 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d750f6-8308-44f4-b335-0e87635b2614 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:43.721650 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d750f6-8308-44f4-b335-0e87635b2614 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:43.723015 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d750f6-8308-44f4-b335-0e87635b2614 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:43.735526 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 461/948] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:43.746127 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d750f6-8308-44f4-b335-0e87635b2614 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:43.838692 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226fe831-aef6-4e5a-accb-3f849ca03105 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:43.864634 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d750f6-8308-44f4-b335-0e87635b2614 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:43.876414 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e95ec5-2fa7-48a0-b58a-fd1cf615e8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:43.877536 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e95ec5-2fa7-48a0-b58a-fd1cf615e8d5 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:43.877817 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e95ec5-2fa7-48a0-b58a-fd1cf615e8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:43.878088 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e95ec5-2fa7-48a0-b58a-fd1cf615e8d5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:43.878718 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e95ec5-2fa7-48a0-b58a-fd1cf615e8d5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:43.880231 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e95ec5-2fa7-48a0-b58a-fd1cf615e8d5 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:43.889978 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-79e95ec5-2fa7-48a0-b58a-fd1cf615e8d5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 01:03:43.889978 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:43.889978 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:03:43.889978 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:03:43.889978 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:03:43.889978 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:03:43.889978 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:03:43.889978 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:43.889978 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 01:03:43.889978 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:43.889978 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:03:43.889978 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:43.889978 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:43.889978 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:43.889978 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:43.889978 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:43.889978 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:43.891048 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:43.891048 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:43.891048 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:43.891048 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:43.891048 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:43.891048 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:43.891048 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:03:43.891048 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:03:43.891048 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:03:43.891048 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:03:43.891048 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:43.891048 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:43.891048 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:43.891048 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:43.891048 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:43.891048 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:43.892007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:43.892007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:43.892007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:43.892007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:43.892007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:43.892007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:43.892007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:43.892007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:43.892007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:43.892007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:43.892007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:03:43.892007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:43.892007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 01:03:43.892007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:43.892007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 488/949] 10.222.0.60 () {56 vars in 1126 bytes} [Sun Jul 31 01:03:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:03:43.899868 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e95ec5-2fa7-48a0-b58a-fd1cf615e8d5 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:43.906465 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce95289-8a05-43f9-a9a9-13bcb43d6457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:43.907201 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce95289-8a05-43f9-a9a9-13bcb43d6457 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:43.908357 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce95289-8a05-43f9-a9a9-13bcb43d6457 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:43.908357 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce95289-8a05-43f9-a9a9-13bcb43d6457 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:43.910299 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:43.916270 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce95289-8a05-43f9-a9a9-13bcb43d6457 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:43.917890 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce95289-8a05-43f9-a9a9-13bcb43d6457 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:43.928527 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:43.933218 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-cce95289-8a05-43f9-a9a9-13bcb43d6457 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:43.933218 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:43.933218 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:43.933218 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:43.933218 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:43.933218 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:43.933218 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:43.933218 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:43.933218 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:43.933218 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:43.933218 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:43.933218 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:43.933218 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:03:43.933218 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:03:43.933218 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:03:43.934474 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:03:43.934474 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:43.934474 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:43.934474 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:43.934474 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:43.934474 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:43.934474 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:43.934474 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:43.934474 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:43.934474 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:43.934474 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:43.934474 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:43.934474 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:43.934474 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:43.934474 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:43.934474 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:43.934474 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:43.935832 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:03:43.935832 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:03:43.935832 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:03:43.935832 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:03:43.935832 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:03:43.935832 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:03:43.935832 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:43.935832 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:43.937379 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 462/950] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:03:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:03:43.943028 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce95289-8a05-43f9-a9a9-13bcb43d6457 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:44.036672 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e95ec5-2fa7-48a0-b58a-fd1cf615e8d5 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:44.065971 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce95289-8a05-43f9-a9a9-13bcb43d6457 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:44.085423 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb83667-fbd3-433d-aa05-a72a63121e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:44.086360 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb83667-fbd3-433d-aa05-a72a63121e49 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:44.086786 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb83667-fbd3-433d-aa05-a72a63121e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:44.087199 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb83667-fbd3-433d-aa05-a72a63121e49 None admin] PATH_INFO: `/v3/services` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:44.088066 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb83667-fbd3-433d-aa05-a72a63121e49 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:44.089098 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb83667-fbd3-433d-aa05-a72a63121e49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:44.090938 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb83667-fbd3-433d-aa05-a72a63121e49 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:44.103823 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 489/951] 10.222.0.60 () {56 vars in 1122 bytes} [Sun Jul 31 01:03:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:44.109300 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb83667-fbd3-433d-aa05-a72a63121e49 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:44.117664 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef83c17-ffa5-4638-ba37-384ac557382d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:44.118695 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef83c17-ffa5-4638-ba37-384ac557382d None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:44.119177 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef83c17-ffa5-4638-ba37-384ac557382d None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:44.119691 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef83c17-ffa5-4638-ba37-384ac557382d None admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:44.120739 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef83c17-ffa5-4638-ba37-384ac557382d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:44.121115 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef83c17-ffa5-4638-ba37-384ac557382d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:44.123335 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef83c17-ffa5-4638-ba37-384ac557382d None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:44.141488 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 463/952] 10.222.0.60 () {56 vars in 1148 bytes} [Sun Jul 31 01:03:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:03:44.147430 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef83c17-ffa5-4638-ba37-384ac557382d None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:44.222190 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:44.251535 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:44.252721 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb83667-fbd3-433d-aa05-a72a63121e49 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:44.292587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4152a-58fd-4871-9d59-5e42abafaa23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:44.294233 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4152a-58fd-4871-9d59-5e42abafaa23 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:44.295009 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4152a-58fd-4871-9d59-5e42abafaa23 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:44.295855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4152a-58fd-4871-9d59-5e42abafaa23 None admin] PATH_INFO: `/v3/services` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:44.297377 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b4152a-58fd-4871-9d59-5e42abafaa23 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:44.298186 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b4152a-58fd-4871-9d59-5e42abafaa23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:44.301077 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b4152a-58fd-4871-9d59-5e42abafaa23 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:44.310661 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef83c17-ffa5-4638-ba37-384ac557382d None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:44.312604 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 490/953] 10.222.0.60 () {56 vars in 1122 bytes} [Sun Jul 31 01:03:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:03:44.323576 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4152a-58fd-4871-9d59-5e42abafaa23 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:44.364692 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f4ca6-159e-4c4c-bbdb-808f48abf86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:44.365407 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f4ca6-159e-4c4c-bbdb-808f48abf86a None admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:44.366741 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f4ca6-159e-4c4c-bbdb-808f48abf86a None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:44.367031 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f4ca6-159e-4c4c-bbdb-808f48abf86a None admin] PATH_INFO: `/v3/projects/b931b81a237949aa845891d4bb5aa1c0/users/02ed9040d575462db4b270a5b57063f2/roles/9687bf70551b48aaaef3e0187bb47d06` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:44.369452 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f4ca6-159e-4c4c-bbdb-808f48abf86a None admin] RBAC: Authorizing `identity:create_grant(project_id=b931b81a237949aa845891d4bb5aa1c0, user_id=02ed9040d575462db4b270a5b57063f2, role_id=9687bf70551b48aaaef3e0187bb47d06)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:44.370907 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f4ca6-159e-4c4c-bbdb-808f48abf86a None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:44.403626 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 464/954] 10.222.0.60 () {58 vars in 1439 bytes} [Sun Jul 31 01:03:44 2022] PUT /identity/v3/projects/b931b81a237949aa845891d4bb5aa1c0/users/02ed9040d575462db4b270a5b57063f2/roles/9687bf70551b48aaaef3e0187bb47d06 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:03:44.461699 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4152a-58fd-4871-9d59-5e42abafaa23 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:44.501012 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c1016-8d1c-47fc-9f81-433f9df0a9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:44.501662 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c1016-8d1c-47fc-9f81-433f9df0a9b7 None admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:44.501938 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c1016-8d1c-47fc-9f81-433f9df0a9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:44.502573 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c1016-8d1c-47fc-9f81-433f9df0a9b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:44.503430 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c1016-8d1c-47fc-9f81-433f9df0a9b7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:44.504937 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c1016-8d1c-47fc-9f81-433f9df0a9b7 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:44.532216 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 491/955] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:03:44 2022] POST /identity/v3/endpoints => generated 349 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:03:44.985529 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf49009-def9-425d-ac79-8da075435c44 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:44.986113 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf49009-def9-425d-ac79-8da075435c44 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:44.986113 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf49009-def9-425d-ac79-8da075435c44 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:44.987770 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 465/956] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:44.993156 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c143b-f547-4bf2-a631-f5f6dd52cfcd None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:44.993622 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c143b-f547-4bf2-a631-f5f6dd52cfcd None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:44.993701 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c143b-f547-4bf2-a631-f5f6dd52cfcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:45.000218 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:45.015353 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-602c143b-f547-4bf2-a631-f5f6dd52cfcd None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:45.016622 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-602c143b-f547-4bf2-a631-f5f6dd52cfcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:45.096438 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 492/957] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:03:45.121837 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf49009-def9-425d-ac79-8da075435c44 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:45.235133 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf49009-def9-425d-ac79-8da075435c44 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:45.250766 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:45.273133 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0224104-884b-4c2f-9704-fb0243c001e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:45.273866 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0224104-884b-4c2f-9704-fb0243c001e9 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:45.274145 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0224104-884b-4c2f-9704-fb0243c001e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:45.274417 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0224104-884b-4c2f-9704-fb0243c001e9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:45.275049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0224104-884b-4c2f-9704-fb0243c001e9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:45.276468 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0224104-884b-4c2f-9704-fb0243c001e9 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:45.286658 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-f0224104-884b-4c2f-9704-fb0243c001e9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 31 01:03:45.286658 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:45.286658 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:03:45.286658 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:03:45.286658 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:03:45.286658 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:03:45.286658 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:03:45.286658 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:45.286658 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 31 01:03:45.286658 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:45.286658 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:03:45.286658 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:45.286658 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:45.286658 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:45.286658 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:45.286658 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:45.286658 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:45.287870 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:45.287870 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:45.287870 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:45.287870 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:45.287870 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:45.287870 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:45.287870 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:03:45.287870 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:03:45.287870 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:03:45.287870 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:03:45.287870 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:45.287870 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:45.287870 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:45.287870 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:45.287870 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:45.287870 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:45.288780 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:45.288780 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:45.288780 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:45.288780 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:45.288780 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:45.288780 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:45.288780 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:45.288780 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:45.288780 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:45.288780 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:45.288780 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:03:45.288780 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:45.288780 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 31 01:03:45.288780 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:45.288780 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 466/958] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:03:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:45.294130 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c143b-f547-4bf2-a631-f5f6dd52cfcd None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:45.430189 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c143b-f547-4bf2-a631-f5f6dd52cfcd None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:45.479869 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:45.487411 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a524cf-ec5e-458e-ac45-4b2a264f8123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:45.488532 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a524cf-ec5e-458e-ac45-4b2a264f8123 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:45.489266 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a524cf-ec5e-458e-ac45-4b2a264f8123 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:45.489787 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a524cf-ec5e-458e-ac45-4b2a264f8123 None admin] PATH_INFO: `/v3/services` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:45.491092 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a524cf-ec5e-458e-ac45-4b2a264f8123 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:45.491785 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a524cf-ec5e-458e-ac45-4b2a264f8123 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:45.494408 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a524cf-ec5e-458e-ac45-4b2a264f8123 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:45.504140 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 493/959] 10.222.0.60 () {56 vars in 1112 bytes} [Sun Jul 31 01:03:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:45.509779 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0224104-884b-4c2f-9704-fb0243c001e9 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:45.616443 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0224104-884b-4c2f-9704-fb0243c001e9 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:45.655351 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e946a1f-24ae-4101-b418-6a825c825d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:45.656035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e946a1f-24ae-4101-b418-6a825c825d0d None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:45.656313 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e946a1f-24ae-4101-b418-6a825c825d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:45.656589 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e946a1f-24ae-4101-b418-6a825c825d0d None admin] PATH_INFO: `/v3/services` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:45.657299 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e946a1f-24ae-4101-b418-6a825c825d0d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:45.657600 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e946a1f-24ae-4101-b418-6a825c825d0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:45.659027 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e946a1f-24ae-4101-b418-6a825c825d0d None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:45.665215 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 467/960] 10.222.0.60 () {56 vars in 1112 bytes} [Sun Jul 31 01:03:45 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:45.781338 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd2448-cd8a-4696-896a-7e0b5fb73466 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:45.781928 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd2448-cd8a-4696-896a-7e0b5fb73466 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:45.782387 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd2448-cd8a-4696-896a-7e0b5fb73466 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:45.784685 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 494/961] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:45.792970 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f6259-5957-4959-9a11-f2c8bcdd3552 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:45.793419 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f6259-5957-4959-9a11-f2c8bcdd3552 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:45.793812 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f6259-5957-4959-9a11-f2c8bcdd3552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:45.814608 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-2c1f6259-5957-4959-9a11-f2c8bcdd3552 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:45.816413 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-2c1f6259-5957-4959-9a11-f2c8bcdd3552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:45.855422 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:45.891135 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 468/962] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:03:45.917733 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd2448-cd8a-4696-896a-7e0b5fb73466 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:46.031153 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd2448-cd8a-4696-896a-7e0b5fb73466 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:46.077234 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf88d3-5bd6-44de-868e-73360371c8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:46.078260 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf88d3-5bd6-44de-868e-73360371c8bc None admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:46.078731 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf88d3-5bd6-44de-868e-73360371c8bc None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:46.079189 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf88d3-5bd6-44de-868e-73360371c8bc None admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:46.080116 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cf88d3-5bd6-44de-868e-73360371c8bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:46.081770 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cf88d3-5bd6-44de-868e-73360371c8bc None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:46.084598 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: WARNING keystone.server.flask.common [None req-41cf88d3-5bd6-44de-868e-73360371c8bc None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 31 01:03:46.098675 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.sql.core [None req-41cf88d3-5bd6-44de-868e-73360371c8bc None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 31 01:03:46.098675 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 31 01:03:46.098675 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [parameters: {'user_id': 'a4f3fddda08e4044bc3038b3f44e6a8f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 31 01:03:46.098675 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80702) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 31 01:03:46.116593 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-41cf88d3-5bd6-44de-868e-73360371c8bc None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 31 01:03:46.116593 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:46.116593 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 31 01:03:46.116593 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 31 01:03:46.116593 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 31 01:03:46.116593 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 31 01:03:46.116593 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 31 01:03:46.116593 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application result = self._query(query) Jul 31 01:03:46.116593 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 31 01:03:46.116593 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application conn.query(q) Jul 31 01:03:46.116593 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 31 01:03:46.116593 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 31 01:03:46.116593 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 31 01:03:46.116593 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application result.read() Jul 31 01:03:46.116593 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 31 01:03:46.117599 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 31 01:03:46.117599 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 31 01:03:46.117599 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 31 01:03:46.117599 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 31 01:03:46.117599 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 31 01:03:46.117599 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 31 01:03:46.117599 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 31 01:03:46.117599 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 31 01:03:46.117599 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:46.117599 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 31 01:03:46.117599 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:46.117599 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:46.117599 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 31 01:03:46.117599 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 31 01:03:46.117599 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 31 01:03:46.117599 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 31 01:03:46.117599 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 31 01:03:46.117599 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application next(self.gen) Jul 31 01:03:46.118576 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 31 01:03:46.118576 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application yield resource Jul 31 01:03:46.118576 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 31 01:03:46.118576 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application next(self.gen) Jul 31 01:03:46.118576 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 31 01:03:46.118576 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application self.session.rollback() Jul 31 01:03:46.118576 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:03:46.118576 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application self.force_reraise() Jul 31 01:03:46.118576 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:03:46.118576 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise self.value Jul 31 01:03:46.118576 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 31 01:03:46.118576 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 31 01:03:46.118576 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 31 01:03:46.118576 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application session.commit() Jul 31 01:03:46.118576 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 31 01:03:46.118576 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 31 01:03:46.118576 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 31 01:03:46.119519 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application self._prepare_impl() Jul 31 01:03:46.119519 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 31 01:03:46.119519 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application self.session.flush() Jul 31 01:03:46.119519 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 31 01:03:46.119519 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application self._flush(objects) Jul 31 01:03:46.119519 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 31 01:03:46.119519 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 31 01:03:46.119519 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 31 01:03:46.119519 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application compat.raise_( Jul 31 01:03:46.119519 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 31 01:03:46.119519 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception Jul 31 01:03:46.119519 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 31 01:03:46.119519 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application flush_context.execute() Jul 31 01:03:46.119519 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 31 01:03:46.119519 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rec.execute(self) Jul 31 01:03:46.119519 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 31 01:03:46.119519 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 31 01:03:46.120436 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 31 01:03:46.120436 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 31 01:03:46.120436 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 31 01:03:46.120436 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 31 01:03:46.120436 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 31 01:03:46.120436 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 31 01:03:46.120436 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 31 01:03:46.120436 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 31 01:03:46.120436 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 31 01:03:46.120436 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 31 01:03:46.120436 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 31 01:03:46.120436 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 31 01:03:46.120436 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 31 01:03:46.120436 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 31 01:03:46.120436 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 31 01:03:46.120436 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception Jul 31 01:03:46.121306 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 31 01:03:46.121306 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 31 01:03:46.121306 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 31 01:03:46.121306 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 31 01:03:46.121306 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 31 01:03:46.121306 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application result = self._query(query) Jul 31 01:03:46.121306 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 31 01:03:46.121306 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application conn.query(q) Jul 31 01:03:46.121306 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 31 01:03:46.121306 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 31 01:03:46.121306 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 31 01:03:46.121306 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application result.read() Jul 31 01:03:46.121306 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 31 01:03:46.121306 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 31 01:03:46.121306 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 31 01:03:46.121306 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 31 01:03:46.122117 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 31 01:03:46.122117 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 31 01:03:46.122117 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 31 01:03:46.122117 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 31 01:03:46.122117 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 31 01:03:46.122117 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 31 01:03:46.122117 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [parameters: {'user_id': 'a4f3fddda08e4044bc3038b3f44e6a8f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 31 01:03:46.122117 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 31 01:03:46.122117 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:46.122117 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:03:46.122117 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:46.122117 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:46.122117 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:46.122117 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:46.122117 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:46.124763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:46.124763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:46.124763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:46.124763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:46.124763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:46.124763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:46.124763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:46.124763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 31 01:03:46.124763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 31 01:03:46.124763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:46.124763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:46.124763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:03:46.124763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:46.124763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:03:46.124763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:46.124763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 31 01:03:46.124763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 31 01:03:46.126823 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 31 01:03:46.126823 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 31 01:03:46.126823 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 31 01:03:46.126823 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 31 01:03:46.126823 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 31 01:03:46.126823 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:46.129951 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 495/963] 10.222.0.60 () {60 vars in 1131 bytes} [Sun Jul 31 01:03:45 2022] POST /identity/v3/users => generated 160 bytes in 213 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:46.136151 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f6259-5957-4959-9a11-f2c8bcdd3552 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:46.248214 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f6259-5957-4959-9a11-f2c8bcdd3552 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:46.289317 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287563ff-3617-4076-8807-a692d6bcf9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:46.290522 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287563ff-3617-4076-8807-a692d6bcf9dc None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:46.291020 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287563ff-3617-4076-8807-a692d6bcf9dc None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:46.291562 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287563ff-3617-4076-8807-a692d6bcf9dc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:46.300259 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287563ff-3617-4076-8807-a692d6bcf9dc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:46.302215 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287563ff-3617-4076-8807-a692d6bcf9dc None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:46.315463 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-287563ff-3617-4076-8807-a692d6bcf9dc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 31 01:03:46.315463 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:46.315463 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:46.315463 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:46.315463 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:46.315463 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:46.315463 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:46.315463 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:46.315463 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:46.315463 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:46.315463 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:46.315463 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:46.315463 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:03:46.315463 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:03:46.315463 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:03:46.315463 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:03:46.316505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:46.316505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:46.316505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:03:46.316505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:46.316505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:03:46.316505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:46.316505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:46.316505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:46.316505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:46.316505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:46.316505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:46.316505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:46.316505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:46.316505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:46.316505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:46.316505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:46.316505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:46.316505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:46.317452 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:46.317452 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:46.317452 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:03:46.317452 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:03:46.317452 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:03:46.317452 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:03:46.317452 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:03:46.317452 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:03:46.317452 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 31 01:03:46.317452 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:46.320128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 469/964] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:03:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:46.326596 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf88d3-5bd6-44de-868e-73360371c8bc None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:46.389619 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:46.436980 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf88d3-5bd6-44de-868e-73360371c8bc None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:46.471533 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7b0a4-b205-4e0b-a844-95324e0c08e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:46.472178 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7b0a4-b205-4e0b-a844-95324e0c08e3 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:46.472452 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7b0a4-b205-4e0b-a844-95324e0c08e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:46.472715 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7b0a4-b205-4e0b-a844-95324e0c08e3 None admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:46.473481 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe7b0a4-b205-4e0b-a844-95324e0c08e3 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:46.473780 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe7b0a4-b205-4e0b-a844-95324e0c08e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:46.475421 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe7b0a4-b205-4e0b-a844-95324e0c08e3 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:46.517664 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 496/965] 10.222.0.60 () {56 vars in 1101 bytes} [Sun Jul 31 01:03:46 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:46.609161 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50669b01-f078-4cc1-b642-d90798eeb53c None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:46.609837 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50669b01-f078-4cc1-b642-d90798eeb53c None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:46.610303 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50669b01-f078-4cc1-b642-d90798eeb53c None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:46.612407 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 470/966] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:46.618977 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ff630-f9de-4c6e-82f8-1cb6203d1d57 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:46.619685 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ff630-f9de-4c6e-82f8-1cb6203d1d57 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:46.620181 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ff630-f9de-4c6e-82f8-1cb6203d1d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:46.640899 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-ca4ff630-f9de-4c6e-82f8-1cb6203d1d57 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:46.642883 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-ca4ff630-f9de-4c6e-82f8-1cb6203d1d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:46.653343 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c4650-6a56-4d4d-8ebc-98734dbe0d1e None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:46.653716 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c4650-6a56-4d4d-8ebc-98734dbe0d1e None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:46.653949 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c4650-6a56-4d4d-8ebc-98734dbe0d1e None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:46.655543 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 471/967] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:46.661125 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a7a18-db37-436f-bf3f-8e22bf8f038e None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:46.661426 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a7a18-db37-436f-bf3f-8e22bf8f038e None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:46.661686 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a7a18-db37-436f-bf3f-8e22bf8f038e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:46.681841 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-661a7a18-db37-436f-bf3f-8e22bf8f038e None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:46.683085 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-661a7a18-db37-436f-bf3f-8e22bf8f038e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:46.721908 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:46.755845 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 497/968] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:03:46.779595 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ff630-f9de-4c6e-82f8-1cb6203d1d57 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:46.781826 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 472/969] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:03:46.813395 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a7a18-db37-436f-bf3f-8e22bf8f038e None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:46.832809 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:46.902139 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ff630-f9de-4c6e-82f8-1cb6203d1d57 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:46.954146 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f731e-3f3f-4392-81b2-6b97071eebe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:46.954818 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f731e-3f3f-4392-81b2-6b97071eebe6 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:46.955073 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a7a18-db37-436f-bf3f-8e22bf8f038e None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:46.955184 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f731e-3f3f-4392-81b2-6b97071eebe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:46.955362 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f731e-3f3f-4392-81b2-6b97071eebe6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:46.969301 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373f731e-3f3f-4392-81b2-6b97071eebe6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:03:46.974272 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-373f731e-3f3f-4392-81b2-6b97071eebe6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 31 01:03:46.974272 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:46.974272 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:46.974272 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:46.974272 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:46.974272 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:46.974272 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:46.974272 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:46.974272 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:46.974272 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:46.974272 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:46.974272 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:46.974272 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:03:46.974272 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:03:46.974272 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:03:46.974272 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:03:46.975264 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:03:46.975264 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:03:46.975264 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:03:46.975264 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:03:46.975264 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:46.975264 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:46.975264 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:46.975264 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:46.975264 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:46.975264 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:46.975264 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:46.975264 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:46.975264 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:46.975264 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:46.975264 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:46.975264 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:46.976155 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:46.976155 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:46.976155 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:46.976155 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:46.976155 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:03:46.976155 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:03:46.976155 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:03:46.976155 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:03:46.976155 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:03:46.976155 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:03:46.976155 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 31 01:03:46.976155 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:46.976155 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 498/970] 10.222.0.60 () {56 vars in 1120 bytes} [Sun Jul 31 01:03:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:46.981668 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f731e-3f3f-4392-81b2-6b97071eebe6 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:47.000490 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790272eb-a32a-4099-b1a4-f20ed7934eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:47.001177 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790272eb-a32a-4099-b1a4-f20ed7934eb8 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:47.001441 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790272eb-a32a-4099-b1a4-f20ed7934eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:47.001709 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790272eb-a32a-4099-b1a4-f20ed7934eb8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:47.002718 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790272eb-a32a-4099-b1a4-f20ed7934eb8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:47.004498 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790272eb-a32a-4099-b1a4-f20ed7934eb8 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:47.020374 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-790272eb-a32a-4099-b1a4-f20ed7934eb8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 01:03:47.020374 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:47.020374 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:03:47.020374 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:03:47.020374 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:03:47.020374 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:03:47.020374 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:03:47.020374 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:47.020374 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 01:03:47.020374 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:47.020374 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:03:47.020374 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:47.020374 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:47.020374 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:47.020374 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:47.020374 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:47.020374 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:47.021462 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:47.021462 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:47.021462 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:47.021462 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:47.021462 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:47.021462 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:47.021462 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:03:47.021462 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:03:47.021462 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:03:47.021462 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:03:47.021462 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:47.021462 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:47.021462 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:47.021462 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:47.021462 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:47.021462 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:47.022289 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:47.022289 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:47.022289 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:47.022289 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:47.022289 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:47.022289 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:47.022289 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:47.022289 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:47.022289 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:47.022289 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:47.022289 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:03:47.022289 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:47.022289 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 01:03:47.022289 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:47.023026 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 473/971] 10.222.0.60 () {56 vars in 1126 bytes} [Sun Jul 31 01:03:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:03:47.029588 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790272eb-a32a-4099-b1a4-f20ed7934eb8 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:47.060919 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:47.121644 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f731e-3f3f-4392-81b2-6b97071eebe6 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:47.123569 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:47.154414 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790272eb-a32a-4099-b1a4-f20ed7934eb8 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:47.166197 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd799bb-0c24-45ee-93b7-4666de851e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:47.166831 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd799bb-0c24-45ee-93b7-4666de851e61 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:47.167109 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd799bb-0c24-45ee-93b7-4666de851e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:47.167534 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd799bb-0c24-45ee-93b7-4666de851e61 None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:47.168336 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd799bb-0c24-45ee-93b7-4666de851e61 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:47.168646 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd799bb-0c24-45ee-93b7-4666de851e61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:47.170082 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd799bb-0c24-45ee-93b7-4666de851e61 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:47.184460 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 499/972] 10.222.0.60 () {56 vars in 1115 bytes} [Sun Jul 31 01:03:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:47.185700 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd799bb-0c24-45ee-93b7-4666de851e61 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:47.195522 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68686a-77b5-4da8-b6e1-e3ef7cf61f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:47.196170 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68686a-77b5-4da8-b6e1-e3ef7cf61f9d None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:47.196452 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68686a-77b5-4da8-b6e1-e3ef7cf61f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:47.196730 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68686a-77b5-4da8-b6e1-e3ef7cf61f9d None admin] PATH_INFO: `/v3/services` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:47.197610 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68686a-77b5-4da8-b6e1-e3ef7cf61f9d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:47.198162 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68686a-77b5-4da8-b6e1-e3ef7cf61f9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:47.199449 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68686a-77b5-4da8-b6e1-e3ef7cf61f9d None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:47.205114 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 474/973] 10.222.0.60 () {56 vars in 1122 bytes} [Sun Jul 31 01:03:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:47.210883 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68686a-77b5-4da8-b6e1-e3ef7cf61f9d None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:47.305335 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd799bb-0c24-45ee-93b7-4666de851e61 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:47.320121 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:47.332366 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68686a-77b5-4da8-b6e1-e3ef7cf61f9d None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:47.367063 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6db1c-141c-4b97-815e-b3dff4499063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:47.367063 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6db1c-141c-4b97-815e-b3dff4499063 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:47.367063 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6db1c-141c-4b97-815e-b3dff4499063 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:47.367063 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6db1c-141c-4b97-815e-b3dff4499063 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:47.378780 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4877f7c0-b011-4551-acaa-552040810417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:47.379798 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877f7c0-b011-4551-acaa-552040810417 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:47.379957 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa6db1c-141c-4b97-815e-b3dff4499063 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:47.380101 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877f7c0-b011-4551-acaa-552040810417 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:47.380349 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877f7c0-b011-4551-acaa-552040810417 None admin] PATH_INFO: `/v3/services` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:47.381045 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4877f7c0-b011-4551-acaa-552040810417 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:47.381353 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4877f7c0-b011-4551-acaa-552040810417 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:47.381512 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa6db1c-141c-4b97-815e-b3dff4499063 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:47.382724 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4877f7c0-b011-4551-acaa-552040810417 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:47.388975 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 475/974] 10.222.0.60 () {56 vars in 1122 bytes} [Sun Jul 31 01:03:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:03:47.394669 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4877f7c0-b011-4551-acaa-552040810417 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:47.400955 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-1aa6db1c-141c-4b97-815e-b3dff4499063 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:47.400955 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:47.400955 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:47.400955 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:47.400955 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:47.400955 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:47.400955 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:47.400955 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:47.400955 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:47.400955 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:47.400955 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:47.400955 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:47.400955 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:47.400955 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:47.400955 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:47.401888 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:47.401888 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:47.401888 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:47.401888 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:47.401888 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:47.401888 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:47.401888 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:47.401888 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:47.401888 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:47.401888 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:47.401888 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:47.401888 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:47.401888 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:47.401888 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:47.401888 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:47.401888 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:47.401888 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:47.402773 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:47.402773 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:47.402773 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:47.402773 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:47.402773 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 500/975] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:47.409458 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6db1c-141c-4b97-815e-b3dff4499063 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:47.432149 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:47.509887 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4877f7c0-b011-4551-acaa-552040810417 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:47.526824 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6db1c-141c-4b97-815e-b3dff4499063 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:47.548393 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abec381-18f4-4cb0-b1a1-7abe3013c9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:47.549028 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abec381-18f4-4cb0-b1a1-7abe3013c9e1 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:47.549307 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abec381-18f4-4cb0-b1a1-7abe3013c9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:47.549582 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abec381-18f4-4cb0-b1a1-7abe3013c9e1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:47.550361 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abec381-18f4-4cb0-b1a1-7abe3013c9e1 None admin] RBAC: Adding query filter params (interface=admin, service_id=6a938cd00d994daaa48a659359fffe55, region_id=RegionOne) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:47.550670 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abec381-18f4-4cb0-b1a1-7abe3013c9e1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:47.552269 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abec381-18f4-4cb0-b1a1-7abe3013c9e1 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:47.557717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 476/976] 10.222.0.60 () {56 vars in 1249 bytes} [Sun Jul 31 01:03:47 2022] GET /identity/v3/endpoints?service_id=6a938cd00d994daaa48a659359fffe55&interface=admin®ion_id=RegionOne => generated 193 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:47.563015 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abec381-18f4-4cb0-b1a1-7abe3013c9e1 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:47.565432 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7370440-7dcd-4408-ad15-344e2e70e6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:47.566071 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7370440-7dcd-4408-ad15-344e2e70e6d5 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:47.566350 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7370440-7dcd-4408-ad15-344e2e70e6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:47.566620 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7370440-7dcd-4408-ad15-344e2e70e6d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:47.567316 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7370440-7dcd-4408-ad15-344e2e70e6d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:47.567651 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7370440-7dcd-4408-ad15-344e2e70e6d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:47.569030 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7370440-7dcd-4408-ad15-344e2e70e6d5 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:47.581805 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 501/977] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:47.587411 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7370440-7dcd-4408-ad15-344e2e70e6d5 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:47.589497 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:47.669420 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:47.682604 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abec381-18f4-4cb0-b1a1-7abe3013c9e1 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:47.695165 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7370440-7dcd-4408-ad15-344e2e70e6d5 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:47.717278 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2535e84-cfa4-4dc8-9436-e3eedcf992dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:47.717922 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2535e84-cfa4-4dc8-9436-e3eedcf992dd None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:47.718203 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2535e84-cfa4-4dc8-9436-e3eedcf992dd None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:47.718472 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2535e84-cfa4-4dc8-9436-e3eedcf992dd None admin] PATH_INFO: `/v3/services` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:47.719378 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2535e84-cfa4-4dc8-9436-e3eedcf992dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:47.721152 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2535e84-cfa4-4dc8-9436-e3eedcf992dd None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:47.735235 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 477/978] 10.222.0.60 () {56 vars in 1087 bytes} [Sun Jul 31 01:03:47 2022] GET /identity/v3/services => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:03:47.735475 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd49bb-ba3c-4404-91cf-812bdfff4ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:47.735475 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd49bb-ba3c-4404-91cf-812bdfff4ffb None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:47.735475 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd49bb-ba3c-4404-91cf-812bdfff4ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:47.735475 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd49bb-ba3c-4404-91cf-812bdfff4ffb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:47.741793 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cd49bb-ba3c-4404-91cf-812bdfff4ffb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:47.743293 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cd49bb-ba3c-4404-91cf-812bdfff4ffb None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:47.757313 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-73cd49bb-ba3c-4404-91cf-812bdfff4ffb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 31 01:03:47.757313 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:47.757313 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:47.757313 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:47.757313 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:47.757313 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:47.757313 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:47.757313 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:47.757313 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:47.757313 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:47.757313 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:47.757313 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:47.757313 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:03:47.757313 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:03:47.757313 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:03:47.757313 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:03:47.758357 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:47.758357 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:47.758357 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:03:47.758357 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:47.758357 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:03:47.758357 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:47.758357 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:47.758357 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:47.758357 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:47.758357 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:47.758357 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:47.758357 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:47.758357 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:47.758357 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:47.758357 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:47.758357 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:47.758357 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:47.758357 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:47.759293 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:47.759293 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:47.759293 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:03:47.759293 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:03:47.759293 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:03:47.759293 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:03:47.759293 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:03:47.759293 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:03:47.759293 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 31 01:03:47.759293 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:47.759293 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 502/979] 10.222.0.60 () {56 vars in 1117 bytes} [Sun Jul 31 01:03:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:03:47.764833 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2535e84-cfa4-4dc8-9436-e3eedcf992dd None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:47.795650 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d8037-15d6-4ae6-ab61-dbe7211643d1 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:47.796108 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d8037-15d6-4ae6-ab61-dbe7211643d1 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:47.796387 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d8037-15d6-4ae6-ab61-dbe7211643d1 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:47.797868 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 503/980] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:03:47.803814 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76c860-121a-4e8a-bf5a-7c02d46c48a6 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:47.804093 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76c860-121a-4e8a-bf5a-7c02d46c48a6 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:47.804364 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76c860-121a-4e8a-bf5a-7c02d46c48a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:47.823909 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-fc76c860-121a-4e8a-bf5a-7c02d46c48a6 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:47.825183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-fc76c860-121a-4e8a-bf5a-7c02d46c48a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:47.868864 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:47.897081 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2535e84-cfa4-4dc8-9436-e3eedcf992dd None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:47.913258 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 504/981] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:03:47.936477 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc76c860-121a-4e8a-bf5a-7c02d46c48a6 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:47.938361 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b97eb-3440-4d14-97e0-240969cbfb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:47.939005 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b97eb-3440-4d14-97e0-240969cbfb39 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:47.939284 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b97eb-3440-4d14-97e0-240969cbfb39 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:47.939586 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b97eb-3440-4d14-97e0-240969cbfb39 None admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:47.940391 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1b97eb-3440-4d14-97e0-240969cbfb39 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:47.940697 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1b97eb-3440-4d14-97e0-240969cbfb39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:47.942128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1b97eb-3440-4d14-97e0-240969cbfb39 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:47.960878 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 478/982] 10.222.0.60 () {56 vars in 1149 bytes} [Sun Jul 31 01:03:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:47.966629 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b97eb-3440-4d14-97e0-240969cbfb39 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:48.007181 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:48.048131 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc76c860-121a-4e8a-bf5a-7c02d46c48a6 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:48.071506 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b97eb-3440-4d14-97e0-240969cbfb39 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:48.083580 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993de76-647a-4622-8d43-2361bf224be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:48.084216 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993de76-647a-4622-8d43-2361bf224be2 None admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:48.084491 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993de76-647a-4622-8d43-2361bf224be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:48.084763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993de76-647a-4622-8d43-2361bf224be2 None admin] PATH_INFO: `/v3/services` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:48.085455 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c993de76-647a-4622-8d43-2361bf224be2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:48.086835 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c993de76-647a-4622-8d43-2361bf224be2 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:48.107729 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 505/983] 10.222.0.60 () {60 vars in 1141 bytes} [Sun Jul 31 01:03:47 2022] POST /identity/v3/services => generated 242 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:03:48.129710 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e535c-9008-4aec-915c-9e45e0cad3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:48.130433 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e535c-9008-4aec-915c-9e45e0cad3bb None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:48.130717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e535c-9008-4aec-915c-9e45e0cad3bb None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:48.130988 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e535c-9008-4aec-915c-9e45e0cad3bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:48.135793 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:48.215021 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e535c-9008-4aec-915c-9e45e0cad3bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:48.215021 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e535c-9008-4aec-915c-9e45e0cad3bb None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:48.333112 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 479/984] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:03:47 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 31 01:03:48.338695 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993de76-647a-4622-8d43-2361bf224be2 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:48.459479 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993de76-647a-4622-8d43-2361bf224be2 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:48.498818 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:48.513381 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019464f-5160-47b3-9781-8affa221e4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:48.514055 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019464f-5160-47b3-9781-8affa221e4a2 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:48.514319 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019464f-5160-47b3-9781-8affa221e4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:48.514594 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019464f-5160-47b3-9781-8affa221e4a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:48.526486 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5019464f-5160-47b3-9781-8affa221e4a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:48.527988 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5019464f-5160-47b3-9781-8affa221e4a2 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:48.542750 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-5019464f-5160-47b3-9781-8affa221e4a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:48.542750 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:48.542750 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:48.542750 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:48.542750 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:48.542750 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:48.542750 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:48.542750 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:48.542750 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:48.542750 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:48.542750 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:48.542750 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:48.542750 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:48.542750 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:48.542750 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:48.544173 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:48.544173 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:48.544173 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:48.544173 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:48.544173 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:48.544173 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:48.544173 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:48.544173 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:48.544173 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:48.544173 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:48.544173 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:48.544173 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:48.544173 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:48.544173 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:48.544173 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:48.544173 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:48.544173 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:48.545076 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:48.545076 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:48.545076 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:48.545076 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:48.547575 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 506/985] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:48.549772 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e535c-9008-4aec-915c-9e45e0cad3bb None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:48.586095 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:48.659945 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e535c-9008-4aec-915c-9e45e0cad3bb None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:48.696260 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347aba4c-0045-4d22-9c9e-8097774a2ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:48.696892 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347aba4c-0045-4d22-9c9e-8097774a2ab4 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:48.697232 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347aba4c-0045-4d22-9c9e-8097774a2ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:48.697502 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347aba4c-0045-4d22-9c9e-8097774a2ab4 None admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:48.698205 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347aba4c-0045-4d22-9c9e-8097774a2ab4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:48.698502 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347aba4c-0045-4d22-9c9e-8097774a2ab4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:48.699952 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347aba4c-0045-4d22-9c9e-8097774a2ab4 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:48.712597 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 480/986] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:48.718272 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019464f-5160-47b3-9781-8affa221e4a2 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:48.828889 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019464f-5160-47b3-9781-8affa221e4a2 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:48.864668 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63255a-7a72-489b-93ff-7e3686ffc893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:48.865323 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63255a-7a72-489b-93ff-7e3686ffc893 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:48.865601 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63255a-7a72-489b-93ff-7e3686ffc893 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:48.865874 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63255a-7a72-489b-93ff-7e3686ffc893 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:48.873599 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63255a-7a72-489b-93ff-7e3686ffc893 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:48.875103 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63255a-7a72-489b-93ff-7e3686ffc893 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:48.888624 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-7a63255a-7a72-489b-93ff-7e3686ffc893 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:48.888624 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:48.888624 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:48.888624 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:48.888624 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:48.888624 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:48.888624 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:48.888624 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:48.888624 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:48.888624 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:48.888624 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:48.888624 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:48.888624 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:03:48.888624 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:03:48.888624 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:03:48.889740 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:03:48.889740 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:48.889740 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:48.889740 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:48.889740 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:48.889740 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:48.889740 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:48.889740 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:48.889740 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:48.889740 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:48.889740 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:48.889740 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:48.889740 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:48.889740 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:48.889740 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:48.889740 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:48.889740 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:48.895557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:03:48.895557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:03:48.895557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:03:48.895557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:03:48.895557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:03:48.895557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:03:48.895557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:48.895557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:48.895557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 507/987] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:03:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:48.898112 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347aba4c-0045-4d22-9c9e-8097774a2ab4 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:49.012469 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:49.020239 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347aba4c-0045-4d22-9c9e-8097774a2ab4 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:49.057286 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939b175-eaaf-4b02-abc8-bd4f4d6526b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:49.057926 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939b175-eaaf-4b02-abc8-bd4f4d6526b0 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:49.058206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939b175-eaaf-4b02-abc8-bd4f4d6526b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:49.058480 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939b175-eaaf-4b02-abc8-bd4f4d6526b0 None admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:49.059250 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5939b175-eaaf-4b02-abc8-bd4f4d6526b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:49.059669 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5939b175-eaaf-4b02-abc8-bd4f4d6526b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:49.061148 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5939b175-eaaf-4b02-abc8-bd4f4d6526b0 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:49.080015 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 481/988] 10.222.0.60 () {56 vars in 1148 bytes} [Sun Jul 31 01:03:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:03:49.080796 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63255a-7a72-489b-93ff-7e3686ffc893 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:49.124688 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:49.192303 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63255a-7a72-489b-93ff-7e3686ffc893 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:49.229592 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf412e2-eef1-4e55-885e-b33d382e797d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:49.230219 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf412e2-eef1-4e55-885e-b33d382e797d None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:49.230493 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf412e2-eef1-4e55-885e-b33d382e797d None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:49.230765 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf412e2-eef1-4e55-885e-b33d382e797d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:49.231583 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf412e2-eef1-4e55-885e-b33d382e797d None admin] RBAC: Adding query filter params (role.id=9687bf70551b48aaaef3e0187bb47d06, scope.project.id=b931b81a237949aa845891d4bb5aa1c0, user.id=02ed9040d575462db4b270a5b57063f2) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:49.231888 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf412e2-eef1-4e55-885e-b33d382e797d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:49.233333 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf412e2-eef1-4e55-885e-b33d382e797d None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:49.240627 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 508/989] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:03:49 2022] GET /identity/v3/role_assignments?user.id=02ed9040d575462db4b270a5b57063f2&scope.project.id=b931b81a237949aa845891d4bb5aa1c0&role.id=9687bf70551b48aaaef3e0187bb47d06 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:03:49.788011 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae622df-0257-4762-bb86-7a8593de466e None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:49.788593 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae622df-0257-4762-bb86-7a8593de466e None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:49.788593 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae622df-0257-4762-bb86-7a8593de466e None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:49.789876 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 482/990] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:49.795608 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea50c60-f7b3-4e3d-802e-a54ddab563de None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:49.796044 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea50c60-f7b3-4e3d-802e-a54ddab563de None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:49.796119 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea50c60-f7b3-4e3d-802e-a54ddab563de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:49.814317 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-6ea50c60-f7b3-4e3d-802e-a54ddab563de None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:49.815515 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-6ea50c60-f7b3-4e3d-802e-a54ddab563de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:49.888767 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 509/991] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:49 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:03:49.908424 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae622df-0257-4762-bb86-7a8593de466e None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:50.026412 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae622df-0257-4762-bb86-7a8593de466e None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:50.074023 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2649630e-1935-497c-a1e8-0d0147aad5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:50.074578 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649630e-1935-497c-a1e8-0d0147aad5ee None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:50.074857 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649630e-1935-497c-a1e8-0d0147aad5ee None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:50.075129 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649630e-1935-497c-a1e8-0d0147aad5ee None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:50.075825 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2649630e-1935-497c-a1e8-0d0147aad5ee None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:50.077221 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2649630e-1935-497c-a1e8-0d0147aad5ee None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:50.086976 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-2649630e-1935-497c-a1e8-0d0147aad5ee None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 01:03:50.086976 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:50.086976 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:03:50.086976 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:03:50.086976 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:03:50.086976 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:03:50.086976 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:03:50.086976 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:50.086976 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 01:03:50.086976 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:50.086976 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:03:50.086976 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:50.086976 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:50.086976 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:50.086976 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:50.086976 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:50.086976 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:50.088259 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:50.088259 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:50.088259 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:50.088259 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:50.088259 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:50.088259 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:50.088259 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:03:50.088259 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:03:50.088259 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:03:50.088259 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:03:50.088259 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:50.088259 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:50.088259 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:50.088259 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:50.088259 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:50.088259 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:50.089098 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:50.089098 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:50.089098 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:50.089098 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:50.089098 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:50.089098 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:50.089098 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:50.089098 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:50.089098 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:50.089098 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:50.089098 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:03:50.089098 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:50.089098 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 01:03:50.089098 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:50.090563 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 483/992] 10.222.0.60 () {56 vars in 1126 bytes} [Sun Jul 31 01:03:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:50.094387 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea50c60-f7b3-4e3d-802e-a54ddab563de None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:50.133485 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:50.152231 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d1078-c202-4708-becc-02271118d245 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:50.152583 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d1078-c202-4708-becc-02271118d245 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:50.152784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d1078-c202-4708-becc-02271118d245 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:50.154952 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 484/993] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:50.160206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53722d8d-c9ae-4dcc-bae7-daea61b2831d None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:50.160495 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53722d8d-c9ae-4dcc-bae7-daea61b2831d None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:50.160774 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53722d8d-c9ae-4dcc-bae7-daea61b2831d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:50.184485 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-53722d8d-c9ae-4dcc-bae7-daea61b2831d None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:50.186788 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-53722d8d-c9ae-4dcc-bae7-daea61b2831d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:50.202994 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:50.217202 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea50c60-f7b3-4e3d-802e-a54ddab563de None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:50.257775 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da030d-eb16-448c-ac45-a62dacb474c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:50.258409 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da030d-eb16-448c-ac45-a62dacb474c5 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:50.258687 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da030d-eb16-448c-ac45-a62dacb474c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:50.258957 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da030d-eb16-448c-ac45-a62dacb474c5 None admin] PATH_INFO: `/v3/services` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:50.259680 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da030d-eb16-448c-ac45-a62dacb474c5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:50.259979 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da030d-eb16-448c-ac45-a62dacb474c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:50.263541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 485/994] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:50 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:03:50.263702 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da030d-eb16-448c-ac45-a62dacb474c5 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:50.267147 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 510/995] 10.222.0.60 () {56 vars in 1122 bytes} [Sun Jul 31 01:03:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:03:50.272963 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53722d8d-c9ae-4dcc-bae7-daea61b2831d None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:50.283585 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da030d-eb16-448c-ac45-a62dacb474c5 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:50.393016 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53722d8d-c9ae-4dcc-bae7-daea61b2831d None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:50.409311 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:50.417434 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da030d-eb16-448c-ac45-a62dacb474c5 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:50.433324 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a764cd-7351-4103-8e58-59a88b734a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:50.433972 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a764cd-7351-4103-8e58-59a88b734a78 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:50.434252 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a764cd-7351-4103-8e58-59a88b734a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:50.434765 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a764cd-7351-4103-8e58-59a88b734a78 None admin] PATH_INFO: `/v3/services` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:50.435227 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a764cd-7351-4103-8e58-59a88b734a78 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:50.435599 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a764cd-7351-4103-8e58-59a88b734a78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:50.437042 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a764cd-7351-4103-8e58-59a88b734a78 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:50.442420 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 486/996] 10.222.0.60 () {56 vars in 1122 bytes} [Sun Jul 31 01:03:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:50.448296 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a764cd-7351-4103-8e58-59a88b734a78 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:50.455776 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2141fb1-5ed5-4a64-aa51-b3e13e84e5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:50.456438 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2141fb1-5ed5-4a64-aa51-b3e13e84e5fe None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:50.456712 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2141fb1-5ed5-4a64-aa51-b3e13e84e5fe None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:50.456982 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2141fb1-5ed5-4a64-aa51-b3e13e84e5fe None admin] PATH_INFO: `/v3/services/compute` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:50.457612 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2141fb1-5ed5-4a64-aa51-b3e13e84e5fe None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:50.459074 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2141fb1-5ed5-4a64-aa51-b3e13e84e5fe None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:50.465563 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:50.468579 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-c2141fb1-5ed5-4a64-aa51-b3e13e84e5fe None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 31 01:03:50.468579 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:50.468579 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:03:50.468579 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:03:50.468579 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:03:50.468579 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:03:50.468579 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:03:50.468579 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:50.468579 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 31 01:03:50.468579 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:50.468579 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:03:50.468579 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:50.468579 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:50.468579 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:50.468579 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:50.468579 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:50.468579 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:50.469840 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:50.469840 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:50.469840 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:50.469840 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:50.469840 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:50.469840 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:50.469840 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:03:50.469840 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:03:50.469840 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:03:50.469840 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:03:50.469840 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:50.469840 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:50.469840 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:50.469840 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:50.469840 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:50.469840 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:50.470698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:50.470698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:50.470698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:50.470698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:50.470698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:50.470698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:50.470698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:50.470698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:50.470698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:50.470698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:50.470698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:03:50.470698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:50.470698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 31 01:03:50.470698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:50.470698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 511/997] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:03:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:03:50.476338 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2141fb1-5ed5-4a64-aa51-b3e13e84e5fe None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:50.564390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a764cd-7351-4103-8e58-59a88b734a78 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:50.587109 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2141fb1-5ed5-4a64-aa51-b3e13e84e5fe None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:50.600120 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53789291-616d-42d5-9bee-51abb422eb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:50.600768 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53789291-616d-42d5-9bee-51abb422eb83 None admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:50.601038 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53789291-616d-42d5-9bee-51abb422eb83 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:50.601311 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53789291-616d-42d5-9bee-51abb422eb83 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:50.602028 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53789291-616d-42d5-9bee-51abb422eb83 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:50.603397 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53789291-616d-42d5-9bee-51abb422eb83 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:50.631521 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 487/998] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:03:50 2022] POST /identity/v3/endpoints => generated 325 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:03:50.641686 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4819d6-0012-4aec-8499-d158d6d7b7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:50.642337 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4819d6-0012-4aec-8499-d158d6d7b7c2 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:50.642613 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4819d6-0012-4aec-8499-d158d6d7b7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:50.642883 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4819d6-0012-4aec-8499-d158d6d7b7c2 None admin] PATH_INFO: `/v3/services` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:50.643649 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4819d6-0012-4aec-8499-d158d6d7b7c2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:50.643953 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4819d6-0012-4aec-8499-d158d6d7b7c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:50.645368 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4819d6-0012-4aec-8499-d158d6d7b7c2 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:50.657517 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 512/999] 10.222.0.60 () {56 vars in 1112 bytes} [Sun Jul 31 01:03:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:03:50.663906 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53789291-616d-42d5-9bee-51abb422eb83 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:50.751327 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:50.785514 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53789291-616d-42d5-9bee-51abb422eb83 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:50.837143 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b4581d-cbbf-40ba-8763-df8164e44b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:50.838116 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4581d-cbbf-40ba-8763-df8164e44b8d None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:50.838563 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4581d-cbbf-40ba-8763-df8164e44b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:50.838998 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4581d-cbbf-40ba-8763-df8164e44b8d None admin] PATH_INFO: `/v3/services` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:50.840179 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b4581d-cbbf-40ba-8763-df8164e44b8d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:50.840687 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b4581d-cbbf-40ba-8763-df8164e44b8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:50.843247 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b4581d-cbbf-40ba-8763-df8164e44b8d None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:50.851814 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 488/1000] 10.222.0.60 () {56 vars in 1112 bytes} [Sun Jul 31 01:03:50 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:50.857984 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4819d6-0012-4aec-8499-d158d6d7b7c2 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:50.883397 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:50.966114 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4819d6-0012-4aec-8499-d158d6d7b7c2 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:51.006896 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7f126-f453-4044-b07d-b2637e4edf8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:51.007564 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7f126-f453-4044-b07d-b2637e4edf8f None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:51.007841 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7f126-f453-4044-b07d-b2637e4edf8f None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:51.008111 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7f126-f453-4044-b07d-b2637e4edf8f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:51.008874 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7f126-f453-4044-b07d-b2637e4edf8f None admin] RBAC: Adding query filter params (interface=public, service_id=c1c9cc53507344bf8b6a303388e41772, region_id=RegionOne) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:51.009183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7f126-f453-4044-b07d-b2637e4edf8f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:51.010571 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7f126-f453-4044-b07d-b2637e4edf8f None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:51.016560 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 513/1001] 10.222.0.60 () {56 vars in 1251 bytes} [Sun Jul 31 01:03:50 2022] GET /identity/v3/endpoints?service_id=c1c9cc53507344bf8b6a303388e41772&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:51.021929 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b4581d-cbbf-40ba-8763-df8164e44b8d None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:51.128268 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b4581d-cbbf-40ba-8763-df8164e44b8d None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:51.167252 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d679bc8d-8f91-4e0e-b898-cf4641635106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:51.170166 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679bc8d-8f91-4e0e-b898-cf4641635106 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:51.170448 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679bc8d-8f91-4e0e-b898-cf4641635106 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:51.170723 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679bc8d-8f91-4e0e-b898-cf4641635106 None admin] PATH_INFO: `/v3/services` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:51.171406 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d679bc8d-8f91-4e0e-b898-cf4641635106 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:51.172830 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d679bc8d-8f91-4e0e-b898-cf4641635106 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:51.185002 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 489/1002] 10.222.0.60 () {56 vars in 1087 bytes} [Sun Jul 31 01:03:51 2022] GET /identity/v3/services => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:03:51.295678 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0deabe0-7edb-430f-8a23-e17ed15b08ef None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:51.295990 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0deabe0-7edb-430f-8a23-e17ed15b08ef None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:51.296445 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0deabe0-7edb-430f-8a23-e17ed15b08ef None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:51.298270 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 514/1003] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:51.304254 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f01b7-b616-4a18-8d2e-c2a8318c0fbe None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:51.304572 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f01b7-b616-4a18-8d2e-c2a8318c0fbe None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:51.304790 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f01b7-b616-4a18-8d2e-c2a8318c0fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:51.311803 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:51.326597 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-664f01b7-b616-4a18-8d2e-c2a8318c0fbe None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:51.327874 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-664f01b7-b616-4a18-8d2e-c2a8318c0fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:51.411520 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 490/1004] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:51 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:03:51.431309 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0deabe0-7edb-430f-8a23-e17ed15b08ef None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:51.527804 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:51.548950 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0deabe0-7edb-430f-8a23-e17ed15b08ef None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:51.609735 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e93553-1b6e-43d2-9874-784c1363c902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:51.610409 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e93553-1b6e-43d2-9874-784c1363c902 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:51.610686 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e93553-1b6e-43d2-9874-784c1363c902 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:51.610952 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e93553-1b6e-43d2-9874-784c1363c902 None admin] PATH_INFO: `/v3/services/image` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:51.611624 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e93553-1b6e-43d2-9874-784c1363c902 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:51.613006 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e93553-1b6e-43d2-9874-784c1363c902 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:51.622959 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-e5e93553-1b6e-43d2-9874-784c1363c902 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 31 01:03:51.622959 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:51.622959 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:03:51.622959 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:03:51.622959 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:03:51.622959 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:03:51.622959 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:03:51.622959 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:51.622959 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 31 01:03:51.622959 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:51.622959 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:03:51.622959 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:51.622959 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:51.622959 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:51.622959 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:51.622959 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:51.622959 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:51.624250 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:51.624250 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:51.624250 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:51.624250 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:51.624250 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:51.624250 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:51.624250 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:03:51.624250 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:03:51.624250 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:03:51.624250 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:03:51.624250 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:51.624250 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:51.624250 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:51.624250 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:51.624250 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:51.624250 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:51.625099 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:51.625099 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:51.625099 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:51.625099 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:51.625099 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:51.625099 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:51.625099 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:51.625099 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:51.625099 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:51.625099 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:51.625099 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:03:51.625099 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:51.625099 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 31 01:03:51.625099 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:51.626384 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 515/1005] 10.222.0.60 () {56 vars in 1105 bytes} [Sun Jul 31 01:03:51 2022] GET /identity/v3/services/image => generated 86 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:51.630637 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f01b7-b616-4a18-8d2e-c2a8318c0fbe None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:51.740670 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f01b7-b616-4a18-8d2e-c2a8318c0fbe None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:51.780978 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:51.787529 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135b3cc-d9a3-46ee-b8cd-e5a8d89785b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:51.788279 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135b3cc-d9a3-46ee-b8cd-e5a8d89785b9 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:51.788612 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135b3cc-d9a3-46ee-b8cd-e5a8d89785b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:51.788963 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135b3cc-d9a3-46ee-b8cd-e5a8d89785b9 None admin] PATH_INFO: `/v3/services` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:51.789728 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2135b3cc-d9a3-46ee-b8cd-e5a8d89785b9 None admin] RBAC: Adding query filter params (name=image) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:51.790099 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2135b3cc-d9a3-46ee-b8cd-e5a8d89785b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:51.791565 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2135b3cc-d9a3-46ee-b8cd-e5a8d89785b9 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:51.797608 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 491/1006] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:51.803216 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e93553-1b6e-43d2-9874-784c1363c902 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:51.909949 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e93553-1b6e-43d2-9874-784c1363c902 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:51.947043 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ae646-f06f-4aec-82b0-f5637ce7e795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:51.947703 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ae646-f06f-4aec-82b0-f5637ce7e795 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:51.947983 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ae646-f06f-4aec-82b0-f5637ce7e795 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:51.948250 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ae646-f06f-4aec-82b0-f5637ce7e795 None admin] PATH_INFO: `/v3/services` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:51.948914 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ae646-f06f-4aec-82b0-f5637ce7e795 None admin] RBAC: Adding query filter params (type=image) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:51.949212 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ae646-f06f-4aec-82b0-f5637ce7e795 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:51.950657 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ae646-f06f-4aec-82b0-f5637ce7e795 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:51.955884 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 516/1007] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:51 2022] GET /identity/v3/services?type=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:52.660097 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ffbc0-1875-4ef1-b28c-9c91cbc55d20 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:52.661336 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ffbc0-1875-4ef1-b28c-9c91cbc55d20 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:52.661336 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ffbc0-1875-4ef1-b28c-9c91cbc55d20 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:52.663536 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 492/1008] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:03:52.669004 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93da101-4e68-47c4-a2ce-e9ff64373d6f None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:52.669385 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93da101-4e68-47c4-a2ce-e9ff64373d6f None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:52.669759 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93da101-4e68-47c4-a2ce-e9ff64373d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:52.691015 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-a93da101-4e68-47c4-a2ce-e9ff64373d6f None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:52.692261 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-a93da101-4e68-47c4-a2ce-e9ff64373d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:52.701257 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:52.774420 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 517/1009] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:52 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:03:52.797520 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ffbc0-1875-4ef1-b28c-9c91cbc55d20 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:52.914487 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ffbc0-1875-4ef1-b28c-9c91cbc55d20 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:52.949877 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336475ce-6195-412b-9d67-608331f85c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:52.950570 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336475ce-6195-412b-9d67-608331f85c59 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:52.950843 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336475ce-6195-412b-9d67-608331f85c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:52.951108 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336475ce-6195-412b-9d67-608331f85c59 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:52.952297 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336475ce-6195-412b-9d67-608331f85c59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:52.953728 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336475ce-6195-412b-9d67-608331f85c59 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:52.955599 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 493/1010] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:52.961516 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93da101-4e68-47c4-a2ce-e9ff64373d6f None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:53.070809 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93da101-4e68-47c4-a2ce-e9ff64373d6f None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:53.108572 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509e3c2-7c89-4a96-9066-1784ddc9c88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:53.109225 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509e3c2-7c89-4a96-9066-1784ddc9c88e None admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:53.109660 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509e3c2-7c89-4a96-9066-1784ddc9c88e None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:53.109866 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509e3c2-7c89-4a96-9066-1784ddc9c88e None admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:53.110522 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3509e3c2-7c89-4a96-9066-1784ddc9c88e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:53.112013 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3509e3c2-7c89-4a96-9066-1784ddc9c88e None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:53.127638 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:53.147849 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 518/1011] 10.222.0.60 () {60 vars in 1141 bytes} [Sun Jul 31 01:03:52 2022] POST /identity/v3/projects => generated 311 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:03:53.277797 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c4e8f-865f-43a9-bc2c-d8d26fc8dbd0 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:53.278012 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c4e8f-865f-43a9-bc2c-d8d26fc8dbd0 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:53.278339 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c4e8f-865f-43a9-bc2c-d8d26fc8dbd0 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:53.279777 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 494/1012] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:53.285736 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5ba26-b1b6-45ad-8afd-76761c0c0688 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:53.286023 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5ba26-b1b6-45ad-8afd-76761c0c0688 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:53.286297 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5ba26-b1b6-45ad-8afd-76761c0c0688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:53.305844 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-b0d5ba26-b1b6-45ad-8afd-76761c0c0688 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:53.307047 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-b0d5ba26-b1b6-45ad-8afd-76761c0c0688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:53.385907 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 519/1013] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:53 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:03:53.408456 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c4e8f-865f-43a9-bc2c-d8d26fc8dbd0 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:53.476872 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:53.521289 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c4e8f-865f-43a9-bc2c-d8d26fc8dbd0 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:53.566307 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd39bb-15f9-4a27-92c9-2382bf527f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:53.566879 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd39bb-15f9-4a27-92c9-2382bf527f9f None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:53.567151 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd39bb-15f9-4a27-92c9-2382bf527f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:53.567413 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd39bb-15f9-4a27-92c9-2382bf527f9f None admin] PATH_INFO: `/v3/services/compute` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:53.568075 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd39bb-15f9-4a27-92c9-2382bf527f9f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:53.569435 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd39bb-15f9-4a27-92c9-2382bf527f9f None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:53.578884 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-34dd39bb-15f9-4a27-92c9-2382bf527f9f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 31 01:03:53.578884 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:53.578884 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:03:53.578884 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:03:53.578884 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:03:53.578884 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:03:53.578884 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:03:53.578884 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:53.578884 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 31 01:03:53.578884 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:53.578884 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:03:53.578884 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:53.578884 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:53.578884 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:53.578884 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:53.578884 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:53.578884 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:53.580137 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:53.580137 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:53.580137 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:53.580137 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:53.580137 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:53.580137 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:53.580137 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:03:53.580137 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:03:53.580137 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:03:53.580137 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:03:53.580137 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:53.580137 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:53.580137 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:53.580137 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:53.580137 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:53.580137 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:53.580984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:53.580984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:53.580984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:53.580984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:53.580984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:53.580984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:53.580984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:53.580984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:53.580984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:53.580984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:53.580984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:03:53.580984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:53.580984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 31 01:03:53.580984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:53.582179 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 495/1014] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:03:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:53.586428 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5ba26-b1b6-45ad-8afd-76761c0c0688 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:53.692847 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5ba26-b1b6-45ad-8afd-76761c0c0688 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:53.717882 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:53.731270 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74489a71-1b1d-42bd-bc47-7deaff3ca30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:53.731966 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74489a71-1b1d-42bd-bc47-7deaff3ca30b None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:53.732245 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74489a71-1b1d-42bd-bc47-7deaff3ca30b None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:53.732523 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74489a71-1b1d-42bd-bc47-7deaff3ca30b None admin] PATH_INFO: `/v3/services` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:53.733225 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74489a71-1b1d-42bd-bc47-7deaff3ca30b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:53.733524 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74489a71-1b1d-42bd-bc47-7deaff3ca30b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:53.734890 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74489a71-1b1d-42bd-bc47-7deaff3ca30b None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:53.741629 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 520/1015] 10.222.0.60 () {56 vars in 1112 bytes} [Sun Jul 31 01:03:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:53.747516 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd39bb-15f9-4a27-92c9-2382bf527f9f None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:53.851724 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd39bb-15f9-4a27-92c9-2382bf527f9f None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:53.879432 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:53.891770 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835e89c-7c64-4b6a-909f-933e4297c98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:53.892407 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835e89c-7c64-4b6a-909f-933e4297c98d None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:53.892699 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835e89c-7c64-4b6a-909f-933e4297c98d None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:53.892966 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835e89c-7c64-4b6a-909f-933e4297c98d None admin] PATH_INFO: `/v3/services` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:53.893667 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5835e89c-7c64-4b6a-909f-933e4297c98d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:53.893956 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5835e89c-7c64-4b6a-909f-933e4297c98d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:53.895365 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5835e89c-7c64-4b6a-909f-933e4297c98d None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:53.901607 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 496/1016] 10.222.0.60 () {56 vars in 1112 bytes} [Sun Jul 31 01:03:53 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:53.907444 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74489a71-1b1d-42bd-bc47-7deaff3ca30b None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:53.977755 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc38bd-1f59-496f-a8d0-9f8a8acaa261 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:53.978090 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc38bd-1f59-496f-a8d0-9f8a8acaa261 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:53.978294 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc38bd-1f59-496f-a8d0-9f8a8acaa261 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:53.979808 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 497/1017] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:03:53.984859 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc196346-8cf0-4a23-a390-8bf1a9d335bf None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:53.985126 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc196346-8cf0-4a23-a390-8bf1a9d335bf None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:53.985410 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc196346-8cf0-4a23-a390-8bf1a9d335bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:54.006950 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-dc196346-8cf0-4a23-a390-8bf1a9d335bf None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:54.008174 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-dc196346-8cf0-4a23-a390-8bf1a9d335bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:54.020764 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74489a71-1b1d-42bd-bc47-7deaff3ca30b None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:54.066758 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25996d6-74ce-4222-ac8c-2d6699906aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:54.067771 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25996d6-74ce-4222-ac8c-2d6699906aec None admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:54.068191 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25996d6-74ce-4222-ac8c-2d6699906aec None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:54.068645 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25996d6-74ce-4222-ac8c-2d6699906aec None admin] PATH_INFO: `/v3/endpoints` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:54.069523 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25996d6-74ce-4222-ac8c-2d6699906aec None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:54.071423 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25996d6-74ce-4222-ac8c-2d6699906aec None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:54.096576 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 521/1018] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:03:53 2022] POST /identity/v3/endpoints => generated 334 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:03:54.108065 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 498/1019] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:53 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:03:54.134975 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25996d6-74ce-4222-ac8c-2d6699906aec None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:54.196533 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:54.269259 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25996d6-74ce-4222-ac8c-2d6699906aec None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:54.306619 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2084d093-26d1-4ca3-a44d-27aede35468a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:54.307267 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084d093-26d1-4ca3-a44d-27aede35468a None admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:54.307578 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084d093-26d1-4ca3-a44d-27aede35468a None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:54.307959 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084d093-26d1-4ca3-a44d-27aede35468a None admin] PATH_INFO: `/v3/services` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:54.308576 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2084d093-26d1-4ca3-a44d-27aede35468a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:54.314313 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2084d093-26d1-4ca3-a44d-27aede35468a None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:54.340609 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 522/1020] 10.222.0.60 () {60 vars in 1141 bytes} [Sun Jul 31 01:03:54 2022] POST /identity/v3/services => generated 242 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:03:55.236981 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55516e26-ce7c-4b4d-840f-5af85ec517be None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:55.237568 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55516e26-ce7c-4b4d-840f-5af85ec517be None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:55.237568 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55516e26-ce7c-4b4d-840f-5af85ec517be None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:55.239101 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 499/1021] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:55.244123 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc052b13-9f53-4305-9921-e69df80a6b78 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:55.244529 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc052b13-9f53-4305-9921-e69df80a6b78 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:55.244622 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc052b13-9f53-4305-9921-e69df80a6b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:55.263877 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-fc052b13-9f53-4305-9921-e69df80a6b78 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:55.265042 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-fc052b13-9f53-4305-9921-e69df80a6b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:55.347852 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 523/1022] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:03:55.366359 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55516e26-ce7c-4b4d-840f-5af85ec517be None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:55.475408 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55516e26-ce7c-4b4d-840f-5af85ec517be None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:55.499318 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:55.513087 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501dadfe-a2b5-4bd1-bc60-a9a0ce7b9763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:55.513736 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501dadfe-a2b5-4bd1-bc60-a9a0ce7b9763 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:55.514011 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501dadfe-a2b5-4bd1-bc60-a9a0ce7b9763 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:55.514280 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501dadfe-a2b5-4bd1-bc60-a9a0ce7b9763 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:55.515443 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501dadfe-a2b5-4bd1-bc60-a9a0ce7b9763 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:55.516921 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501dadfe-a2b5-4bd1-bc60-a9a0ce7b9763 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:55.518741 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 500/1023] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:55.524401 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc052b13-9f53-4305-9921-e69df80a6b78 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:55.561835 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:55.677844 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc052b13-9f53-4305-9921-e69df80a6b78 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:55.736755 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b19c5-695b-40af-9f17-73669a4583c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:55.737388 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b19c5-695b-40af-9f17-73669a4583c7 None admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:55.737661 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b19c5-695b-40af-9f17-73669a4583c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:55.737922 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b19c5-695b-40af-9f17-73669a4583c7 None admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:55.738606 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b19c5-695b-40af-9f17-73669a4583c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:55.740089 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b19c5-695b-40af-9f17-73669a4583c7 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:55.770257 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 524/1024] 10.222.0.60 () {60 vars in 1132 bytes} [Sun Jul 31 01:03:55 2022] POST /identity/v3/users => generated 285 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:03:56.237557 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e899120-17f9-4be3-a6e3-6823bb72eaa6 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:56.238115 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e899120-17f9-4be3-a6e3-6823bb72eaa6 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:56.238115 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e899120-17f9-4be3-a6e3-6823bb72eaa6 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:56.239637 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 501/1025] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:56.245149 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b87b80-511d-493f-8b72-aaa4775c09d2 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:56.245591 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b87b80-511d-493f-8b72-aaa4775c09d2 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:56.245666 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b87b80-511d-493f-8b72-aaa4775c09d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:56.265515 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-10b87b80-511d-493f-8b72-aaa4775c09d2 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:56.266684 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-10b87b80-511d-493f-8b72-aaa4775c09d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:56.336628 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 525/1026] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:56 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:03:56.359576 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e899120-17f9-4be3-a6e3-6823bb72eaa6 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:56.421841 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fbbbe7-1e09-4571-9fe9-dca1355dd45b None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:56.422146 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fbbbe7-1e09-4571-9fe9-dca1355dd45b None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:56.422391 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fbbbe7-1e09-4571-9fe9-dca1355dd45b None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:56.424044 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 526/1027] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:03:56.429192 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73439a-57db-4c94-84e5-76ea3ad472fe None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:56.429475 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73439a-57db-4c94-84e5-76ea3ad472fe None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:56.429747 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73439a-57db-4c94-84e5-76ea3ad472fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:56.447738 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-fe73439a-57db-4c94-84e5-76ea3ad472fe None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:56.448933 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-fe73439a-57db-4c94-84e5-76ea3ad472fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:56.456744 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:56.474030 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e899120-17f9-4be3-a6e3-6823bb72eaa6 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:56.512728 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d92a70-7a97-4493-80e9-f970c2eb9267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:56.513374 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d92a70-7a97-4493-80e9-f970c2eb9267 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:56.513645 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d92a70-7a97-4493-80e9-f970c2eb9267 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:56.513897 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d92a70-7a97-4493-80e9-f970c2eb9267 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:56.525121 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d92a70-7a97-4493-80e9-f970c2eb9267 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:03:56.525426 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 527/1028] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:56 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:03:56.530667 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-f0d92a70-7a97-4493-80e9-f970c2eb9267 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 31 01:03:56.530667 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:56.530667 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:56.530667 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:56.530667 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:56.530667 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:56.530667 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:56.530667 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:56.530667 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:56.530667 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:56.530667 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:56.530667 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:56.530667 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:03:56.530667 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:03:56.530667 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:03:56.530667 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:03:56.531704 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:03:56.531704 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:03:56.531704 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:03:56.531704 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:03:56.531704 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:56.531704 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:56.531704 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:56.531704 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:56.531704 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:56.531704 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:56.531704 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:56.531704 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:56.531704 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:56.531704 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:56.531704 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:56.531704 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:56.532645 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:56.532645 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:56.532645 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:56.532645 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:56.532645 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:03:56.532645 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:03:56.532645 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:03:56.532645 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:03:56.532645 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:03:56.532645 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:03:56.532645 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 31 01:03:56.532645 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:56.534010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 502/1029] 10.222.0.60 () {56 vars in 1120 bytes} [Sun Jul 31 01:03:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:56.540111 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe73439a-57db-4c94-84e5-76ea3ad472fe None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:56.549621 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d92a70-7a97-4493-80e9-f970c2eb9267 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:56.607184 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:56.649444 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe73439a-57db-4c94-84e5-76ea3ad472fe None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:56.662086 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d92a70-7a97-4493-80e9-f970c2eb9267 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:56.688124 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ec596-980a-40ee-9a21-faeb7878d2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:56.688759 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ec596-980a-40ee-9a21-faeb7878d2d2 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:56.689039 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ec596-980a-40ee-9a21-faeb7878d2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:56.689311 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ec596-980a-40ee-9a21-faeb7878d2d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:56.690032 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08ec596-980a-40ee-9a21-faeb7878d2d2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:56.690337 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08ec596-980a-40ee-9a21-faeb7878d2d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:56.691756 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08ec596-980a-40ee-9a21-faeb7878d2d2 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:56.699875 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae496ef-0a65-4b7d-9dff-867b93177891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:56.700832 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae496ef-0a65-4b7d-9dff-867b93177891 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:56.700944 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 528/1030] 10.222.0.60 () {56 vars in 1115 bytes} [Sun Jul 31 01:03:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:56.701024 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae496ef-0a65-4b7d-9dff-867b93177891 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:56.701262 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae496ef-0a65-4b7d-9dff-867b93177891 None admin] PATH_INFO: `/v3/services/image` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:56.701969 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae496ef-0a65-4b7d-9dff-867b93177891 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:56.703603 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae496ef-0a65-4b7d-9dff-867b93177891 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:56.706328 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ec596-980a-40ee-9a21-faeb7878d2d2 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:56.712746 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:56.713923 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-cae496ef-0a65-4b7d-9dff-867b93177891 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 31 01:03:56.713923 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:56.713923 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:03:56.713923 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:03:56.713923 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:03:56.713923 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:03:56.713923 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:03:56.713923 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:56.713923 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 31 01:03:56.713923 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:56.713923 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:03:56.713923 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:56.713923 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:56.713923 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:56.713923 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:56.713923 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:56.713923 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:56.714907 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:56.714907 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:56.714907 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:56.714907 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:56.714907 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:56.714907 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:56.714907 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:03:56.714907 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:03:56.714907 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:03:56.714907 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:03:56.714907 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:56.714907 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:56.714907 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:56.714907 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:56.714907 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:56.714907 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:56.721030 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:56.721030 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:56.721030 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:56.721030 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:56.721030 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:56.721030 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:56.721030 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:56.721030 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:56.721030 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:56.721030 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:56.721030 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:03:56.721030 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:56.721030 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 31 01:03:56.721030 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:56.721030 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 503/1031] 10.222.0.60 () {56 vars in 1105 bytes} [Sun Jul 31 01:03:56 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:56.721871 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae496ef-0a65-4b7d-9dff-867b93177891 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:56.828169 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ec596-980a-40ee-9a21-faeb7878d2d2 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:56.836725 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae496ef-0a65-4b7d-9dff-867b93177891 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:56.852718 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:56.862155 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9bc0aa-4369-4f00-9796-853b16a10ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:56.862809 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9bc0aa-4369-4f00-9796-853b16a10ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:56.863086 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9bc0aa-4369-4f00-9796-853b16a10ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:56.863359 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9bc0aa-4369-4f00-9796-853b16a10ad2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:56.874380 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9bc0aa-4369-4f00-9796-853b16a10ad2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:56.875839 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902a8ba-483c-4e96-9249-b4764c176d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:56.875966 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9bc0aa-4369-4f00-9796-853b16a10ad2 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:56.876833 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902a8ba-483c-4e96-9249-b4764c176d7b None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:56.877549 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902a8ba-483c-4e96-9249-b4764c176d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:56.878181 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902a8ba-483c-4e96-9249-b4764c176d7b None admin] PATH_INFO: `/v3/services` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:56.879770 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b902a8ba-483c-4e96-9249-b4764c176d7b None admin] RBAC: Adding query filter params (name=image) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:56.880084 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b902a8ba-483c-4e96-9249-b4764c176d7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:56.881472 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b902a8ba-483c-4e96-9249-b4764c176d7b None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:56.892834 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 504/1032] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:56.893003 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-0c9bc0aa-4369-4f00-9796-853b16a10ad2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:56.893003 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:56.893003 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:56.893003 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:56.893003 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:56.893003 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:56.893003 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:56.893003 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:56.893003 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:56.893003 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:56.893003 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:56.893003 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:56.893003 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:56.893003 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:56.893003 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:56.893822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:56.893822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:56.893822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:56.893822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:56.893822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:56.893822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:56.893822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:56.893822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:56.893822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:56.893822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:56.893822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:56.893822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:56.893822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:56.893822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:56.893822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:56.893822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:56.893822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:56.894711 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:56.894711 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:56.894711 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:56.894711 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:56.894711 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 529/1033] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:03:56.894981 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902a8ba-483c-4e96-9249-b4764c176d7b None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:56.900961 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9bc0aa-4369-4f00-9796-853b16a10ad2 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:56.970841 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:57.027388 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9bc0aa-4369-4f00-9796-853b16a10ad2 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:57.030281 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902a8ba-483c-4e96-9249-b4764c176d7b None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:57.064767 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f1920-557d-44ee-8673-dfa3ecf27879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:57.065399 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f1920-557d-44ee-8673-dfa3ecf27879 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:57.065674 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f1920-557d-44ee-8673-dfa3ecf27879 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:57.065943 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f1920-557d-44ee-8673-dfa3ecf27879 None admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:57.066521 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c2ba1-2a2a-413d-accd-5c4e2a490699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:57.066647 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f1920-557d-44ee-8673-dfa3ecf27879 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:57.066921 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f1920-557d-44ee-8673-dfa3ecf27879 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:57.067152 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c2ba1-2a2a-413d-accd-5c4e2a490699 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:57.067430 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c2ba1-2a2a-413d-accd-5c4e2a490699 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:57.067734 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c2ba1-2a2a-413d-accd-5c4e2a490699 None admin] PATH_INFO: `/v3/services` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:57.068319 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f1920-557d-44ee-8673-dfa3ecf27879 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:57.068428 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c2ba1-2a2a-413d-accd-5c4e2a490699 None admin] RBAC: Adding query filter params (type=image) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:57.068717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c2ba1-2a2a-413d-accd-5c4e2a490699 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:57.070196 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c2ba1-2a2a-413d-accd-5c4e2a490699 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:57.075801 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 505/1034] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:56 2022] GET /identity/v3/services?type=image => generated 350 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:03:57.082930 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c2ba1-2a2a-413d-accd-5c4e2a490699 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:57.085884 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 530/1035] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:57.091391 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f1920-557d-44ee-8673-dfa3ecf27879 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:57.146974 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:57.201339 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f1920-557d-44ee-8673-dfa3ecf27879 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:57.217596 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c2ba1-2a2a-413d-accd-5c4e2a490699 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:57.221380 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:57.240476 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe3df3-e60b-4442-9e4c-c81457f8f4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:57.241161 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe3df3-e60b-4442-9e4c-c81457f8f4d5 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:57.241483 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe3df3-e60b-4442-9e4c-c81457f8f4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:57.241833 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe3df3-e60b-4442-9e4c-c81457f8f4d5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:57.249673 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe3df3-e60b-4442-9e4c-c81457f8f4d5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:57.251183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe3df3-e60b-4442-9e4c-c81457f8f4d5 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:57.257051 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a22921-746a-48ef-a775-d34bd14894e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:57.257735 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a22921-746a-48ef-a775-d34bd14894e0 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:57.258023 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a22921-746a-48ef-a775-d34bd14894e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:57.258306 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a22921-746a-48ef-a775-d34bd14894e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:57.259019 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a22921-746a-48ef-a775-d34bd14894e0 None admin] RBAC: Adding query filter params (interface=public, service_id=86ce8f8a6b4a4d628cca10a3b17b6ab6, region_id=RegionOne) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:57.259322 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a22921-746a-48ef-a775-d34bd14894e0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:57.260745 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a22921-746a-48ef-a775-d34bd14894e0 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:57.264396 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-75fe3df3-e60b-4442-9e4c-c81457f8f4d5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:03:57.264396 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:57.264396 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:57.264396 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:57.264396 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:57.264396 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:57.264396 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:57.264396 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:57.264396 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:57.264396 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:57.264396 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:57.264396 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:57.264396 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:03:57.264396 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:03:57.264396 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:03:57.264396 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:03:57.265374 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:57.265374 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:57.265374 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:03:57.265374 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:57.265374 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:03:57.265374 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:03:57.265374 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:57.265374 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:57.265374 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:57.265374 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:57.265374 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:57.265374 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:57.265374 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:57.265374 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:57.265374 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:57.265374 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:57.265374 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:57.265374 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:57.266318 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:57.266318 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:57.266318 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:03:57.266318 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:03:57.266318 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:03:57.266318 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:03:57.266318 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:03:57.266318 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:03:57.266318 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:03:57.266318 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:57.273990 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 506/1036] 10.222.0.60 () {56 vars in 1251 bytes} [Sun Jul 31 01:03:57 2022] GET /identity/v3/endpoints?service_id=86ce8f8a6b4a4d628cca10a3b17b6ab6&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:03:57.274166 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 531/1037] 10.222.0.60 () {56 vars in 1093 bytes} [Sun Jul 31 01:03:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:57.274246 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a22921-746a-48ef-a775-d34bd14894e0 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:57.274986 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe3df3-e60b-4442-9e4c-c81457f8f4d5 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:57.387770 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a22921-746a-48ef-a775-d34bd14894e0 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:57.391153 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe3df3-e60b-4442-9e4c-c81457f8f4d5 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:57.395996 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:57.426816 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf19684-0b1e-49a4-8e6e-c407414eab73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:57.427785 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b950e3-b662-415a-a564-d8c4a0eb3ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:57.427985 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf19684-0b1e-49a4-8e6e-c407414eab73 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:57.428401 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf19684-0b1e-49a4-8e6e-c407414eab73 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:57.428513 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b950e3-b662-415a-a564-d8c4a0eb3ce1 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:57.428679 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b950e3-b662-415a-a564-d8c4a0eb3ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:57.428948 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b950e3-b662-415a-a564-d8c4a0eb3ce1 None admin] PATH_INFO: `/v3/services` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:57.429220 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf19684-0b1e-49a4-8e6e-c407414eab73 None admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:57.429600 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b950e3-b662-415a-a564-d8c4a0eb3ce1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:57.430323 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf19684-0b1e-49a4-8e6e-c407414eab73 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:57.430769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf19684-0b1e-49a4-8e6e-c407414eab73 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:57.430971 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b950e3-b662-415a-a564-d8c4a0eb3ce1 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:57.432600 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf19684-0b1e-49a4-8e6e-c407414eab73 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:57.438151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 532/1038] 10.222.0.60 () {56 vars in 1087 bytes} [Sun Jul 31 01:03:57 2022] GET /identity/v3/services => generated 1957 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:03:57.453764 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 507/1039] 10.222.0.60 () {56 vars in 1133 bytes} [Sun Jul 31 01:03:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:03:57.459910 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b950e3-b662-415a-a564-d8c4a0eb3ce1 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:57.508932 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:57.576847 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b950e3-b662-415a-a564-d8c4a0eb3ce1 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:57.619333 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da819904-9896-4e0b-ae07-796b79fdd07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:57.620037 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da819904-9896-4e0b-ae07-796b79fdd07a None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:57.620315 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da819904-9896-4e0b-ae07-796b79fdd07a None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:57.620588 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da819904-9896-4e0b-ae07-796b79fdd07a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:57.693294 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da819904-9896-4e0b-ae07-796b79fdd07a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:57.694777 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da819904-9896-4e0b-ae07-796b79fdd07a None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:57.737501 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:57.814977 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 533/1040] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:03:57 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:03:57.816581 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf19684-0b1e-49a4-8e6e-c407414eab73 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:57.856452 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64282d46-d5fc-48de-9194-19d313973e13 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:57.856839 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64282d46-d5fc-48de-9194-19d313973e13 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:57.857019 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64282d46-d5fc-48de-9194-19d313973e13 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:57.858574 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 534/1041] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:03:57.864027 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f2931-3cff-43b0-a309-b3c52758cb84 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:57.864303 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f2931-3cff-43b0-a309-b3c52758cb84 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:57.864571 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f2931-3cff-43b0-a309-b3c52758cb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:57.884095 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-9e0f2931-3cff-43b0-a309-b3c52758cb84 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:57.885214 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-9e0f2931-3cff-43b0-a309-b3c52758cb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:57.943562 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf19684-0b1e-49a4-8e6e-c407414eab73 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:57.991059 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 535/1042] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:03:57.991266 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cead62-222e-4437-ae48-4d4a5f3aba69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:57.991266 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cead62-222e-4437-ae48-4d4a5f3aba69 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:57.991266 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cead62-222e-4437-ae48-4d4a5f3aba69 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:57.991266 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cead62-222e-4437-ae48-4d4a5f3aba69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:58.006041 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cead62-222e-4437-ae48-4d4a5f3aba69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:58.006924 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f2931-3cff-43b0-a309-b3c52758cb84 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:58.007540 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cead62-222e-4437-ae48-4d4a5f3aba69 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:58.025496 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-f7cead62-222e-4437-ae48-4d4a5f3aba69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:58.025496 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:58.025496 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:58.025496 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:58.025496 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:58.025496 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:58.025496 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:58.025496 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:58.025496 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:58.025496 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:58.025496 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:58.025496 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:58.025496 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:03:58.025496 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:03:58.025496 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:03:58.026478 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:03:58.026478 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:58.026478 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:58.026478 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:58.026478 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:58.026478 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:58.026478 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:58.026478 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:58.026478 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:58.026478 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:58.026478 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:58.026478 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:58.026478 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:58.026478 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:58.026478 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:58.026478 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:58.026478 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:58.027719 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:03:58.027719 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:03:58.027719 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:03:58.027719 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:58.027719 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 508/1043] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:58.035855 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cead62-222e-4437-ae48-4d4a5f3aba69 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:58.056423 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:58.095455 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:58.139097 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f2931-3cff-43b0-a309-b3c52758cb84 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:58.154965 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cead62-222e-4437-ae48-4d4a5f3aba69 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:58.176228 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81394f-9466-4423-a9d0-924d1ace1071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:58.176880 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81394f-9466-4423-a9d0-924d1ace1071 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:58.177161 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81394f-9466-4423-a9d0-924d1ace1071 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:58.177433 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81394f-9466-4423-a9d0-924d1ace1071 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:58.188135 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81394f-9466-4423-a9d0-924d1ace1071 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:03:58.193081 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-3c81394f-9466-4423-a9d0-924d1ace1071 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:03:58.193081 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:58.193081 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:58.193081 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:58.193081 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:58.193081 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:58.193081 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:58.193081 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:58.193081 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:58.193081 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:58.193081 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:58.193081 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:58.193081 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:03:58.193081 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:03:58.193081 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:03:58.193081 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:03:58.194002 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:03:58.194002 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:03:58.194002 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:03:58.194002 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:03:58.194002 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:58.194002 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:58.194002 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:58.194002 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:58.194002 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:58.194002 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:58.194002 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:58.194002 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:58.194002 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:58.194002 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:58.194002 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:58.194002 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:58.194864 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:58.194864 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:58.194864 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:58.194864 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:58.194864 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:03:58.194864 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:03:58.194864 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:03:58.194864 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:03:58.194864 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:03:58.194864 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:03:58.194864 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:03:58.194864 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:03:58.194864 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 536/1044] 10.222.0.60 () {56 vars in 1096 bytes} [Sun Jul 31 01:03:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:03:58.200373 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81394f-9466-4423-a9d0-924d1ace1071 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:58.202915 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fdd23f-4495-4493-8d86-ba7ad91dee44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:58.203596 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdd23f-4495-4493-8d86-ba7ad91dee44 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:58.203877 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdd23f-4495-4493-8d86-ba7ad91dee44 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:58.204151 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdd23f-4495-4493-8d86-ba7ad91dee44 None admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:58.204861 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fdd23f-4495-4493-8d86-ba7ad91dee44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:58.205165 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fdd23f-4495-4493-8d86-ba7ad91dee44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:58.206531 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fdd23f-4495-4493-8d86-ba7ad91dee44 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:58.224212 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 509/1045] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:03:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:03:58.225234 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fdd23f-4495-4493-8d86-ba7ad91dee44 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:58.302154 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:58.315029 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81394f-9466-4423-a9d0-924d1ace1071 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:58.325779 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fdd23f-4495-4493-8d86-ba7ad91dee44 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:58.344149 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:58.350629 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870260a3-efee-410f-b6e9-43eaae2d337c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:58.351260 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870260a3-efee-410f-b6e9-43eaae2d337c None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:58.351652 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870260a3-efee-410f-b6e9-43eaae2d337c None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:58.351898 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870260a3-efee-410f-b6e9-43eaae2d337c None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:58.352544 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870260a3-efee-410f-b6e9-43eaae2d337c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:58.352845 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870260a3-efee-410f-b6e9-43eaae2d337c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:58.356624 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870260a3-efee-410f-b6e9-43eaae2d337c None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:58.368382 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113f246-a5ec-4292-b91c-42ed4be1338a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:58.369039 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113f246-a5ec-4292-b91c-42ed4be1338a None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:58.369319 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113f246-a5ec-4292-b91c-42ed4be1338a None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:58.369594 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113f246-a5ec-4292-b91c-42ed4be1338a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:58.371070 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 537/1046] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:03:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:58.377680 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870260a3-efee-410f-b6e9-43eaae2d337c None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:58.377860 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113f246-a5ec-4292-b91c-42ed4be1338a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:58.379206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113f246-a5ec-4292-b91c-42ed4be1338a None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:58.390952 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-7113f246-a5ec-4292-b91c-42ed4be1338a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:58.390952 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:58.390952 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:58.390952 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:58.390952 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:58.390952 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:58.390952 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:58.390952 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:58.390952 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:58.390952 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:58.390952 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:58.390952 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:58.390952 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:03:58.390952 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:03:58.390952 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:03:58.392112 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:03:58.392112 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:58.392112 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:58.392112 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:58.392112 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:58.392112 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:58.392112 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:58.392112 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:58.392112 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:58.392112 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:58.392112 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:58.392112 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:58.392112 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:58.392112 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:58.392112 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:58.392112 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:58.392112 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:58.393538 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:03:58.393538 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:03:58.393538 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:03:58.393538 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:03:58.393538 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:03:58.393538 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:03:58.393538 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:03:58.393538 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:58.393538 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 510/1047] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:03:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:03:58.400303 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113f246-a5ec-4292-b91c-42ed4be1338a None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:58.490623 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870260a3-efee-410f-b6e9-43eaae2d337c None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:58.515226 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113f246-a5ec-4292-b91c-42ed4be1338a None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:58.525239 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8978b50-3e54-4be6-aa81-7fc1414e2eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:58.525889 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8978b50-3e54-4be6-aa81-7fc1414e2eda None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:58.526215 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8978b50-3e54-4be6-aa81-7fc1414e2eda None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:58.526489 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8978b50-3e54-4be6-aa81-7fc1414e2eda None admin] PATH_INFO: `/v3/users/e54b008fb4d44cbaa2455bba7e381b67` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:58.540451 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8978b50-3e54-4be6-aa81-7fc1414e2eda None admin] RBAC: Authorizing `identity:get_user(user_id=e54b008fb4d44cbaa2455bba7e381b67)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:58.541892 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8978b50-3e54-4be6-aa81-7fc1414e2eda None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:58.548573 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 538/1048] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:03:58 2022] GET /identity/v3/users/e54b008fb4d44cbaa2455bba7e381b67 => generated 285 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:58.549346 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8978b50-3e54-4be6-aa81-7fc1414e2eda None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:58.556056 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6ccfc-057b-4cb1-bcb3-675ab9fed907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:58.556715 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6ccfc-057b-4cb1-bcb3-675ab9fed907 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:58.556999 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6ccfc-057b-4cb1-bcb3-675ab9fed907 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:58.557274 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6ccfc-057b-4cb1-bcb3-675ab9fed907 None admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:58.558046 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e6ccfc-057b-4cb1-bcb3-675ab9fed907 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:58.558356 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e6ccfc-057b-4cb1-bcb3-675ab9fed907 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:58.559930 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e6ccfc-057b-4cb1-bcb3-675ab9fed907 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:58.565459 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:58.591468 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 511/1049] 10.222.0.60 () {56 vars in 1148 bytes} [Sun Jul 31 01:03:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:58.593316 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6ccfc-057b-4cb1-bcb3-675ab9fed907 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:58.617200 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:58.683426 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8978b50-3e54-4be6-aa81-7fc1414e2eda None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:58.722578 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6ccfc-057b-4cb1-bcb3-675ab9fed907 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:58.730353 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340000a-0da5-4b49-9f0e-0572f4803a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:58.731051 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340000a-0da5-4b49-9f0e-0572f4803a1f None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:58.737432 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340000a-0da5-4b49-9f0e-0572f4803a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:58.737981 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340000a-0da5-4b49-9f0e-0572f4803a1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:58.774305 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef047c5-7504-4745-b2a9-47079a9ee3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:58.775262 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef047c5-7504-4745-b2a9-47079a9ee3c1 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:58.775894 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef047c5-7504-4745-b2a9-47079a9ee3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:58.776261 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef047c5-7504-4745-b2a9-47079a9ee3c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:58.777353 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef047c5-7504-4745-b2a9-47079a9ee3c1 None admin] RBAC: Adding query filter params (role.id=9687bf70551b48aaaef3e0187bb47d06, scope.project.id=b931b81a237949aa845891d4bb5aa1c0, user.id=04591cd035ef4961b8b7a93e294eb881) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:58.777790 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef047c5-7504-4745-b2a9-47079a9ee3c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:58.780359 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef047c5-7504-4745-b2a9-47079a9ee3c1 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:58.790256 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 512/1050] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:03:58 2022] GET /identity/v3/role_assignments?user.id=04591cd035ef4961b8b7a93e294eb881&scope.project.id=b931b81a237949aa845891d4bb5aa1c0&role.id=9687bf70551b48aaaef3e0187bb47d06 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:03:58.835742 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8340000a-0da5-4b49-9f0e-0572f4803a1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:58.837539 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8340000a-0da5-4b49-9f0e-0572f4803a1f None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:58.896093 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:58.955069 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 539/1051] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:03:58 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:03:58.961514 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef047c5-7504-4745-b2a9-47079a9ee3c1 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:59.058661 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:59.131072 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef047c5-7504-4745-b2a9-47079a9ee3c1 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:59.188955 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a2de3-3343-48ac-8caa-c6da2bab536b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:59.190017 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a2de3-3343-48ac-8caa-c6da2bab536b None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:59.190495 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a2de3-3343-48ac-8caa-c6da2bab536b None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:59.190974 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a2de3-3343-48ac-8caa-c6da2bab536b None admin] PATH_INFO: `/v3/projects/f709dc9f531144c6926efc7582a367e0` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:59.192955 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9a2de3-3343-48ac-8caa-c6da2bab536b None admin] RBAC: Authorizing `identity:get_project(project_id=f709dc9f531144c6926efc7582a367e0)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:59.195617 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9a2de3-3343-48ac-8caa-c6da2bab536b None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:59.203776 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 513/1052] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:03:58 2022] GET /identity/v3/projects/f709dc9f531144c6926efc7582a367e0 => generated 311 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:03:59.205139 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340000a-0da5-4b49-9f0e-0572f4803a1f None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:59.305848 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340000a-0da5-4b49-9f0e-0572f4803a1f None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:59.341405 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f386559-5da4-4c82-9145-7336c4681d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:59.342088 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f386559-5da4-4c82-9145-7336c4681d82 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:59.342325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f386559-5da4-4c82-9145-7336c4681d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:59.342554 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f386559-5da4-4c82-9145-7336c4681d82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:59.343350 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f386559-5da4-4c82-9145-7336c4681d82 None admin] RBAC: Adding query filter params (role.id=fef526a7d2e741ce995d107f3ac934ae, scope.project.id=f709dc9f531144c6926efc7582a367e0, user.id=e54b008fb4d44cbaa2455bba7e381b67) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:59.343683 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f386559-5da4-4c82-9145-7336c4681d82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:59.345161 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f386559-5da4-4c82-9145-7336c4681d82 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:59.351235 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 540/1053] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:03:59 2022] GET /identity/v3/role_assignments?user.id=e54b008fb4d44cbaa2455bba7e381b67&scope.project.id=f709dc9f531144c6926efc7582a367e0&role.id=fef526a7d2e741ce995d107f3ac934ae => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:59.487581 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d965a3-8844-40e4-8e2b-337aec8a777c None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:59.488099 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d965a3-8844-40e4-8e2b-337aec8a777c None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:59.488099 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d965a3-8844-40e4-8e2b-337aec8a777c None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:59.489487 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 514/1054] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:59.495417 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac210f0-b4be-42d4-8a60-cde2a098ae45 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:59.495824 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac210f0-b4be-42d4-8a60-cde2a098ae45 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:59.496165 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac210f0-b4be-42d4-8a60-cde2a098ae45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:59.516830 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-4ac210f0-b4be-42d4-8a60-cde2a098ae45 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:59.518019 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-4ac210f0-b4be-42d4-8a60-cde2a098ae45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:59.528653 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:59.596869 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 541/1055] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:59 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:03:59.619739 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d965a3-8844-40e4-8e2b-337aec8a777c None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:59.731707 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d965a3-8844-40e4-8e2b-337aec8a777c None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:59.759566 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:03:59.769324 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07a009-e940-4779-bf95-01321e39b7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:59.769971 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07a009-e940-4779-bf95-01321e39b7dd None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:59.770242 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07a009-e940-4779-bf95-01321e39b7dd None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:59.770510 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07a009-e940-4779-bf95-01321e39b7dd None admin] PATH_INFO: `/v3/services/image` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:59.771136 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b07a009-e940-4779-bf95-01321e39b7dd None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:59.772524 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b07a009-e940-4779-bf95-01321e39b7dd None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:59.782049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-2b07a009-e940-4779-bf95-01321e39b7dd None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 31 01:03:59.782049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:59.782049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:03:59.782049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:03:59.782049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:03:59.782049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:03:59.782049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:03:59.782049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:59.782049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 31 01:03:59.782049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:59.782049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:03:59.782049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:59.782049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:03:59.782049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:03:59.782049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:03:59.782049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:03:59.782049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:03:59.789206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:03:59.789206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:03:59.789206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:03:59.789206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:03:59.789206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:03:59.789206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:03:59.789206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:03:59.789206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:03:59.789206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:03:59.789206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:03:59.789206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:03:59.789206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:03:59.789206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:03:59.789206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:03:59.789206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:03:59.789206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:03:59.790124 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:03:59.790124 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:03:59.790124 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:03:59.790124 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:03:59.790124 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:03:59.790124 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:03:59.790124 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:03:59.790124 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:03:59.790124 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:03:59.790124 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:03:59.790124 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:03:59.790124 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:03:59.790124 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 31 01:03:59.790124 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:03:59.790124 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 515/1056] 10.222.0.60 () {56 vars in 1105 bytes} [Sun Jul 31 01:03:59 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:03:59.792464 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac210f0-b4be-42d4-8a60-cde2a098ae45 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:59.904810 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac210f0-b4be-42d4-8a60-cde2a098ae45 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:59.939076 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8416e9-6f24-4422-bf6c-48a0fb036421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:59.939818 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8416e9-6f24-4422-bf6c-48a0fb036421 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:59.940096 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8416e9-6f24-4422-bf6c-48a0fb036421 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:59.940363 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8416e9-6f24-4422-bf6c-48a0fb036421 None admin] PATH_INFO: `/v3/services` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:59.941043 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8416e9-6f24-4422-bf6c-48a0fb036421 None admin] RBAC: Adding query filter params (name=image) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:03:59.941345 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8416e9-6f24-4422-bf6c-48a0fb036421 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:59.942714 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8416e9-6f24-4422-bf6c-48a0fb036421 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:59.948453 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 542/1057] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:59.954118 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07a009-e940-4779-bf95-01321e39b7dd None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:00.086750 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07a009-e940-4779-bf95-01321e39b7dd None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:00.123593 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d46e58-2feb-4441-ae88-6ee0281a23f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:00.124232 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d46e58-2feb-4441-ae88-6ee0281a23f9 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:00.124539 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d46e58-2feb-4441-ae88-6ee0281a23f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:00.124836 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d46e58-2feb-4441-ae88-6ee0281a23f9 None admin] PATH_INFO: `/v3/services` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:00.125608 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d46e58-2feb-4441-ae88-6ee0281a23f9 None admin] RBAC: Adding query filter params (type=image) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:00.125923 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d46e58-2feb-4441-ae88-6ee0281a23f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:00.127687 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d46e58-2feb-4441-ae88-6ee0281a23f9 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:00.133110 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 516/1058] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:03:59 2022] GET /identity/v3/services?type=image => generated 350 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:00.138921 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8416e9-6f24-4422-bf6c-48a0fb036421 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:00.150694 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:00.258265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8416e9-6f24-4422-bf6c-48a0fb036421 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:00.297318 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce09fe1b-cf04-4c6e-940e-62dd9dc71850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:00.298140 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09fe1b-cf04-4c6e-940e-62dd9dc71850 None admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:00.298522 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09fe1b-cf04-4c6e-940e-62dd9dc71850 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:00.298904 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09fe1b-cf04-4c6e-940e-62dd9dc71850 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:00.299741 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce09fe1b-cf04-4c6e-940e-62dd9dc71850 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:00.301242 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce09fe1b-cf04-4c6e-940e-62dd9dc71850 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:00.331530 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 543/1059] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:04:00 2022] POST /identity/v3/endpoints => generated 327 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:04:00.969433 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb11ab8-d9fa-4300-bab0-1b5e9998bc4c None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:00.969995 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb11ab8-d9fa-4300-bab0-1b5e9998bc4c None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:00.969995 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb11ab8-d9fa-4300-bab0-1b5e9998bc4c None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:00.971523 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 517/1060] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:00.976838 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95a416-b431-450a-be50-6f210e12a4da None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:00.977319 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95a416-b431-450a-be50-6f210e12a4da None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:00.977319 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95a416-b431-450a-be50-6f210e12a4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:00.996127 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-4d95a416-b431-450a-be50-6f210e12a4da None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:00.997326 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-4d95a416-b431-450a-be50-6f210e12a4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:01.070896 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:01.088909 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 544/1061] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:04:01.112739 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb11ab8-d9fa-4300-bab0-1b5e9998bc4c None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:01.182232 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:01.229664 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb11ab8-d9fa-4300-bab0-1b5e9998bc4c None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:01.278429 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c080ac2-fa99-46f1-a8af-53fb824788f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:01.279085 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c080ac2-fa99-46f1-a8af-53fb824788f8 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:01.279359 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c080ac2-fa99-46f1-a8af-53fb824788f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:01.279668 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c080ac2-fa99-46f1-a8af-53fb824788f8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:01.295105 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c080ac2-fa99-46f1-a8af-53fb824788f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:01.301507 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-8c080ac2-fa99-46f1-a8af-53fb824788f8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 31 01:04:01.301507 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:01.301507 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:01.301507 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:01.301507 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:01.301507 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:01.301507 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:01.301507 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:01.301507 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:01.301507 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:01.301507 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:01.301507 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:01.301507 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:01.301507 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:01.301507 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:01.301507 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:01.302528 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:01.302528 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:01.302528 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:01.302528 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:01.302528 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:01.302528 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:01.302528 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:01.302528 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:01.302528 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:01.302528 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:01.302528 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:01.302528 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:01.302528 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:01.302528 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:01.302528 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:01.302528 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:01.304554 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:01.304554 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:01.304554 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:01.304554 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:01.304554 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:01.304554 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:01.304554 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:01.304554 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:01.304554 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:01.304554 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:01.304554 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 31 01:04:01.304554 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:04:01.306737 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 518/1062] 10.222.0.60 () {56 vars in 1120 bytes} [Sun Jul 31 01:04:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:01.310411 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95a416-b431-450a-be50-6f210e12a4da None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:01.398868 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3db87-4ab4-4e90-9bb4-fe7b7dfac786 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:01.399354 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3db87-4ab4-4e90-9bb4-fe7b7dfac786 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:01.399866 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3db87-4ab4-4e90-9bb4-fe7b7dfac786 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:01.402511 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 519/1063] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:04:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:01.410870 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82621b-887e-4a1c-a7c7-6bafc40f05aa None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:01.411359 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82621b-887e-4a1c-a7c7-6bafc40f05aa None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:01.411836 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82621b-887e-4a1c-a7c7-6bafc40f05aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:01.430670 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95a416-b431-450a-be50-6f210e12a4da None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:01.435346 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-3d82621b-887e-4a1c-a7c7-6bafc40f05aa None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:01.436698 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-3d82621b-887e-4a1c-a7c7-6bafc40f05aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:01.489198 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6d387-e1cd-4213-ba46-47ce7b5cfc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:01.490106 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6d387-e1cd-4213-ba46-47ce7b5cfc7a None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:01.490533 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6d387-e1cd-4213-ba46-47ce7b5cfc7a None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:01.490961 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6d387-e1cd-4213-ba46-47ce7b5cfc7a None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:01.491968 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6d387-e1cd-4213-ba46-47ce7b5cfc7a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:01.492514 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6d387-e1cd-4213-ba46-47ce7b5cfc7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:01.493919 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6d387-e1cd-4213-ba46-47ce7b5cfc7a None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:01.508811 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 545/1064] 10.222.0.60 () {56 vars in 1115 bytes} [Sun Jul 31 01:04:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:01.514605 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6d387-e1cd-4213-ba46-47ce7b5cfc7a None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:01.528902 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 520/1065] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:04:01.551153 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82621b-887e-4a1c-a7c7-6bafc40f05aa None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:01.574812 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:01.601968 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:01.630660 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6d387-e1cd-4213-ba46-47ce7b5cfc7a None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:01.664260 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82621b-887e-4a1c-a7c7-6bafc40f05aa None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:01.667602 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e0dd8-1cd6-4a39-aa99-d9141f466e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:01.668267 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e0dd8-1cd6-4a39-aa99-d9141f466e7e None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:01.668543 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e0dd8-1cd6-4a39-aa99-d9141f466e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:01.668880 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e0dd8-1cd6-4a39-aa99-d9141f466e7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:01.680207 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e0dd8-1cd6-4a39-aa99-d9141f466e7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:01.681681 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e0dd8-1cd6-4a39-aa99-d9141f466e7e None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:01.696383 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-763e0dd8-1cd6-4a39-aa99-d9141f466e7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:04:01.696383 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:01.696383 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:01.696383 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:01.696383 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:01.696383 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:01.696383 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:01.696383 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:01.696383 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:01.696383 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:01.696383 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:01.696383 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:01.696383 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:04:01.696383 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:04:01.696383 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:04:01.697505 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:04:01.697505 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:01.697505 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:01.697505 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:01.697505 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:01.697505 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:01.697505 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:01.697505 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:01.697505 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:01.697505 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:01.697505 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:01.697505 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:01.697505 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:01.697505 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:01.697505 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:01.697505 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:01.697505 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:01.698422 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:04:01.698422 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:04:01.698422 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:04:01.698422 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:04:01.698422 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 546/1066] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:04:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:04:01.703585 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e0dd8-1cd6-4a39-aa99-d9141f466e7e None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:01.708635 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181276d-c959-4f5a-a765-f5916db60853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:01.709302 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181276d-c959-4f5a-a765-f5916db60853 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:01.709583 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181276d-c959-4f5a-a765-f5916db60853 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:01.709858 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181276d-c959-4f5a-a765-f5916db60853 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:01.721254 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d181276d-c959-4f5a-a765-f5916db60853 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:01.726232 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-d181276d-c959-4f5a-a765-f5916db60853 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:04:01.726232 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:01.726232 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:01.726232 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:01.726232 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:01.726232 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:01.726232 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:01.726232 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:01.726232 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:01.726232 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:01.726232 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:01.726232 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:01.726232 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:01.726232 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:01.726232 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:01.726232 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:01.727338 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:01.727338 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:01.727338 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:01.727338 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:01.727338 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:01.727338 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:01.727338 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:01.727338 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:01.727338 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:01.727338 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:01.727338 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:01.727338 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:01.727338 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:01.727338 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:01.727338 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:01.727338 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:01.728496 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:01.728496 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:01.728496 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:01.728496 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:01.728496 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:01.728496 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:01.728496 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:01.728496 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:01.728496 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:01.728496 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:01.728496 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:04:01.728496 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:04:01.732889 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 521/1067] 10.222.0.60 () {56 vars in 1096 bytes} [Sun Jul 31 01:04:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:01.733758 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181276d-c959-4f5a-a765-f5916db60853 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:01.818520 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e0dd8-1cd6-4a39-aa99-d9141f466e7e None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:01.822344 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:01.858181 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a56e00-eca3-4820-8c7a-0650a3affe8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:01.858853 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a56e00-eca3-4820-8c7a-0650a3affe8d None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:01.859130 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a56e00-eca3-4820-8c7a-0650a3affe8d None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:01.859517 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a56e00-eca3-4820-8c7a-0650a3affe8d None admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:01.860279 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a56e00-eca3-4820-8c7a-0650a3affe8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:01.860581 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a56e00-eca3-4820-8c7a-0650a3affe8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:01.861956 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a56e00-eca3-4820-8c7a-0650a3affe8d None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:01.864559 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181276d-c959-4f5a-a765-f5916db60853 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:01.872765 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:01.874637 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 547/1068] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:01.881127 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a56e00-eca3-4820-8c7a-0650a3affe8d None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:01.908139 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ba361-0f8d-41e9-ae49-dc1532e7ba0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:01.908712 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ba361-0f8d-41e9-ae49-dc1532e7ba0f None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:01.908986 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ba361-0f8d-41e9-ae49-dc1532e7ba0f None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:01.909262 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ba361-0f8d-41e9-ae49-dc1532e7ba0f None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:01.910096 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38ba361-0f8d-41e9-ae49-dc1532e7ba0f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:01.910288 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38ba361-0f8d-41e9-ae49-dc1532e7ba0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:01.911674 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38ba361-0f8d-41e9-ae49-dc1532e7ba0f None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:01.922037 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 522/1069] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:04:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:01.927692 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ba361-0f8d-41e9-ae49-dc1532e7ba0f None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:01.992711 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a56e00-eca3-4820-8c7a-0650a3affe8d None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:02.030212 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6990af4-bd24-49fa-b0eb-b8506a6c0c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:02.031142 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6990af4-bd24-49fa-b0eb-b8506a6c0c81 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:02.031521 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6990af4-bd24-49fa-b0eb-b8506a6c0c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:02.031922 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6990af4-bd24-49fa-b0eb-b8506a6c0c81 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:02.041042 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6990af4-bd24-49fa-b0eb-b8506a6c0c81 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:02.043474 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6990af4-bd24-49fa-b0eb-b8506a6c0c81 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:02.047939 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ba361-0f8d-41e9-ae49-dc1532e7ba0f None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:02.060065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-d6990af4-bd24-49fa-b0eb-b8506a6c0c81 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:04:02.060065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:02.060065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:02.060065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:02.060065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:02.060065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:02.060065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:02.060065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:02.060065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:02.060065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:02.060065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:02.060065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:02.060065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:04:02.060065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:04:02.060065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:04:02.060065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:04:02.061246 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:02.061246 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:02.061246 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:04:02.061246 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:04:02.061246 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:04:02.061246 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:04:02.061246 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:02.061246 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:02.061246 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:02.061246 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:02.061246 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:02.061246 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:02.061246 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:02.061246 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:02.061246 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:02.061246 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:02.061246 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:02.061246 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:02.062562 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:02.062562 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:02.062562 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:04:02.062562 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:04:02.062562 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:04:02.062562 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:04:02.062562 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:04:02.062562 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:04:02.062562 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:04:02.062562 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:04:02.069958 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 548/1070] 10.222.0.60 () {56 vars in 1093 bytes} [Sun Jul 31 01:04:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:04:02.070683 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6990af4-bd24-49fa-b0eb-b8506a6c0c81 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:02.093974 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ea59d-3983-47c2-957c-c2afa4da9e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:02.094648 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ea59d-3983-47c2-957c-c2afa4da9e24 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:02.094947 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ea59d-3983-47c2-957c-c2afa4da9e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:02.095238 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ea59d-3983-47c2-957c-c2afa4da9e24 None admin] PATH_INFO: `/v3/users/e54b008fb4d44cbaa2455bba7e381b67` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:02.096496 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ea59d-3983-47c2-957c-c2afa4da9e24 None admin] RBAC: Authorizing `identity:get_user(user_id=e54b008fb4d44cbaa2455bba7e381b67)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:02.097938 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ea59d-3983-47c2-957c-c2afa4da9e24 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:02.099769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 523/1071] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:01 2022] GET /identity/v3/users/e54b008fb4d44cbaa2455bba7e381b67 => generated 285 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:04:02.099884 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:02.105465 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ea59d-3983-47c2-957c-c2afa4da9e24 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:02.148615 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:02.195499 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6990af4-bd24-49fa-b0eb-b8506a6c0c81 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:02.221966 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ea59d-3983-47c2-957c-c2afa4da9e24 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:02.233714 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ab74d-c20d-4e47-9260-ed9ea3fbbb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:02.234341 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ab74d-c20d-4e47-9260-ed9ea3fbbb18 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:02.234619 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ab74d-c20d-4e47-9260-ed9ea3fbbb18 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:02.234888 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ab74d-c20d-4e47-9260-ed9ea3fbbb18 None admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:02.235723 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ab74d-c20d-4e47-9260-ed9ea3fbbb18 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:02.236128 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ab74d-c20d-4e47-9260-ed9ea3fbbb18 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:02.237705 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ab74d-c20d-4e47-9260-ed9ea3fbbb18 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:02.258228 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 549/1072] 10.222.0.60 () {56 vars in 1133 bytes} [Sun Jul 31 01:04:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:02.261655 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b7567-59a8-4021-899f-e68b7c09eba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:02.262361 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b7567-59a8-4021-899f-e68b7c09eba7 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:02.262635 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b7567-59a8-4021-899f-e68b7c09eba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:02.262903 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b7567-59a8-4021-899f-e68b7c09eba7 None admin] PATH_INFO: `/v3/projects/f709dc9f531144c6926efc7582a367e0` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:02.264125 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ab74d-c20d-4e47-9260-ed9ea3fbbb18 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:02.265534 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894b7567-59a8-4021-899f-e68b7c09eba7 None admin] RBAC: Authorizing `identity:get_project(project_id=f709dc9f531144c6926efc7582a367e0)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:02.266978 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894b7567-59a8-4021-899f-e68b7c09eba7 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:02.268729 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 524/1073] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:02 2022] GET /identity/v3/projects/f709dc9f531144c6926efc7582a367e0 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:04:02.274856 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b7567-59a8-4021-899f-e68b7c09eba7 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:02.367119 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:02.387541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b7567-59a8-4021-899f-e68b7c09eba7 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:02.394239 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:02.398878 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ab74d-c20d-4e47-9260-ed9ea3fbbb18 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:02.439411 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18bae70-cedb-47ef-8c46-4c5bd9eecc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:02.439687 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c001b-9616-4f1f-b588-4072a750f977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:02.440101 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18bae70-cedb-47ef-8c46-4c5bd9eecc31 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:02.440344 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c001b-9616-4f1f-b588-4072a750f977 None admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:02.440438 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18bae70-cedb-47ef-8c46-4c5bd9eecc31 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:02.440626 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18bae70-cedb-47ef-8c46-4c5bd9eecc31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:02.440725 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c001b-9616-4f1f-b588-4072a750f977 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:02.441043 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c001b-9616-4f1f-b588-4072a750f977 None admin] PATH_INFO: `/v3/projects/f709dc9f531144c6926efc7582a367e0/users/e54b008fb4d44cbaa2455bba7e381b67/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:02.443860 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c001b-9616-4f1f-b588-4072a750f977 None admin] RBAC: Authorizing `identity:create_grant(project_id=f709dc9f531144c6926efc7582a367e0, user_id=e54b008fb4d44cbaa2455bba7e381b67, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:02.445366 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c001b-9616-4f1f-b588-4072a750f977 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:02.451539 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18bae70-cedb-47ef-8c46-4c5bd9eecc31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:02.453277 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18bae70-cedb-47ef-8c46-4c5bd9eecc31 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:02.464674 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 525/1074] 10.222.0.60 () {58 vars in 1439 bytes} [Sun Jul 31 01:04:02 2022] PUT /identity/v3/projects/f709dc9f531144c6926efc7582a367e0/users/e54b008fb4d44cbaa2455bba7e381b67/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:04:02.466116 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa406b1-2bbc-4ceb-b342-96475a8a777f None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:02.466503 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa406b1-2bbc-4ceb-b342-96475a8a777f None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:02.466893 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa406b1-2bbc-4ceb-b342-96475a8a777f None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:02.471543 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 526/1075] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:02.474170 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-d18bae70-cedb-47ef-8c46-4c5bd9eecc31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:04:02.474170 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:02.474170 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:02.474170 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:02.474170 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:02.474170 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:02.474170 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:02.474170 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:02.474170 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:02.474170 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:02.474170 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:02.474170 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:02.474170 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:04:02.474170 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:04:02.474170 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:04:02.475127 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:04:02.475127 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:02.475127 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:02.475127 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:02.475127 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:02.475127 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:02.475127 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:02.475127 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:02.475127 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:02.475127 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:02.475127 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:02.475127 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:02.475127 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:02.475127 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:02.475127 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:02.475127 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:02.475127 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:02.476071 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:04:02.476071 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:04:02.476071 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:04:02.476071 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:04:02.476292 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b30d7-5cd0-4be0-af9e-1a541eb0037f None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:02.476292 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b30d7-5cd0-4be0-af9e-1a541eb0037f None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:02.476292 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b30d7-5cd0-4be0-af9e-1a541eb0037f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:02.476492 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 550/1076] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:04:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:04:02.481404 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18bae70-cedb-47ef-8c46-4c5bd9eecc31 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:02.495542 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-f40b30d7-5cd0-4be0-af9e-1a541eb0037f None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:02.496841 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-f40b30d7-5cd0-4be0-af9e-1a541eb0037f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:02.601841 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 527/1077] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:04:02.617855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18bae70-cedb-47ef-8c46-4c5bd9eecc31 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:02.624521 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b30d7-5cd0-4be0-af9e-1a541eb0037f None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:02.666130 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50104b-2822-4b2a-a0ce-13b99f27cf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:02.668327 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50104b-2822-4b2a-a0ce-13b99f27cf7d None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:02.668646 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50104b-2822-4b2a-a0ce-13b99f27cf7d None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:02.668918 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50104b-2822-4b2a-a0ce-13b99f27cf7d None admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:02.669757 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee50104b-2822-4b2a-a0ce-13b99f27cf7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:02.669931 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee50104b-2822-4b2a-a0ce-13b99f27cf7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:02.671308 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee50104b-2822-4b2a-a0ce-13b99f27cf7d None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:02.673181 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:02.686980 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 551/1078] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:02.696920 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50104b-2822-4b2a-a0ce-13b99f27cf7d None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:02.770050 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:02.778279 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b30d7-5cd0-4be0-af9e-1a541eb0037f None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:02.822935 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37c967-954f-443c-9e13-9db1a261637b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:02.823843 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37c967-954f-443c-9e13-9db1a261637b None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:02.825538 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37c967-954f-443c-9e13-9db1a261637b None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:02.825538 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37c967-954f-443c-9e13-9db1a261637b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:02.835796 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50104b-2822-4b2a-a0ce-13b99f27cf7d None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:02.876678 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7853cf-d86d-49b2-b228-147a6a66128c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:02.877613 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7853cf-d86d-49b2-b228-147a6a66128c None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:02.877891 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7853cf-d86d-49b2-b228-147a6a66128c None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:02.878160 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7853cf-d86d-49b2-b228-147a6a66128c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:02.885345 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7853cf-d86d-49b2-b228-147a6a66128c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:02.886824 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7853cf-d86d-49b2-b228-147a6a66128c None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:02.899366 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-bd7853cf-d86d-49b2-b228-147a6a66128c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:04:02.899366 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:02.899366 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:02.899366 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:02.899366 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:02.899366 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:02.899366 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:02.899366 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:02.899366 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:02.899366 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:02.899366 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:02.899366 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:02.899366 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:04:02.899366 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:04:02.899366 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:04:02.900349 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:04:02.900349 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:02.900349 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:02.900349 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:02.900349 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:02.900349 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:02.900349 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:02.900349 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:02.900349 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:02.900349 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:02.900349 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:02.900349 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:02.900349 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:02.900349 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:02.900349 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:02.900349 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:02.900349 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:02.901247 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:04:02.901247 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:04:02.901247 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:04:02.901247 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:04:02.901247 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:04:02.901247 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:04:02.901247 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:04:02.901247 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:04:02.905616 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 552/1079] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:04:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:02.905856 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c37c967-954f-443c-9e13-9db1a261637b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:02.906474 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7853cf-d86d-49b2-b228-147a6a66128c None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:02.907318 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c37c967-954f-443c-9e13-9db1a261637b None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:02.969931 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:03.014835 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:03.020947 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7853cf-d86d-49b2-b228-147a6a66128c None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:03.029514 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 528/1080] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:04:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:04:03.030825 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37c967-954f-443c-9e13-9db1a261637b None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:03.057283 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51b1df-6bb6-460b-b6af-4b94a1bd1b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:03.057911 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51b1df-6bb6-460b-b6af-4b94a1bd1b81 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:03.058188 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51b1df-6bb6-460b-b6af-4b94a1bd1b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:03.058459 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51b1df-6bb6-460b-b6af-4b94a1bd1b81 None admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:03.059257 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51b1df-6bb6-460b-b6af-4b94a1bd1b81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:03.059593 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51b1df-6bb6-460b-b6af-4b94a1bd1b81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:03.061037 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51b1df-6bb6-460b-b6af-4b94a1bd1b81 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:03.078944 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 553/1081] 10.222.0.60 () {56 vars in 1148 bytes} [Sun Jul 31 01:04:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:03.081224 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51b1df-6bb6-460b-b6af-4b94a1bd1b81 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:03.153206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37c967-954f-443c-9e13-9db1a261637b None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:03.191422 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51b1df-6bb6-460b-b6af-4b94a1bd1b81 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:03.197196 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df57a95a-a7d0-44ae-ba62-c1eb00def1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:03.197863 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df57a95a-a7d0-44ae-ba62-c1eb00def1a7 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:03.198142 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df57a95a-a7d0-44ae-ba62-c1eb00def1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:03.198591 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df57a95a-a7d0-44ae-ba62-c1eb00def1a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:03.209643 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:03.213615 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df57a95a-a7d0-44ae-ba62-c1eb00def1a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:03.215177 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df57a95a-a7d0-44ae-ba62-c1eb00def1a7 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:03.232268 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-df57a95a-a7d0-44ae-ba62-c1eb00def1a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:04:03.232268 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:03.232268 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:03.232268 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:03.232268 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:03.232268 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:03.232268 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:03.232268 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:03.232268 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:03.232268 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:03.232268 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:03.232268 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:03.232268 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:04:03.232268 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:04:03.232268 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:04:03.233341 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:04:03.233341 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:03.233341 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:03.233341 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:03.233341 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:03.233341 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:03.233341 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:03.233341 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:03.233341 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:03.233341 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:03.233341 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:03.233341 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:03.233341 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:03.233341 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:03.233341 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:03.233341 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:03.233341 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:03.234514 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:04:03.234514 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:04:03.234514 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:04:03.234514 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:04:03.238679 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 529/1082] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:04:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:03.239631 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df57a95a-a7d0-44ae-ba62-c1eb00def1a7 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:03.240442 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f368c4-908a-4bbe-8e46-052113019111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:03.241151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f368c4-908a-4bbe-8e46-052113019111 None admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:03.241422 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f368c4-908a-4bbe-8e46-052113019111 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:03.241691 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f368c4-908a-4bbe-8e46-052113019111 None admin] PATH_INFO: `/v3/projects/b931b81a237949aa845891d4bb5aa1c0/users/04591cd035ef4961b8b7a93e294eb881/roles/9687bf70551b48aaaef3e0187bb47d06` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:03.245121 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f368c4-908a-4bbe-8e46-052113019111 None admin] RBAC: Authorizing `identity:create_grant(project_id=b931b81a237949aa845891d4bb5aa1c0, user_id=04591cd035ef4961b8b7a93e294eb881, role_id=9687bf70551b48aaaef3e0187bb47d06)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:03.246577 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f368c4-908a-4bbe-8e46-052113019111 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:03.264851 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 554/1083] 10.222.0.60 () {58 vars in 1439 bytes} [Sun Jul 31 01:04:03 2022] PUT /identity/v3/projects/b931b81a237949aa845891d4bb5aa1c0/users/04591cd035ef4961b8b7a93e294eb881/roles/9687bf70551b48aaaef3e0187bb47d06 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:04:03.300248 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:03.376036 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df57a95a-a7d0-44ae-ba62-c1eb00def1a7 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:03.415877 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bdcc9-6cfe-4f32-a204-140588f566dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:03.416424 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bdcc9-6cfe-4f32-a204-140588f566dc None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:03.416694 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bdcc9-6cfe-4f32-a204-140588f566dc None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:03.416961 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bdcc9-6cfe-4f32-a204-140588f566dc None admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:03.417661 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539bdcc9-6cfe-4f32-a204-140588f566dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:03.417961 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539bdcc9-6cfe-4f32-a204-140588f566dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:03.419330 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539bdcc9-6cfe-4f32-a204-140588f566dc None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:03.436217 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 530/1084] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:04:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:04.500126 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fcbce8-f82a-4b3b-9040-0ad1a9267aa1 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:04.500692 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fcbce8-f82a-4b3b-9040-0ad1a9267aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:04.500692 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fcbce8-f82a-4b3b-9040-0ad1a9267aa1 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:04.502392 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 555/1085] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:04:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:04.509686 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636b87b-fe22-49d5-a6ba-729ad2ae911a None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:04.510223 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636b87b-fe22-49d5-a6ba-729ad2ae911a None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:04.510223 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636b87b-fe22-49d5-a6ba-729ad2ae911a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:04.531136 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-2636b87b-fe22-49d5-a6ba-729ad2ae911a None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:04.541096 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-2636b87b-fe22-49d5-a6ba-729ad2ae911a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:04.618677 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 531/1086] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:04:04.647223 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fcbce8-f82a-4b3b-9040-0ad1a9267aa1 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:04.766677 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fcbce8-f82a-4b3b-9040-0ad1a9267aa1 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:04.810695 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c121f-7216-4dbf-8a25-e91c3ca4e55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:04.811526 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c121f-7216-4dbf-8a25-e91c3ca4e55a None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:04.811826 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c121f-7216-4dbf-8a25-e91c3ca4e55a None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:04.812189 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c121f-7216-4dbf-8a25-e91c3ca4e55a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:04.822300 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146c121f-7216-4dbf-8a25-e91c3ca4e55a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:04.830918 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-146c121f-7216-4dbf-8a25-e91c3ca4e55a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:04:04.830918 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:04.830918 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:04.830918 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:04.830918 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:04.830918 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:04.830918 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:04.830918 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:04.830918 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:04.830918 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:04.830918 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:04.830918 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:04.830918 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:04.830918 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:04.830918 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:04.830918 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:04.832052 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:04.832052 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:04.832052 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:04.832052 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:04.832052 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:04.832052 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:04.832052 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:04.832052 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:04.832052 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:04.832052 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:04.832052 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:04.832052 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:04.832052 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:04.832052 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:04.832052 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:04.832052 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:04.832963 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:04.832963 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:04.832963 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:04.832963 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:04.832963 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:04.832963 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:04.832963 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:04.832963 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:04.832963 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:04.832963 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:04.832963 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:04:04.832963 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:04:04.832963 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 556/1087] 10.222.0.60 () {56 vars in 1096 bytes} [Sun Jul 31 01:04:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:04.838537 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636b87b-fe22-49d5-a6ba-729ad2ae911a None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:04.877351 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:04.949737 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636b87b-fe22-49d5-a6ba-729ad2ae911a None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:04.987817 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba140b-b0b8-4bfc-84a3-8038f0cf92ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:04.988445 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba140b-b0b8-4bfc-84a3-8038f0cf92ec None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:04.988725 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba140b-b0b8-4bfc-84a3-8038f0cf92ec None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:04.988994 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba140b-b0b8-4bfc-84a3-8038f0cf92ec None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:04.989718 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba140b-b0b8-4bfc-84a3-8038f0cf92ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:04.990018 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba140b-b0b8-4bfc-84a3-8038f0cf92ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:04.991389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba140b-b0b8-4bfc-84a3-8038f0cf92ec None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:05.000217 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 532/1088] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:04:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:05.006752 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c121f-7216-4dbf-8a25-e91c3ca4e55a None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:05.043940 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:05.116011 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c121f-7216-4dbf-8a25-e91c3ca4e55a None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:05.152652 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1df252-89fe-43e6-88a5-80bcde90f50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:05.153301 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1df252-89fe-43e6-88a5-80bcde90f50c None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:05.153589 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1df252-89fe-43e6-88a5-80bcde90f50c None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:05.153861 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1df252-89fe-43e6-88a5-80bcde90f50c None admin] PATH_INFO: `/v3/users/e54b008fb4d44cbaa2455bba7e381b67` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:05.155073 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1df252-89fe-43e6-88a5-80bcde90f50c None admin] RBAC: Authorizing `identity:get_user(user_id=e54b008fb4d44cbaa2455bba7e381b67)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:05.156647 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1df252-89fe-43e6-88a5-80bcde90f50c None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:05.158302 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 557/1089] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:05 2022] GET /identity/v3/users/e54b008fb4d44cbaa2455bba7e381b67 => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:05.164331 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba140b-b0b8-4bfc-84a3-8038f0cf92ec None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:05.273556 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:05.279134 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba140b-b0b8-4bfc-84a3-8038f0cf92ec None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:05.279723 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb494c-5471-40fb-a0d5-90eac7d6990e None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:05.279991 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb494c-5471-40fb-a0d5-90eac7d6990e None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:05.280264 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb494c-5471-40fb-a0d5-90eac7d6990e None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:05.282688 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 558/1090] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:04:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:05.288265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c7bf4-b3b8-418a-9a22-6620c8ec7f21 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:05.288549 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c7bf4-b3b8-418a-9a22-6620c8ec7f21 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:05.288825 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c7bf4-b3b8-418a-9a22-6620c8ec7f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:05.307784 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-4d6c7bf4-b3b8-418a-9a22-6620c8ec7f21 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:05.309642 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-4d6c7bf4-b3b8-418a-9a22-6620c8ec7f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:05.315761 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de1e8a-9df7-44ee-9dd2-e66ebddcde95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:05.316393 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de1e8a-9df7-44ee-9dd2-e66ebddcde95 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:05.316667 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de1e8a-9df7-44ee-9dd2-e66ebddcde95 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:05.316934 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de1e8a-9df7-44ee-9dd2-e66ebddcde95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:05.383531 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 559/1091] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:04:05.399831 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de1e8a-9df7-44ee-9dd2-e66ebddcde95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:05.401300 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de1e8a-9df7-44ee-9dd2-e66ebddcde95 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:05.406566 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6c7bf4-b3b8-418a-9a22-6620c8ec7f21 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:05.446799 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:05.503246 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:05.508576 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 533/1092] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:04:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 31 01:04:05.514162 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de1e8a-9df7-44ee-9dd2-e66ebddcde95 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:05.519886 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6c7bf4-b3b8-418a-9a22-6620c8ec7f21 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:05.555703 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c6e20-7c51-4991-833d-85bbdbb942af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:05.556367 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c6e20-7c51-4991-833d-85bbdbb942af None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:05.556641 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c6e20-7c51-4991-833d-85bbdbb942af None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:05.556910 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c6e20-7c51-4991-833d-85bbdbb942af None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:05.567628 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c6e20-7c51-4991-833d-85bbdbb942af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:05.572615 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-6c2c6e20-7c51-4991-833d-85bbdbb942af None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 31 01:04:05.572615 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:05.572615 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:05.572615 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:05.572615 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:05.572615 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:05.572615 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:05.572615 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:05.572615 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:05.572615 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:05.572615 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:05.572615 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:05.572615 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:05.572615 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:05.572615 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:05.572615 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:05.573587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:05.573587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:05.573587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:05.573587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:05.573587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:05.573587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:05.573587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:05.573587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:05.573587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:05.573587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:05.573587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:05.573587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:05.573587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:05.573587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:05.573587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:05.573587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:05.574456 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:05.574456 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:05.574456 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:05.574456 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:05.574456 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:05.574456 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:05.574456 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:05.574456 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:05.574456 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:05.574456 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:05.574456 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 31 01:04:05.574456 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:04:05.574456 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 560/1093] 10.222.0.60 () {56 vars in 1120 bytes} [Sun Jul 31 01:04:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:05.580800 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c6e20-7c51-4991-833d-85bbdbb942af None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:05.621137 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de1e8a-9df7-44ee-9dd2-e66ebddcde95 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:05.659163 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c12b77-7699-4a13-9b39-5f0dfa39a73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:05.659760 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c12b77-7699-4a13-9b39-5f0dfa39a73c None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:05.660039 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c12b77-7699-4a13-9b39-5f0dfa39a73c None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:05.660308 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c12b77-7699-4a13-9b39-5f0dfa39a73c None admin] PATH_INFO: `/v3/projects/f709dc9f531144c6926efc7582a367e0` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:05.661478 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c12b77-7699-4a13-9b39-5f0dfa39a73c None admin] RBAC: Authorizing `identity:get_project(project_id=f709dc9f531144c6926efc7582a367e0)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:05.662916 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c12b77-7699-4a13-9b39-5f0dfa39a73c None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:05.664628 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 534/1094] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:05 2022] GET /identity/v3/projects/f709dc9f531144c6926efc7582a367e0 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:04:05.671007 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c12b77-7699-4a13-9b39-5f0dfa39a73c None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:05.687718 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:05.697137 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c6e20-7c51-4991-833d-85bbdbb942af None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:05.732471 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2247327-2682-4d94-b5f9-7ec8fbcb1f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:05.733111 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2247327-2682-4d94-b5f9-7ec8fbcb1f68 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:05.733387 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2247327-2682-4d94-b5f9-7ec8fbcb1f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:05.733654 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2247327-2682-4d94-b5f9-7ec8fbcb1f68 None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:05.734385 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2247327-2682-4d94-b5f9-7ec8fbcb1f68 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:05.734681 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2247327-2682-4d94-b5f9-7ec8fbcb1f68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:05.736121 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2247327-2682-4d94-b5f9-7ec8fbcb1f68 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:05.742690 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:05.744551 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 561/1095] 10.222.0.60 () {56 vars in 1115 bytes} [Sun Jul 31 01:04:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:05.750457 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2247327-2682-4d94-b5f9-7ec8fbcb1f68 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:05.792173 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c12b77-7699-4a13-9b39-5f0dfa39a73c None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:05.827777 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb145f-7aee-4bd0-ac44-05ae6e1ae93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:05.828408 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb145f-7aee-4bd0-ac44-05ae6e1ae93b None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:05.828691 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb145f-7aee-4bd0-ac44-05ae6e1ae93b None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:05.828949 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb145f-7aee-4bd0-ac44-05ae6e1ae93b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:05.829755 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb145f-7aee-4bd0-ac44-05ae6e1ae93b None admin] RBAC: Adding query filter params (role.id=fef526a7d2e741ce995d107f3ac934ae, scope.project.id=f709dc9f531144c6926efc7582a367e0, user.id=e54b008fb4d44cbaa2455bba7e381b67) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:05.830059 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb145f-7aee-4bd0-ac44-05ae6e1ae93b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:05.831533 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb145f-7aee-4bd0-ac44-05ae6e1ae93b None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:05.838320 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 535/1096] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:04:05 2022] GET /identity/v3/role_assignments?user.id=e54b008fb4d44cbaa2455bba7e381b67&scope.project.id=f709dc9f531144c6926efc7582a367e0&role.id=fef526a7d2e741ce995d107f3ac934ae => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:05.859166 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2247327-2682-4d94-b5f9-7ec8fbcb1f68 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:05.900882 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f91bd1-dd29-4340-8887-716ffbb04039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:05.901564 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f91bd1-dd29-4340-8887-716ffbb04039 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:05.901909 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f91bd1-dd29-4340-8887-716ffbb04039 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:05.902094 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f91bd1-dd29-4340-8887-716ffbb04039 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:05.914640 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f91bd1-dd29-4340-8887-716ffbb04039 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:05.916087 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f91bd1-dd29-4340-8887-716ffbb04039 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:05.935428 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-43f91bd1-dd29-4340-8887-716ffbb04039 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:04:05.935428 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:05.935428 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:05.935428 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:05.935428 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:05.935428 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:05.935428 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:05.935428 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:05.935428 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:05.935428 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:05.935428 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:05.935428 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:05.935428 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:04:05.935428 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:04:05.935428 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:04:05.936667 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:04:05.936667 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:05.936667 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:05.936667 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:05.936667 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:05.936667 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:05.936667 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:05.936667 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:05.936667 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:05.936667 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:05.936667 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:05.936667 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:05.936667 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:05.936667 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:05.936667 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:05.936667 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:05.936667 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:05.938072 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:04:05.938072 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:04:05.938072 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:04:05.938072 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:04:05.938072 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 562/1097] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:04:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:05.942795 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb145f-7aee-4bd0-ac44-05ae6e1ae93b None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:06.063162 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb145f-7aee-4bd0-ac44-05ae6e1ae93b None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:06.092095 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:06.098517 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2124c-8839-47ee-90e4-7792cf039d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:06.099144 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2124c-8839-47ee-90e4-7792cf039d39 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:06.099420 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2124c-8839-47ee-90e4-7792cf039d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:06.099717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2124c-8839-47ee-90e4-7792cf039d39 None admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:06.100396 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e2124c-8839-47ee-90e4-7792cf039d39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:06.100692 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e2124c-8839-47ee-90e4-7792cf039d39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:06.102050 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e2124c-8839-47ee-90e4-7792cf039d39 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:06.114850 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 536/1098] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:04:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:06.120766 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f91bd1-dd29-4340-8887-716ffbb04039 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:06.130755 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:06.224299 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f91bd1-dd29-4340-8887-716ffbb04039 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:06.260864 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340cbaaf-ebf0-4d1e-a421-5c092191ace9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:06.261525 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340cbaaf-ebf0-4d1e-a421-5c092191ace9 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:06.261805 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340cbaaf-ebf0-4d1e-a421-5c092191ace9 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:06.262077 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340cbaaf-ebf0-4d1e-a421-5c092191ace9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:06.272747 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340cbaaf-ebf0-4d1e-a421-5c092191ace9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:06.274918 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340cbaaf-ebf0-4d1e-a421-5c092191ace9 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:06.287628 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-340cbaaf-ebf0-4d1e-a421-5c092191ace9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:04:06.287628 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:06.287628 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:06.287628 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:06.287628 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:06.287628 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:06.287628 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:06.287628 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:06.287628 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:06.287628 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:06.287628 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:06.287628 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:06.287628 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:04:06.287628 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:04:06.287628 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:04:06.287628 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:04:06.288841 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:06.288841 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:06.288841 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:04:06.288841 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:04:06.288841 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:04:06.288841 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:04:06.288841 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:06.288841 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:06.288841 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:06.288841 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:06.288841 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:06.288841 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:06.288841 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:06.288841 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:06.288841 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:06.288841 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:06.288841 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:06.288841 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:06.290106 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:06.290106 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:06.290106 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:04:06.290106 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:04:06.290106 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:04:06.290106 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:04:06.290106 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:04:06.290106 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:04:06.290106 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:04:06.290106 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:04:06.290106 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 563/1099] 10.222.0.60 () {56 vars in 1093 bytes} [Sun Jul 31 01:04:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:06.294838 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2124c-8839-47ee-90e4-7792cf039d39 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:06.406880 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2124c-8839-47ee-90e4-7792cf039d39 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:06.445779 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ea824-1595-4169-b249-b262de700b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:06.446420 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ea824-1595-4169-b249-b262de700b78 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:06.446700 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ea824-1595-4169-b249-b262de700b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:06.446972 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ea824-1595-4169-b249-b262de700b78 None admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:06.447804 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ea824-1595-4169-b249-b262de700b78 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:06.448111 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ea824-1595-4169-b249-b262de700b78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:06.449548 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ea824-1595-4169-b249-b262de700b78 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:06.467518 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 537/1100] 10.222.0.60 () {56 vars in 1133 bytes} [Sun Jul 31 01:04:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:06.473484 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340cbaaf-ebf0-4d1e-a421-5c092191ace9 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:06.547378 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:06.586444 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340cbaaf-ebf0-4d1e-a421-5c092191ace9 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:06.621679 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a768a61-fc8a-42f4-97dc-0ef85528581f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:06.622310 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a768a61-fc8a-42f4-97dc-0ef85528581f None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:06.622580 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a768a61-fc8a-42f4-97dc-0ef85528581f None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:06.622844 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a768a61-fc8a-42f4-97dc-0ef85528581f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:06.693710 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a768a61-fc8a-42f4-97dc-0ef85528581f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:06.695198 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a768a61-fc8a-42f4-97dc-0ef85528581f None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:06.761094 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:06.796583 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 564/1101] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:04:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:04:06.802512 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ea824-1595-4169-b249-b262de700b78 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:06.856010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:06.914062 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ea824-1595-4169-b249-b262de700b78 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:06.949903 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae678a0-98ba-41d5-aca9-a924e2561026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:06.950574 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae678a0-98ba-41d5-aca9-a924e2561026 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:06.950845 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae678a0-98ba-41d5-aca9-a924e2561026 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:06.951113 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae678a0-98ba-41d5-aca9-a924e2561026 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:06.962819 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae678a0-98ba-41d5-aca9-a924e2561026 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:06.964300 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae678a0-98ba-41d5-aca9-a924e2561026 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:06.981048 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-4ae678a0-98ba-41d5-aca9-a924e2561026 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:04:06.981048 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:06.981048 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:06.981048 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:06.981048 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:06.981048 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:06.981048 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:06.981048 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:06.981048 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:06.981048 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:06.981048 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:06.981048 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:06.981048 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:04:06.981048 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:04:06.981048 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:04:06.982044 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:04:06.982044 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:06.982044 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:06.982044 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:06.982044 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:06.982044 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:06.982044 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:06.982044 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:06.982044 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:06.982044 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:06.982044 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:06.982044 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:06.982044 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:06.982044 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:06.982044 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:06.982044 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:06.982044 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:06.983018 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:04:06.983018 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:04:06.983018 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:04:06.983018 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:04:06.983018 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 538/1102] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:04:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:06.988265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a768a61-fc8a-42f4-97dc-0ef85528581f None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:07.095200 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a768a61-fc8a-42f4-97dc-0ef85528581f None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:07.138295 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b91c7d-6944-4ea3-b9f1-183332581643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:07.138924 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b91c7d-6944-4ea3-b9f1-183332581643 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:07.139199 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b91c7d-6944-4ea3-b9f1-183332581643 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:07.139464 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b91c7d-6944-4ea3-b9f1-183332581643 None admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:07.140183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b91c7d-6944-4ea3-b9f1-183332581643 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:07.140481 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b91c7d-6944-4ea3-b9f1-183332581643 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:07.141853 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b91c7d-6944-4ea3-b9f1-183332581643 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:07.153591 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 565/1103] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:04:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:07.159383 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae678a0-98ba-41d5-aca9-a924e2561026 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:07.258795 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:07.261983 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae678a0-98ba-41d5-aca9-a924e2561026 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:07.297029 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb595c14-8f01-4b3e-baa1-1c5222147134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:07.297673 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb595c14-8f01-4b3e-baa1-1c5222147134 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:07.297946 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb595c14-8f01-4b3e-baa1-1c5222147134 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:07.298207 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb595c14-8f01-4b3e-baa1-1c5222147134 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:07.305368 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb595c14-8f01-4b3e-baa1-1c5222147134 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:07.306908 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb595c14-8f01-4b3e-baa1-1c5222147134 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:07.318769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-eb595c14-8f01-4b3e-baa1-1c5222147134 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:04:07.318769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:07.318769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:07.318769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:07.318769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:07.318769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:07.318769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:07.318769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:07.318769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:07.318769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:07.318769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:07.318769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:07.318769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:04:07.318769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:04:07.318769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:04:07.319936 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:04:07.319936 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:07.319936 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:07.319936 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:07.319936 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:07.319936 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:07.319936 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:07.319936 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:07.319936 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:07.319936 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:07.319936 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:07.319936 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:07.319936 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:07.319936 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:07.319936 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:07.319936 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:07.319936 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:07.321206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:04:07.321206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:04:07.321206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:04:07.321206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:04:07.321206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:04:07.321206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:04:07.321206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:04:07.321206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:04:07.321206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 539/1104] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:04:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:07.326643 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b91c7d-6944-4ea3-b9f1-183332581643 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:07.356652 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:07.434093 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b91c7d-6944-4ea3-b9f1-183332581643 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:07.468512 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71331e00-5a38-4939-a107-27ca654b12e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:07.469127 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71331e00-5a38-4939-a107-27ca654b12e9 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:07.469404 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71331e00-5a38-4939-a107-27ca654b12e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:07.469668 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71331e00-5a38-4939-a107-27ca654b12e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:07.470410 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71331e00-5a38-4939-a107-27ca654b12e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:07.470710 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71331e00-5a38-4939-a107-27ca654b12e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:07.472167 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71331e00-5a38-4939-a107-27ca654b12e9 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:07.484365 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 566/1105] 10.222.0.60 () {56 vars in 1148 bytes} [Sun Jul 31 01:04:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:07.490591 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb595c14-8f01-4b3e-baa1-1c5222147134 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:07.593788 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb595c14-8f01-4b3e-baa1-1c5222147134 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:07.629993 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd6fe1-f935-4a78-93a6-35445b3076c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:07.630579 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd6fe1-f935-4a78-93a6-35445b3076c8 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:07.630852 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd6fe1-f935-4a78-93a6-35445b3076c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:07.631119 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd6fe1-f935-4a78-93a6-35445b3076c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:07.631930 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd6fe1-f935-4a78-93a6-35445b3076c8 None admin] RBAC: Adding query filter params (role.id=9687bf70551b48aaaef3e0187bb47d06, scope.project.id=b931b81a237949aa845891d4bb5aa1c0, user.id=04591cd035ef4961b8b7a93e294eb881) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:07.632231 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd6fe1-f935-4a78-93a6-35445b3076c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:07.633645 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd6fe1-f935-4a78-93a6-35445b3076c8 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:07.651517 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 540/1106] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:04:07 2022] GET /identity/v3/role_assignments?user.id=04591cd035ef4961b8b7a93e294eb881&scope.project.id=b931b81a237949aa845891d4bb5aa1c0&role.id=9687bf70551b48aaaef3e0187bb47d06 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:07.892712 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dff54f-ef33-469c-b5db-f57da380e1da None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:07.893210 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dff54f-ef33-469c-b5db-f57da380e1da None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:07.893210 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dff54f-ef33-469c-b5db-f57da380e1da None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:07.894582 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 567/1107] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:07.900365 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be548b52-bc8a-4447-b72f-027a4062c7e3 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:07.900839 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be548b52-bc8a-4447-b72f-027a4062c7e3 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:07.901000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be548b52-bc8a-4447-b72f-027a4062c7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:07.920876 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-be548b52-bc8a-4447-b72f-027a4062c7e3 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:07.922113 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-be548b52-bc8a-4447-b72f-027a4062c7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:07.950635 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:08.010864 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 541/1108] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:04:08.035667 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dff54f-ef33-469c-b5db-f57da380e1da None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:08.123583 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:08.141149 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dff54f-ef33-469c-b5db-f57da380e1da None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:08.178652 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d48aa5-000c-4b49-a9bf-d3326a58fb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:08.179226 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d48aa5-000c-4b49-a9bf-d3326a58fb5f None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:08.179538 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d48aa5-000c-4b49-a9bf-d3326a58fb5f None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:08.179876 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d48aa5-000c-4b49-a9bf-d3326a58fb5f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:08.181035 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d48aa5-000c-4b49-a9bf-d3326a58fb5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:08.182509 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d48aa5-000c-4b49-a9bf-d3326a58fb5f None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:08.184275 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 568/1109] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:04:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:08.190570 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be548b52-bc8a-4447-b72f-027a4062c7e3 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:08.297770 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be548b52-bc8a-4447-b72f-027a4062c7e3 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:08.337859 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b66418-0fba-459e-97e4-33d69363cd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:08.338682 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b66418-0fba-459e-97e4-33d69363cd0e None admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:08.338963 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b66418-0fba-459e-97e4-33d69363cd0e None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:08.339748 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b66418-0fba-459e-97e4-33d69363cd0e None admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:08.340093 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b66418-0fba-459e-97e4-33d69363cd0e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:08.341611 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b66418-0fba-459e-97e4-33d69363cd0e None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:08.373897 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 542/1110] 10.222.0.60 () {60 vars in 1132 bytes} [Sun Jul 31 01:04:08 2022] POST /identity/v3/users => generated 286 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:04:10.421580 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956657de-2c21-407c-ac91-5d81aba62c20 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:10.422436 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956657de-2c21-407c-ac91-5d81aba62c20 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:10.422436 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956657de-2c21-407c-ac91-5d81aba62c20 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:10.424727 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 569/1111] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:04:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:10.430883 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb570167-7499-41cf-b486-371fc1cef135 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:10.431591 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb570167-7499-41cf-b486-371fc1cef135 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:10.431782 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb570167-7499-41cf-b486-371fc1cef135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:10.462354 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-eb570167-7499-41cf-b486-371fc1cef135 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:10.464242 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-eb570167-7499-41cf-b486-371fc1cef135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:10.467904 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:10.538635 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 543/1112] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:04:10.564393 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956657de-2c21-407c-ac91-5d81aba62c20 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:10.676574 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956657de-2c21-407c-ac91-5d81aba62c20 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:10.715965 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d072d-542a-4795-ae4d-7cf901bacb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:10.716602 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d072d-542a-4795-ae4d-7cf901bacb97 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:10.716875 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d072d-542a-4795-ae4d-7cf901bacb97 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:10.717140 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d072d-542a-4795-ae4d-7cf901bacb97 None admin] PATH_INFO: `/v3/roles/8272ca656a1f41379f9acf1ea055fb4d` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:10.718587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d072d-542a-4795-ae4d-7cf901bacb97 None admin] RBAC: Authorizing `identity:get_role(role_id=8272ca656a1f41379f9acf1ea055fb4d)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:10.719982 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d072d-542a-4795-ae4d-7cf901bacb97 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:10.721581 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 570/1113] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:10 2022] GET /identity/v3/roles/8272ca656a1f41379f9acf1ea055fb4d => generated 223 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:10.727699 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb570167-7499-41cf-b486-371fc1cef135 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:10.834565 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb570167-7499-41cf-b486-371fc1cef135 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:10.869272 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a97cc-ba3f-4812-b070-586db05dfc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:10.869902 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a97cc-ba3f-4812-b070-586db05dfc53 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:10.870180 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a97cc-ba3f-4812-b070-586db05dfc53 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:10.870449 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a97cc-ba3f-4812-b070-586db05dfc53 None admin] PATH_INFO: `/v3/users/c6f33e5a10244b7087e3e70c8d5715cb` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:10.881410 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:10.885033 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a97cc-ba3f-4812-b070-586db05dfc53 None admin] RBAC: Authorizing `identity:get_user(user_id=c6f33e5a10244b7087e3e70c8d5715cb)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:10.886917 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a97cc-ba3f-4812-b070-586db05dfc53 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:10.889545 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 544/1114] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:10 2022] GET /identity/v3/users/c6f33e5a10244b7087e3e70c8d5715cb => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:10.897701 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d072d-542a-4795-ae4d-7cf901bacb97 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:10.925978 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:11.011430 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d072d-542a-4795-ae4d-7cf901bacb97 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:11.053509 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc713fcc-3e39-4b4f-910d-692e7e1120fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:11.054403 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc713fcc-3e39-4b4f-910d-692e7e1120fe None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:11.054743 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc713fcc-3e39-4b4f-910d-692e7e1120fe None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:11.055159 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc713fcc-3e39-4b4f-910d-692e7e1120fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:11.126593 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc713fcc-3e39-4b4f-910d-692e7e1120fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:11.128439 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc713fcc-3e39-4b4f-910d-692e7e1120fe None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:11.151280 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:11.226177 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 571/1115] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:04:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:04:11.232596 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a97cc-ba3f-4812-b070-586db05dfc53 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:11.339378 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a97cc-ba3f-4812-b070-586db05dfc53 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:11.375438 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e53ce1-4026-4a57-81c9-25509daf99b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:11.376115 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e53ce1-4026-4a57-81c9-25509daf99b8 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:11.376395 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e53ce1-4026-4a57-81c9-25509daf99b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:11.376666 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e53ce1-4026-4a57-81c9-25509daf99b8 None admin] PATH_INFO: `/v3/projects/f709dc9f531144c6926efc7582a367e0` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:11.378212 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e53ce1-4026-4a57-81c9-25509daf99b8 None admin] RBAC: Authorizing `identity:get_project(project_id=f709dc9f531144c6926efc7582a367e0)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:11.379673 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e53ce1-4026-4a57-81c9-25509daf99b8 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:11.381341 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 545/1116] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:11 2022] GET /identity/v3/projects/f709dc9f531144c6926efc7582a367e0 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:11.387790 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc713fcc-3e39-4b4f-910d-692e7e1120fe None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:11.501715 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc713fcc-3e39-4b4f-910d-692e7e1120fe None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:11.529388 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:11.542298 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df59e8-eca1-468c-8725-270dfe2262a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:11.542912 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df59e8-eca1-468c-8725-270dfe2262a1 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:11.543184 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df59e8-eca1-468c-8725-270dfe2262a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:11.543577 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df59e8-eca1-468c-8725-270dfe2262a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:11.544377 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37df59e8-eca1-468c-8725-270dfe2262a1 None admin] RBAC: Adding query filter params (role.id=8272ca656a1f41379f9acf1ea055fb4d, scope.project.id=f709dc9f531144c6926efc7582a367e0, user.id=c6f33e5a10244b7087e3e70c8d5715cb) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:11.544679 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37df59e8-eca1-468c-8725-270dfe2262a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:11.546149 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37df59e8-eca1-468c-8725-270dfe2262a1 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:11.551685 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 572/1117] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:04:11 2022] GET /identity/v3/role_assignments?user.id=c6f33e5a10244b7087e3e70c8d5715cb&scope.project.id=f709dc9f531144c6926efc7582a367e0&role.id=8272ca656a1f41379f9acf1ea055fb4d => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:13.494255 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d0f45-83e8-45a9-ae0d-0ea8f7606fd1 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:13.495119 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d0f45-83e8-45a9-ae0d-0ea8f7606fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:13.495119 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d0f45-83e8-45a9-ae0d-0ea8f7606fd1 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:13.497400 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 546/1118] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:04:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:13.503918 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99c833-c657-4060-8625-ec42a1dfafbf None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:13.504606 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99c833-c657-4060-8625-ec42a1dfafbf None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:13.504696 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99c833-c657-4060-8625-ec42a1dfafbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:13.532409 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-ce99c833-c657-4060-8625-ec42a1dfafbf None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:13.533605 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-ce99c833-c657-4060-8625-ec42a1dfafbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:13.603909 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 573/1119] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:04:13.626675 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d0f45-83e8-45a9-ae0d-0ea8f7606fd1 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:13.705635 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:13.746593 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d0f45-83e8-45a9-ae0d-0ea8f7606fd1 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:13.782790 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca633c8-989b-4712-ba74-f2b13ed81568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:13.783429 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca633c8-989b-4712-ba74-f2b13ed81568 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:13.783716 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca633c8-989b-4712-ba74-f2b13ed81568 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:13.783989 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca633c8-989b-4712-ba74-f2b13ed81568 None admin] PATH_INFO: `/v3/roles/8272ca656a1f41379f9acf1ea055fb4d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:13.785508 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca633c8-989b-4712-ba74-f2b13ed81568 None admin] RBAC: Authorizing `identity:get_role(role_id=8272ca656a1f41379f9acf1ea055fb4d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:13.786873 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca633c8-989b-4712-ba74-f2b13ed81568 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:13.788262 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 547/1120] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:13 2022] GET /identity/v3/roles/8272ca656a1f41379f9acf1ea055fb4d => generated 223 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:13.794598 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce99c833-c657-4060-8625-ec42a1dfafbf None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:13.896691 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce99c833-c657-4060-8625-ec42a1dfafbf None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:13.912759 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:13.933907 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c0f4c2-ec41-4fdb-8661-c348ef241046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:13.934612 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0f4c2-ec41-4fdb-8661-c348ef241046 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:13.934887 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0f4c2-ec41-4fdb-8661-c348ef241046 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:13.935155 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0f4c2-ec41-4fdb-8661-c348ef241046 None admin] PATH_INFO: `/v3/users/c6f33e5a10244b7087e3e70c8d5715cb` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:13.936393 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c0f4c2-ec41-4fdb-8661-c348ef241046 None admin] RBAC: Authorizing `identity:get_user(user_id=c6f33e5a10244b7087e3e70c8d5715cb)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:13.937813 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c0f4c2-ec41-4fdb-8661-c348ef241046 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:13.939392 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 574/1121] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:13 2022] GET /identity/v3/users/c6f33e5a10244b7087e3e70c8d5715cb => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:13.945897 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca633c8-989b-4712-ba74-f2b13ed81568 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:14.056410 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca633c8-989b-4712-ba74-f2b13ed81568 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:14.094334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57585b2-e175-4875-b53c-e18c91a23f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:14.094972 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57585b2-e175-4875-b53c-e18c91a23f92 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:14.095251 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57585b2-e175-4875-b53c-e18c91a23f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:14.095530 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57585b2-e175-4875-b53c-e18c91a23f92 None admin] PATH_INFO: `/v3/projects/f709dc9f531144c6926efc7582a367e0` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:14.096754 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57585b2-e175-4875-b53c-e18c91a23f92 None admin] RBAC: Authorizing `identity:get_project(project_id=f709dc9f531144c6926efc7582a367e0)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:14.098189 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57585b2-e175-4875-b53c-e18c91a23f92 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:14.099904 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 548/1122] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:13 2022] GET /identity/v3/projects/f709dc9f531144c6926efc7582a367e0 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:14.109497 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c0f4c2-ec41-4fdb-8661-c348ef241046 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:14.219620 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c0f4c2-ec41-4fdb-8661-c348ef241046 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:14.254451 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadbde5a-f53f-421b-af90-11ef2a874b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:14.255072 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbde5a-f53f-421b-af90-11ef2a874b0f None admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:14.255374 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbde5a-f53f-421b-af90-11ef2a874b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:14.255670 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbde5a-f53f-421b-af90-11ef2a874b0f None admin] PATH_INFO: `/v3/projects/f709dc9f531144c6926efc7582a367e0/users/c6f33e5a10244b7087e3e70c8d5715cb/roles/8272ca656a1f41379f9acf1ea055fb4d` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:14.258251 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadbde5a-f53f-421b-af90-11ef2a874b0f None admin] RBAC: Authorizing `identity:create_grant(project_id=f709dc9f531144c6926efc7582a367e0, user_id=c6f33e5a10244b7087e3e70c8d5715cb, role_id=8272ca656a1f41379f9acf1ea055fb4d)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:14.259710 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadbde5a-f53f-421b-af90-11ef2a874b0f None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:14.274883 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 575/1123] 10.222.0.60 () {58 vars in 1439 bytes} [Sun Jul 31 01:04:14 2022] PUT /identity/v3/projects/f709dc9f531144c6926efc7582a367e0/users/c6f33e5a10244b7087e3e70c8d5715cb/roles/8272ca656a1f41379f9acf1ea055fb4d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:04:16.240199 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6cbbf-f34c-42e7-8060-b78b1c399ec5 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:16.240827 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6cbbf-f34c-42e7-8060-b78b1c399ec5 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:16.240827 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6cbbf-f34c-42e7-8060-b78b1c399ec5 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:16.242799 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 549/1124] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:04:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:16.250618 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92101da-be77-4f0e-8b6e-d8974cffd820 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:16.251043 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92101da-be77-4f0e-8b6e-d8974cffd820 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:16.251173 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92101da-be77-4f0e-8b6e-d8974cffd820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:16.279558 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-f92101da-be77-4f0e-8b6e-d8974cffd820 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:16.281014 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-f92101da-be77-4f0e-8b6e-d8974cffd820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:16.321260 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:16.350783 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 576/1125] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:04:16.374468 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc6cbbf-f34c-42e7-8060-b78b1c399ec5 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:16.379756 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:16.497084 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc6cbbf-f34c-42e7-8060-b78b1c399ec5 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:16.534272 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3915a-73a0-44a9-84f5-93afa90d28e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:16.534905 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3915a-73a0-44a9-84f5-93afa90d28e1 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:16.535180 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3915a-73a0-44a9-84f5-93afa90d28e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:16.535452 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3915a-73a0-44a9-84f5-93afa90d28e1 None admin] PATH_INFO: `/v3/roles/8272ca656a1f41379f9acf1ea055fb4d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:16.537005 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3915a-73a0-44a9-84f5-93afa90d28e1 None admin] RBAC: Authorizing `identity:get_role(role_id=8272ca656a1f41379f9acf1ea055fb4d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:16.538375 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3915a-73a0-44a9-84f5-93afa90d28e1 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:16.539741 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 550/1126] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:16 2022] GET /identity/v3/roles/8272ca656a1f41379f9acf1ea055fb4d => generated 223 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:16.546139 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92101da-be77-4f0e-8b6e-d8974cffd820 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:16.649118 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92101da-be77-4f0e-8b6e-d8974cffd820 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:16.689371 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7085cc5-c322-4b0a-8559-afb373e164fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:16.690002 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7085cc5-c322-4b0a-8559-afb373e164fa None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:16.690275 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7085cc5-c322-4b0a-8559-afb373e164fa None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:16.690543 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7085cc5-c322-4b0a-8559-afb373e164fa None admin] PATH_INFO: `/v3/users/c6f33e5a10244b7087e3e70c8d5715cb` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:16.692042 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7085cc5-c322-4b0a-8559-afb373e164fa None admin] RBAC: Authorizing `identity:get_user(user_id=c6f33e5a10244b7087e3e70c8d5715cb)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:16.693612 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7085cc5-c322-4b0a-8559-afb373e164fa None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:16.695472 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 577/1127] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:16 2022] GET /identity/v3/users/c6f33e5a10244b7087e3e70c8d5715cb => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:16.702003 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3915a-73a0-44a9-84f5-93afa90d28e1 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:16.786213 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:16.816669 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3915a-73a0-44a9-84f5-93afa90d28e1 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:16.852107 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec2518-ede9-4247-9526-841c0377c4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:16.852736 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec2518-ede9-4247-9526-841c0377c4c3 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:16.853040 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec2518-ede9-4247-9526-841c0377c4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:16.853342 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec2518-ede9-4247-9526-841c0377c4c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:16.921300 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec2518-ede9-4247-9526-841c0377c4c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:16.922773 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec2518-ede9-4247-9526-841c0377c4c3 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:16.994400 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:17.026667 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 551/1128] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:04:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:04:17.033061 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7085cc5-c322-4b0a-8559-afb373e164fa None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:17.078335 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:17.139872 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7085cc5-c322-4b0a-8559-afb373e164fa None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:17.178836 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6b321-0654-464d-8d9c-532a06ce25ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:17.179462 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6b321-0654-464d-8d9c-532a06ce25ef None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:17.179772 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6b321-0654-464d-8d9c-532a06ce25ef None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:17.180034 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6b321-0654-464d-8d9c-532a06ce25ef None admin] PATH_INFO: `/v3/projects/f709dc9f531144c6926efc7582a367e0` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:17.181334 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d6b321-0654-464d-8d9c-532a06ce25ef None admin] RBAC: Authorizing `identity:get_project(project_id=f709dc9f531144c6926efc7582a367e0)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:17.182747 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d6b321-0654-464d-8d9c-532a06ce25ef None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:17.184528 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 578/1129] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:17 2022] GET /identity/v3/projects/f709dc9f531144c6926efc7582a367e0 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:17.191653 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec2518-ede9-4247-9526-841c0377c4c3 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:17.315128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec2518-ede9-4247-9526-841c0377c4c3 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:17.357262 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71cfd6-282e-40db-9152-62bbad7e032a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:17.357837 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71cfd6-282e-40db-9152-62bbad7e032a None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:17.358146 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71cfd6-282e-40db-9152-62bbad7e032a None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:17.358449 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71cfd6-282e-40db-9152-62bbad7e032a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:17.359298 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a71cfd6-282e-40db-9152-62bbad7e032a None admin] RBAC: Adding query filter params (role.id=8272ca656a1f41379f9acf1ea055fb4d, scope.project.id=f709dc9f531144c6926efc7582a367e0, user.id=c6f33e5a10244b7087e3e70c8d5715cb) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:17.359635 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a71cfd6-282e-40db-9152-62bbad7e032a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:17.361108 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a71cfd6-282e-40db-9152-62bbad7e032a None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:17.367692 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 552/1130] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:04:17 2022] GET /identity/v3/role_assignments?user.id=c6f33e5a10244b7087e3e70c8d5715cb&scope.project.id=f709dc9f531144c6926efc7582a367e0&role.id=8272ca656a1f41379f9acf1ea055fb4d => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:19.352406 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbb361-b9a2-4f29-aa68-82a2608b3e73 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:19.353314 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbb361-b9a2-4f29-aa68-82a2608b3e73 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:19.353314 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbb361-b9a2-4f29-aa68-82a2608b3e73 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:19.356964 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 579/1131] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:04:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:19.366666 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cc396-f950-4857-b16e-454ffa005772 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:19.367195 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cc396-f950-4857-b16e-454ffa005772 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:19.367834 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cc396-f950-4857-b16e-454ffa005772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:19.388426 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-081cc396-f950-4857-b16e-454ffa005772 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:19.389662 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-081cc396-f950-4857-b16e-454ffa005772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:19.421475 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:19.468860 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 553/1132] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:04:19.503247 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dbb361-b9a2-4f29-aa68-82a2608b3e73 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:19.609271 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dbb361-b9a2-4f29-aa68-82a2608b3e73 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:19.620046 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:19.645152 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb278e-ff88-4203-8772-e128fa165577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:19.645774 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb278e-ff88-4203-8772-e128fa165577 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:19.646043 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb278e-ff88-4203-8772-e128fa165577 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:19.646311 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb278e-ff88-4203-8772-e128fa165577 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:19.647526 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb278e-ff88-4203-8772-e128fa165577 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:19.648976 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb278e-ff88-4203-8772-e128fa165577 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:19.650553 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 580/1133] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:04:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:19.657477 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cc396-f950-4857-b16e-454ffa005772 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:19.764351 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cc396-f950-4857-b16e-454ffa005772 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:19.813535 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234508b-84ff-403a-aa18-db543335df9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:19.814258 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234508b-84ff-403a-aa18-db543335df9e None admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:19.814633 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234508b-84ff-403a-aa18-db543335df9e None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:19.814945 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234508b-84ff-403a-aa18-db543335df9e None admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:19.815711 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b234508b-84ff-403a-aa18-db543335df9e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:19.817176 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b234508b-84ff-403a-aa18-db543335df9e None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:19.846714 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 554/1134] 10.222.0.60 () {60 vars in 1141 bytes} [Sun Jul 31 01:04:19 2022] POST /identity/v3/projects => generated 311 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:04:21.857700 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea8673-efce-482b-a5a7-69e0d793cda0 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:21.858514 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea8673-efce-482b-a5a7-69e0d793cda0 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:21.858514 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea8673-efce-482b-a5a7-69e0d793cda0 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:21.860732 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 581/1135] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:04:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:21.867005 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7783ac-f4a1-412e-bcaf-9394e515a199 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:21.867464 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7783ac-f4a1-412e-bcaf-9394e515a199 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:21.867592 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7783ac-f4a1-412e-bcaf-9394e515a199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:21.895314 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-ad7783ac-f4a1-412e-bcaf-9394e515a199 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:21.896600 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-ad7783ac-f4a1-412e-bcaf-9394e515a199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:21.908223 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:21.967075 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 555/1136] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:04:21.991714 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea8673-efce-482b-a5a7-69e0d793cda0 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:22.099887 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea8673-efce-482b-a5a7-69e0d793cda0 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:22.136717 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6387e2-5956-4046-8166-cba4f073b72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:22.137396 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6387e2-5956-4046-8166-cba4f073b72c None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:22.137665 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6387e2-5956-4046-8166-cba4f073b72c None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:22.137926 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6387e2-5956-4046-8166-cba4f073b72c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:22.139451 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6387e2-5956-4046-8166-cba4f073b72c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:22.140906 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6387e2-5956-4046-8166-cba4f073b72c None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:22.142492 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 582/1137] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:04:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:04:22.153836 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7783ac-f4a1-412e-bcaf-9394e515a199 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:22.256873 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7783ac-f4a1-412e-bcaf-9394e515a199 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:22.300459 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fbaaf7-c3e2-478a-b612-90b556f82f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:22.301071 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbaaf7-c3e2-478a-b612-90b556f82f9b None admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:22.301349 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbaaf7-c3e2-478a-b612-90b556f82f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:22.301620 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbaaf7-c3e2-478a-b612-90b556f82f9b None admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:22.302302 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fbaaf7-c3e2-478a-b612-90b556f82f9b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:22.303764 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fbaaf7-c3e2-478a-b612-90b556f82f9b None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:22.327216 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 556/1138] 10.222.0.60 () {60 vars in 1132 bytes} [Sun Jul 31 01:04:22 2022] POST /identity/v3/users => generated 286 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:04:24.334802 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d6757-dd5a-4b3b-b802-b98b2db4319f None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:24.335734 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d6757-dd5a-4b3b-b802-b98b2db4319f None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:24.335734 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d6757-dd5a-4b3b-b802-b98b2db4319f None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:24.337878 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 583/1139] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:04:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:24.344167 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42555c52-392a-4b25-8a05-59a8e34358ab None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:24.344619 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42555c52-392a-4b25-8a05-59a8e34358ab None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:24.344722 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42555c52-392a-4b25-8a05-59a8e34358ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:24.355441 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:24.370937 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-42555c52-392a-4b25-8a05-59a8e34358ab None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:24.372150 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-42555c52-392a-4b25-8a05-59a8e34358ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:24.443369 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 557/1140] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:04:24.466907 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d6757-dd5a-4b3b-b802-b98b2db4319f None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:24.520060 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:24.579894 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d6757-dd5a-4b3b-b802-b98b2db4319f None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:24.616751 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694bdec-82f1-49c2-9f05-2baf002666bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:24.617385 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694bdec-82f1-49c2-9f05-2baf002666bc None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:24.617653 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694bdec-82f1-49c2-9f05-2baf002666bc None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:24.617917 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694bdec-82f1-49c2-9f05-2baf002666bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:24.628566 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d694bdec-82f1-49c2-9f05-2baf002666bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:24.633436 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-d694bdec-82f1-49c2-9f05-2baf002666bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:04:24.633436 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:24.633436 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:24.633436 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:24.633436 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:24.633436 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:24.633436 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:24.633436 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:24.633436 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:24.633436 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:24.633436 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:24.633436 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:24.633436 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:24.633436 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:24.633436 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:24.633436 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:24.634529 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:24.634529 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:24.634529 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:24.634529 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:24.634529 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:24.634529 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:24.634529 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:24.634529 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:24.634529 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:24.634529 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:24.634529 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:24.634529 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:24.634529 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:24.634529 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:24.634529 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:24.634529 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:24.635451 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:24.635451 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:24.635451 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:24.635451 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:24.635451 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:24.635451 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:24.635451 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:24.635451 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:24.635451 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:24.635451 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:24.635451 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:04:24.635451 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:04:24.635451 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 584/1141] 10.222.0.60 () {56 vars in 1096 bytes} [Sun Jul 31 01:04:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:24.643414 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42555c52-392a-4b25-8a05-59a8e34358ab None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:24.750366 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42555c52-392a-4b25-8a05-59a8e34358ab None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:24.785715 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:24.791766 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e08ad-bc77-4b4f-ab08-c64ab1ec2617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:24.792383 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e08ad-bc77-4b4f-ab08-c64ab1ec2617 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:24.792662 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e08ad-bc77-4b4f-ab08-c64ab1ec2617 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:24.792933 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e08ad-bc77-4b4f-ab08-c64ab1ec2617 None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:24.793672 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59e08ad-bc77-4b4f-ab08-c64ab1ec2617 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:24.793972 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59e08ad-bc77-4b4f-ab08-c64ab1ec2617 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:24.795333 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59e08ad-bc77-4b4f-ab08-c64ab1ec2617 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:24.804312 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 558/1142] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:04:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:24.810386 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694bdec-82f1-49c2-9f05-2baf002666bc None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:24.912434 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694bdec-82f1-49c2-9f05-2baf002666bc None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:24.919542 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:24.947779 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61bbc6-e4e6-4b28-b813-b3efab5afd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:24.948405 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61bbc6-e4e6-4b28-b813-b3efab5afd56 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:24.948679 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61bbc6-e4e6-4b28-b813-b3efab5afd56 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:24.948949 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61bbc6-e4e6-4b28-b813-b3efab5afd56 None admin] PATH_INFO: `/v3/users/686fe934d4004d02a235b7037a7e250a` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:24.962217 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f61bbc6-e4e6-4b28-b813-b3efab5afd56 None admin] RBAC: Authorizing `identity:get_user(user_id=686fe934d4004d02a235b7037a7e250a)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:24.963703 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f61bbc6-e4e6-4b28-b813-b3efab5afd56 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:24.965348 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 585/1143] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:24 2022] GET /identity/v3/users/686fe934d4004d02a235b7037a7e250a => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:04:24.971352 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e08ad-bc77-4b4f-ab08-c64ab1ec2617 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:25.076938 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e08ad-bc77-4b4f-ab08-c64ab1ec2617 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:25.112227 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617b135-b5ac-4442-99b4-30bef7adb84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:25.112848 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617b135-b5ac-4442-99b4-30bef7adb84f None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:25.113145 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617b135-b5ac-4442-99b4-30bef7adb84f None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:25.113409 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617b135-b5ac-4442-99b4-30bef7adb84f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:25.179075 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:25.189309 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617b135-b5ac-4442-99b4-30bef7adb84f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:25.190769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617b135-b5ac-4442-99b4-30bef7adb84f None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:25.295075 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 559/1144] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:04:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:04:25.301411 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61bbc6-e4e6-4b28-b813-b3efab5afd56 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:25.409509 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61bbc6-e4e6-4b28-b813-b3efab5afd56 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:25.450568 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f398222-490b-4cdd-a5ae-8d5db53e24d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:25.451138 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f398222-490b-4cdd-a5ae-8d5db53e24d4 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:25.451409 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f398222-490b-4cdd-a5ae-8d5db53e24d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:25.451705 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f398222-490b-4cdd-a5ae-8d5db53e24d4 None admin] PATH_INFO: `/v3/projects/5d6e57c880f44ee9b9974be73154cd04` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:25.452976 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f398222-490b-4cdd-a5ae-8d5db53e24d4 None admin] RBAC: Authorizing `identity:get_project(project_id=5d6e57c880f44ee9b9974be73154cd04)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:25.454400 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f398222-490b-4cdd-a5ae-8d5db53e24d4 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:25.456095 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 586/1145] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:25 2022] GET /identity/v3/projects/5d6e57c880f44ee9b9974be73154cd04 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:25.463298 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617b135-b5ac-4442-99b4-30bef7adb84f None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:25.572168 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:25.579528 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617b135-b5ac-4442-99b4-30bef7adb84f None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:25.626624 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2de1e4-c7d3-44fb-8d4e-2be3473d713e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:25.627643 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2de1e4-c7d3-44fb-8d4e-2be3473d713e None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:25.627924 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2de1e4-c7d3-44fb-8d4e-2be3473d713e None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:25.628200 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2de1e4-c7d3-44fb-8d4e-2be3473d713e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:25.628998 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2de1e4-c7d3-44fb-8d4e-2be3473d713e None admin] RBAC: Adding query filter params (role.id=fef526a7d2e741ce995d107f3ac934ae, scope.project.id=5d6e57c880f44ee9b9974be73154cd04, user.id=686fe934d4004d02a235b7037a7e250a) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:25.629305 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2de1e4-c7d3-44fb-8d4e-2be3473d713e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:25.630738 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2de1e4-c7d3-44fb-8d4e-2be3473d713e None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:25.637119 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 560/1146] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:04:25 2022] GET /identity/v3/role_assignments?user.id=686fe934d4004d02a235b7037a7e250a&scope.project.id=5d6e57c880f44ee9b9974be73154cd04&role.id=fef526a7d2e741ce995d107f3ac934ae => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:27.591308 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c059e-8805-4561-bae8-047a65c00ade None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:27.591922 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c059e-8805-4561-bae8-047a65c00ade None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:27.592024 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c059e-8805-4561-bae8-047a65c00ade None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:27.593400 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 587/1147] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:27.601091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b22267-d3a4-4a1f-bf49-1cecfff15aac None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:27.601847 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b22267-d3a4-4a1f-bf49-1cecfff15aac None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:27.602018 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b22267-d3a4-4a1f-bf49-1cecfff15aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:27.628782 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-67b22267-d3a4-4a1f-bf49-1cecfff15aac None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:27.629986 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-67b22267-d3a4-4a1f-bf49-1cecfff15aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:27.700939 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 561/1148] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:04:27.723519 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c059e-8805-4561-bae8-047a65c00ade None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:27.758539 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:27.837000 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c059e-8805-4561-bae8-047a65c00ade None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:27.882910 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4037999-de45-4127-b923-0df7fdc46089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:27.883809 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4037999-de45-4127-b923-0df7fdc46089 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:27.884217 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4037999-de45-4127-b923-0df7fdc46089 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:27.884663 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4037999-de45-4127-b923-0df7fdc46089 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:27.896196 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4037999-de45-4127-b923-0df7fdc46089 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:27.901043 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-c4037999-de45-4127-b923-0df7fdc46089 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:04:27.901043 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:27.901043 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:27.901043 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:27.901043 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:27.901043 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:27.901043 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:27.901043 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:27.901043 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:27.901043 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:27.901043 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:27.901043 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:27.901043 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:27.901043 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:27.901043 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:27.901043 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:27.902135 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:27.902135 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:27.902135 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:27.902135 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:27.902135 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:27.902135 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:27.902135 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:27.902135 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:27.902135 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:27.902135 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:27.902135 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:27.902135 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:27.902135 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:27.902135 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:27.902135 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:27.902135 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:27.902971 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:27.902971 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:27.902971 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:27.902971 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:27.902971 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:27.902971 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:27.902971 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:27.902971 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:27.902971 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:27.902971 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:27.902971 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:04:27.902971 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:04:27.902971 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 588/1149] 10.222.0.60 () {56 vars in 1096 bytes} [Sun Jul 31 01:04:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:27.909181 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b22267-d3a4-4a1f-bf49-1cecfff15aac None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:28.009695 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:28.023577 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b22267-d3a4-4a1f-bf49-1cecfff15aac None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:28.058115 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b276d-1460-4427-a65d-1bdb67af45dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:28.058719 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b276d-1460-4427-a65d-1bdb67af45dc None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:28.058992 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b276d-1460-4427-a65d-1bdb67af45dc None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:28.059256 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b276d-1460-4427-a65d-1bdb67af45dc None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:28.059981 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b276d-1460-4427-a65d-1bdb67af45dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:28.060279 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b276d-1460-4427-a65d-1bdb67af45dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:28.061634 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b276d-1460-4427-a65d-1bdb67af45dc None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:28.070335 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 562/1150] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:04:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:28.076699 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4037999-de45-4127-b923-0df7fdc46089 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:28.173458 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:28.187456 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4037999-de45-4127-b923-0df7fdc46089 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:28.227141 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717820ba-cac1-4e82-8572-e46c3d7242b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:28.227814 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717820ba-cac1-4e82-8572-e46c3d7242b4 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:28.228085 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717820ba-cac1-4e82-8572-e46c3d7242b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:28.228350 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717820ba-cac1-4e82-8572-e46c3d7242b4 None admin] PATH_INFO: `/v3/users/686fe934d4004d02a235b7037a7e250a` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:28.229545 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717820ba-cac1-4e82-8572-e46c3d7242b4 None admin] RBAC: Authorizing `identity:get_user(user_id=686fe934d4004d02a235b7037a7e250a)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:28.231010 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717820ba-cac1-4e82-8572-e46c3d7242b4 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:28.232643 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 589/1151] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:28 2022] GET /identity/v3/users/686fe934d4004d02a235b7037a7e250a => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:28.241957 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b276d-1460-4427-a65d-1bdb67af45dc None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:28.352175 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b276d-1460-4427-a65d-1bdb67af45dc None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:28.393000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029224c4-9a7a-4181-a6a1-eb386f8ba803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:28.393637 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029224c4-9a7a-4181-a6a1-eb386f8ba803 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:28.393916 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029224c4-9a7a-4181-a6a1-eb386f8ba803 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:28.394186 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029224c4-9a7a-4181-a6a1-eb386f8ba803 None admin] PATH_INFO: `/v3/projects/5d6e57c880f44ee9b9974be73154cd04` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:28.395349 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029224c4-9a7a-4181-a6a1-eb386f8ba803 None admin] RBAC: Authorizing `identity:get_project(project_id=5d6e57c880f44ee9b9974be73154cd04)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:28.396809 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029224c4-9a7a-4181-a6a1-eb386f8ba803 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:28.398507 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 563/1152] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:28 2022] GET /identity/v3/projects/5d6e57c880f44ee9b9974be73154cd04 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:28.405062 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717820ba-cac1-4e82-8572-e46c3d7242b4 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:28.510911 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717820ba-cac1-4e82-8572-e46c3d7242b4 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:28.547702 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8208cc-e998-4267-9c76-c261383450b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:28.548371 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8208cc-e998-4267-9c76-c261383450b1 None admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:28.548643 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8208cc-e998-4267-9c76-c261383450b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:28.548916 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8208cc-e998-4267-9c76-c261383450b1 None admin] PATH_INFO: `/v3/projects/5d6e57c880f44ee9b9974be73154cd04/users/686fe934d4004d02a235b7037a7e250a/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:28.551112 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8208cc-e998-4267-9c76-c261383450b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d6e57c880f44ee9b9974be73154cd04, user_id=686fe934d4004d02a235b7037a7e250a, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:28.552579 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8208cc-e998-4267-9c76-c261383450b1 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:28.568161 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 590/1153] 10.222.0.60 () {58 vars in 1439 bytes} [Sun Jul 31 01:04:28 2022] PUT /identity/v3/projects/5d6e57c880f44ee9b9974be73154cd04/users/686fe934d4004d02a235b7037a7e250a/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:04:30.512428 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70afe75-393e-4886-90c3-380c55680de4 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:30.513006 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70afe75-393e-4886-90c3-380c55680de4 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:30.513006 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70afe75-393e-4886-90c3-380c55680de4 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:30.514321 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 564/1154] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:30.520624 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6c9f1-f3d0-404f-98de-4f8265c9a225 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:30.521363 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6c9f1-f3d0-404f-98de-4f8265c9a225 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:30.521492 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6c9f1-f3d0-404f-98de-4f8265c9a225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:30.544383 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-13d6c9f1-f3d0-404f-98de-4f8265c9a225 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:30.545582 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-13d6c9f1-f3d0-404f-98de-4f8265c9a225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:30.561591 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:30.628041 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 591/1155] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:04:30.654827 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70afe75-393e-4886-90c3-380c55680de4 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:30.676194 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:30.775636 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70afe75-393e-4886-90c3-380c55680de4 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:30.812250 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68037b-9e80-4325-82b2-7fd6518590f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:30.812883 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68037b-9e80-4325-82b2-7fd6518590f9 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:30.813155 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68037b-9e80-4325-82b2-7fd6518590f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:30.813423 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68037b-9e80-4325-82b2-7fd6518590f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:30.824966 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd68037b-9e80-4325-82b2-7fd6518590f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:30.830105 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-dd68037b-9e80-4325-82b2-7fd6518590f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:04:30.830105 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:30.830105 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:30.830105 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:30.830105 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:30.830105 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:30.830105 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:30.830105 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:30.830105 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:30.830105 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:30.830105 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:30.830105 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:30.830105 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:30.830105 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:30.830105 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:30.830105 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:30.831169 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:30.831169 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:30.831169 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:30.831169 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:30.831169 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:30.831169 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:30.831169 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:30.831169 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:30.831169 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:30.831169 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:30.831169 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:30.831169 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:30.831169 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:30.831169 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:30.831169 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:30.831169 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:30.832392 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:30.832392 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:30.832392 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:30.832392 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:30.832392 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:30.832392 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:30.832392 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:30.832392 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:30.832392 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:30.832392 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:30.832392 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:04:30.832392 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:04:30.832392 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 565/1156] 10.222.0.60 () {56 vars in 1096 bytes} [Sun Jul 31 01:04:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:30.840802 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6c9f1-f3d0-404f-98de-4f8265c9a225 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:30.958628 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6c9f1-f3d0-404f-98de-4f8265c9a225 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:30.998763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2cdae-30e6-41b7-ae8f-c53f1514eb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:30.999440 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2cdae-30e6-41b7-ae8f-c53f1514eb8d None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:30.999759 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2cdae-30e6-41b7-ae8f-c53f1514eb8d None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:31.000028 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2cdae-30e6-41b7-ae8f-c53f1514eb8d None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:31.000746 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2cdae-30e6-41b7-ae8f-c53f1514eb8d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:31.001046 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2cdae-30e6-41b7-ae8f-c53f1514eb8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:31.002774 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2cdae-30e6-41b7-ae8f-c53f1514eb8d None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:31.010813 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 592/1157] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:04:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:31.019861 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68037b-9e80-4325-82b2-7fd6518590f9 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:31.101818 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:31.125602 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68037b-9e80-4325-82b2-7fd6518590f9 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:31.164227 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b62dc4-0c13-475a-9dda-ced4ea4f761e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:31.164868 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b62dc4-0c13-475a-9dda-ced4ea4f761e None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:31.165146 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b62dc4-0c13-475a-9dda-ced4ea4f761e None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:31.165414 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b62dc4-0c13-475a-9dda-ced4ea4f761e None admin] PATH_INFO: `/v3/users/686fe934d4004d02a235b7037a7e250a` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:31.166688 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b62dc4-0c13-475a-9dda-ced4ea4f761e None admin] RBAC: Authorizing `identity:get_user(user_id=686fe934d4004d02a235b7037a7e250a)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:31.168347 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b62dc4-0c13-475a-9dda-ced4ea4f761e None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:31.169979 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 566/1158] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:31 2022] GET /identity/v3/users/686fe934d4004d02a235b7037a7e250a => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:31.179274 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2cdae-30e6-41b7-ae8f-c53f1514eb8d None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:31.197225 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:31.286496 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2cdae-30e6-41b7-ae8f-c53f1514eb8d None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:31.321176 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cbdee9-35ec-41d4-808c-82664adee2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:31.321787 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbdee9-35ec-41d4-808c-82664adee2a3 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:31.322057 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbdee9-35ec-41d4-808c-82664adee2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:31.322325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbdee9-35ec-41d4-808c-82664adee2a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:31.395421 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cbdee9-35ec-41d4-808c-82664adee2a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:31.396906 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cbdee9-35ec-41d4-808c-82664adee2a3 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:31.410228 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:31.497602 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 593/1159] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:04:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:04:31.507845 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b62dc4-0c13-475a-9dda-ced4ea4f761e None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:31.614971 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b62dc4-0c13-475a-9dda-ced4ea4f761e None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:31.649104 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca41dbe-157f-4b98-8321-435b68ad2254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:31.649729 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca41dbe-157f-4b98-8321-435b68ad2254 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:31.650001 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca41dbe-157f-4b98-8321-435b68ad2254 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:31.650272 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca41dbe-157f-4b98-8321-435b68ad2254 None admin] PATH_INFO: `/v3/projects/5d6e57c880f44ee9b9974be73154cd04` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:31.651570 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca41dbe-157f-4b98-8321-435b68ad2254 None admin] RBAC: Authorizing `identity:get_project(project_id=5d6e57c880f44ee9b9974be73154cd04)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:31.653029 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca41dbe-157f-4b98-8321-435b68ad2254 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:31.654665 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 567/1160] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:31 2022] GET /identity/v3/projects/5d6e57c880f44ee9b9974be73154cd04 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:31.661799 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cbdee9-35ec-41d4-808c-82664adee2a3 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:31.768426 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cbdee9-35ec-41d4-808c-82664adee2a3 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:31.782370 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:31.804893 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3fb697-906c-4621-b46e-11b5697b0f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:31.805502 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fb697-906c-4621-b46e-11b5697b0f11 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:31.805777 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fb697-906c-4621-b46e-11b5697b0f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:31.806051 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fb697-906c-4621-b46e-11b5697b0f11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:31.806834 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3fb697-906c-4621-b46e-11b5697b0f11 None admin] RBAC: Adding query filter params (role.id=fef526a7d2e741ce995d107f3ac934ae, scope.project.id=5d6e57c880f44ee9b9974be73154cd04, user.id=686fe934d4004d02a235b7037a7e250a) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:31.807147 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3fb697-906c-4621-b46e-11b5697b0f11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:31.808637 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3fb697-906c-4621-b46e-11b5697b0f11 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:31.814534 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 594/1161] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:04:31 2022] GET /identity/v3/role_assignments?user.id=686fe934d4004d02a235b7037a7e250a&scope.project.id=5d6e57c880f44ee9b9974be73154cd04&role.id=fef526a7d2e741ce995d107f3ac934ae => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:33.832659 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a16b6-0d6e-4f46-9f1d-fe3f9e9d2ca4 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:33.833258 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a16b6-0d6e-4f46-9f1d-fe3f9e9d2ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:33.833258 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a16b6-0d6e-4f46-9f1d-fe3f9e9d2ca4 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:33.834567 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 568/1162] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:33.840931 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22315de2-81e3-4dc9-b4eb-78ca87fd3f26 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:33.841634 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22315de2-81e3-4dc9-b4eb-78ca87fd3f26 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:33.841822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22315de2-81e3-4dc9-b4eb-78ca87fd3f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:33.865671 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-22315de2-81e3-4dc9-b4eb-78ca87fd3f26 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:33.866853 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-22315de2-81e3-4dc9-b4eb-78ca87fd3f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:33.941719 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 595/1163] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:04:33.964182 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a16b6-0d6e-4f46-9f1d-fe3f9e9d2ca4 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:33.982872 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:34.073540 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a16b6-0d6e-4f46-9f1d-fe3f9e9d2ca4 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:34.108457 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1c389-2553-4d94-83d2-a9ae49393db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:34.108999 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1c389-2553-4d94-83d2-a9ae49393db1 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:34.109272 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1c389-2553-4d94-83d2-a9ae49393db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:34.109540 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1c389-2553-4d94-83d2-a9ae49393db1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:34.177862 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc1c389-2553-4d94-83d2-a9ae49393db1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:34.179296 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc1c389-2553-4d94-83d2-a9ae49393db1 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:34.194487 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:34.286689 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 569/1164] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:04:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:04:34.293652 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22315de2-81e3-4dc9-b4eb-78ca87fd3f26 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:34.403996 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22315de2-81e3-4dc9-b4eb-78ca87fd3f26 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:34.411551 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:34.442253 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82442f73-3053-4f09-aaee-a610ead11935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:34.442878 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82442f73-3053-4f09-aaee-a610ead11935 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:34.443157 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82442f73-3053-4f09-aaee-a610ead11935 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:34.443411 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82442f73-3053-4f09-aaee-a610ead11935 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:34.450412 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82442f73-3053-4f09-aaee-a610ead11935 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:34.451882 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82442f73-3053-4f09-aaee-a610ead11935 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:34.463519 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-82442f73-3053-4f09-aaee-a610ead11935 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 31 01:04:34.463519 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:34.463519 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 31 01:04:34.463519 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 31 01:04:34.463519 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:04:34.463519 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:04:34.463519 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:04:34.463519 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:04:34.463519 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 31 01:04:34.463519 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:04:34.463519 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:04:34.463519 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:04:34.463519 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:34.463519 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:34.463519 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:34.463519 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:34.463519 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:34.464762 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:34.464762 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:34.464762 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:34.464762 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:34.464762 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:34.464762 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:34.464762 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:04:34.464762 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:04:34.464762 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:04:34.464762 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:04:34.464762 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:34.464762 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:34.464762 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:34.464762 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:34.464762 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:34.464762 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:34.465675 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:34.465675 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:34.465675 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:34.465675 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:34.465675 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:34.465675 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:34.465675 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:34.465675 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:34.465675 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:34.465675 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:34.465675 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 31 01:04:34.465675 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:04:34.465675 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 31 01:04:34.465675 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:04:34.465675 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 596/1165] 10.222.0.60 () {56 vars in 1117 bytes} [Sun Jul 31 01:04:34 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:34.470993 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1c389-2553-4d94-83d2-a9ae49393db1 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:34.575070 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1c389-2553-4d94-83d2-a9ae49393db1 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:34.588925 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:34.615836 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240fbf2c-8ff7-4b22-9084-230e43a9f970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:34.616399 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fbf2c-8ff7-4b22-9084-230e43a9f970 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:34.616678 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fbf2c-8ff7-4b22-9084-230e43a9f970 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:34.616946 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fbf2c-8ff7-4b22-9084-230e43a9f970 None admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:34.617636 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240fbf2c-8ff7-4b22-9084-230e43a9f970 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:34.617934 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240fbf2c-8ff7-4b22-9084-230e43a9f970 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:34.619294 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240fbf2c-8ff7-4b22-9084-230e43a9f970 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:34.626410 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 570/1166] 10.222.0.60 () {56 vars in 1115 bytes} [Sun Jul 31 01:04:34 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:36.585702 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5ed8c-4e24-43ea-8553-64295c32cb0b None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:36.586261 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5ed8c-4e24-43ea-8553-64295c32cb0b None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:36.586261 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5ed8c-4e24-43ea-8553-64295c32cb0b None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:36.587905 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 597/1167] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:36.594295 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ab84a-9100-4a7e-989c-1a2a245c39e2 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:36.595024 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ab84a-9100-4a7e-989c-1a2a245c39e2 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:36.595172 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ab84a-9100-4a7e-989c-1a2a245c39e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:36.623839 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-8e3ab84a-9100-4a7e-989c-1a2a245c39e2 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:36.625041 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-8e3ab84a-9100-4a7e-989c-1a2a245c39e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:36.694667 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 571/1168] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:04:36.717802 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5ed8c-4e24-43ea-8553-64295c32cb0b None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:36.830498 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5ed8c-4e24-43ea-8553-64295c32cb0b None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:36.871089 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c134cd-6bdd-45c3-957a-72b81e166171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:36.871733 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c134cd-6bdd-45c3-957a-72b81e166171 None admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:36.872012 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c134cd-6bdd-45c3-957a-72b81e166171 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:36.872329 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c134cd-6bdd-45c3-957a-72b81e166171 None admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:36.873027 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c134cd-6bdd-45c3-957a-72b81e166171 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:36.874453 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c134cd-6bdd-45c3-957a-72b81e166171 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:36.892967 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 598/1169] 10.222.0.60 () {60 vars in 1138 bytes} [Sun Jul 31 01:04:36 2022] POST /identity/v3/domains => generated 267 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:04:38.919434 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87cd51b-eeed-4591-b9fb-6bb39af10d19 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:38.920022 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87cd51b-eeed-4591-b9fb-6bb39af10d19 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:38.920022 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87cd51b-eeed-4591-b9fb-6bb39af10d19 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:38.921423 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 572/1170] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:04:38.927795 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97b60b-84ed-4f1c-b1fc-ab60aa24796e None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:38.928479 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97b60b-84ed-4f1c-b1fc-ab60aa24796e None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:38.928619 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97b60b-84ed-4f1c-b1fc-ab60aa24796e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:38.949572 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-1c97b60b-84ed-4f1c-b1fc-ab60aa24796e None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:38.950743 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-1c97b60b-84ed-4f1c-b1fc-ab60aa24796e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:38.971568 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:39.022464 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 599/1171] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:04:39.045338 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87cd51b-eeed-4591-b9fb-6bb39af10d19 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:39.156213 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87cd51b-eeed-4591-b9fb-6bb39af10d19 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:39.166516 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:39.193236 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540210b6-68e5-4d75-b775-05a45945f29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:39.193802 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540210b6-68e5-4d75-b775-05a45945f29f None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:39.194072 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540210b6-68e5-4d75-b775-05a45945f29f None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:39.194323 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540210b6-68e5-4d75-b775-05a45945f29f None admin] PATH_INFO: `/v3/domains/e79b20f8766841d39584d8cbf9ef45d9` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:39.204698 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540210b6-68e5-4d75-b775-05a45945f29f None admin] RBAC: Authorizing `identity:get_domain(domain_id=e79b20f8766841d39584d8cbf9ef45d9)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:39.206141 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540210b6-68e5-4d75-b775-05a45945f29f None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:39.207806 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 573/1172] 10.222.0.60 () {56 vars in 1183 bytes} [Sun Jul 31 01:04:39 2022] GET /identity/v3/domains/e79b20f8766841d39584d8cbf9ef45d9 => generated 267 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:39.214591 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c97b60b-84ed-4f1c-b1fc-ab60aa24796e None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:39.318212 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c97b60b-84ed-4f1c-b1fc-ab60aa24796e None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:39.366743 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe48403-f036-4476-b94e-f082b0eff835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:39.367366 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe48403-f036-4476-b94e-f082b0eff835 None admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:39.367669 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe48403-f036-4476-b94e-f082b0eff835 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:39.367937 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe48403-f036-4476-b94e-f082b0eff835 None admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:39.368611 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe48403-f036-4476-b94e-f082b0eff835 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:39.370036 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe48403-f036-4476-b94e-f082b0eff835 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:39.403079 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 600/1173] 10.222.0.60 () {60 vars in 1141 bytes} [Sun Jul 31 01:04:39 2022] POST /identity/v3/projects => generated 361 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:04:41.387045 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12952e5f-7668-4e59-966d-2917c20e481a None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:41.387613 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12952e5f-7668-4e59-966d-2917c20e481a None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:41.387613 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12952e5f-7668-4e59-966d-2917c20e481a None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:41.388973 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 574/1174] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:41.394379 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57720a-70f9-40c3-be73-29dd877fc827 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:41.394796 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57720a-70f9-40c3-be73-29dd877fc827 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:41.394914 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57720a-70f9-40c3-be73-29dd877fc827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:41.413856 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-7e57720a-70f9-40c3-be73-29dd877fc827 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:41.415037 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-7e57720a-70f9-40c3-be73-29dd877fc827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:41.416966 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:41.498810 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 601/1175] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:04:41.524542 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12952e5f-7668-4e59-966d-2917c20e481a None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:41.642243 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12952e5f-7668-4e59-966d-2917c20e481a None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:41.677165 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dce0f6-7e1d-4c2f-94a3-659f7813675f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:41.677814 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dce0f6-7e1d-4c2f-94a3-659f7813675f None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:41.678064 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dce0f6-7e1d-4c2f-94a3-659f7813675f None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:41.678315 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dce0f6-7e1d-4c2f-94a3-659f7813675f None admin] PATH_INFO: `/v3/domains/e79b20f8766841d39584d8cbf9ef45d9` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:41.679457 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dce0f6-7e1d-4c2f-94a3-659f7813675f None admin] RBAC: Authorizing `identity:get_domain(domain_id=e79b20f8766841d39584d8cbf9ef45d9)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:41.680904 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dce0f6-7e1d-4c2f-94a3-659f7813675f None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:41.682509 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 575/1176] 10.222.0.60 () {56 vars in 1183 bytes} [Sun Jul 31 01:04:41 2022] GET /identity/v3/domains/e79b20f8766841d39584d8cbf9ef45d9 => generated 267 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:41.688635 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57720a-70f9-40c3-be73-29dd877fc827 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:41.789891 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57720a-70f9-40c3-be73-29dd877fc827 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:41.824146 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a50f0a2-0793-4dcb-bdaa-69da3ff95583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:41.824748 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50f0a2-0793-4dcb-bdaa-69da3ff95583 None admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:41.825015 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50f0a2-0793-4dcb-bdaa-69da3ff95583 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:41.825279 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50f0a2-0793-4dcb-bdaa-69da3ff95583 None admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:41.825955 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a50f0a2-0793-4dcb-bdaa-69da3ff95583 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:41.827382 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a50f0a2-0793-4dcb-bdaa-69da3ff95583 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:41.837215 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:41.850332 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 602/1177] 10.222.0.60 () {60 vars in 1132 bytes} [Sun Jul 31 01:04:41 2022] POST /identity/v3/users => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:04:43.856249 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abb6ca-999e-4192-83e0-35159d54dc1f None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:43.856815 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abb6ca-999e-4192-83e0-35159d54dc1f None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:43.856815 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abb6ca-999e-4192-83e0-35159d54dc1f None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:43.858132 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 576/1178] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:43.864638 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb28e1-0645-427f-893e-5e299d029aa1 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:43.865358 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb28e1-0645-427f-893e-5e299d029aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:43.865506 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb28e1-0645-427f-893e-5e299d029aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:43.892872 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-10fb28e1-0645-427f-893e-5e299d029aa1 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:43.894061 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-10fb28e1-0645-427f-893e-5e299d029aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:43.966384 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 603/1179] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:04:44.001359 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86abb6ca-999e-4192-83e0-35159d54dc1f None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:44.042075 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:44.111003 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86abb6ca-999e-4192-83e0-35159d54dc1f None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:44.146147 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb72eda-f83c-4445-8666-29d656927637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:44.146771 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb72eda-f83c-4445-8666-29d656927637 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:44.147044 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb72eda-f83c-4445-8666-29d656927637 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:44.147306 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb72eda-f83c-4445-8666-29d656927637 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:44.158481 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb72eda-f83c-4445-8666-29d656927637 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:44.163347 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-0fb72eda-f83c-4445-8666-29d656927637 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:04:44.163347 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:44.163347 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:44.163347 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:44.163347 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:44.163347 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:44.163347 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:44.163347 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:44.163347 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:44.163347 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:44.163347 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:44.163347 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:44.163347 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:44.163347 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:44.163347 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:44.163347 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:44.164431 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:44.164431 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:44.164431 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:44.164431 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:44.164431 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:44.164431 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:44.164431 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:44.164431 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:44.164431 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:44.164431 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:44.164431 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:44.164431 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:44.164431 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:44.164431 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:44.164431 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:44.164431 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:44.165396 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:44.165396 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:44.165396 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:44.165396 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:44.165396 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:44.165396 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:44.165396 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:44.165396 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:44.165396 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:44.165396 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:44.165396 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:04:44.165396 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:04:44.165396 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 577/1180] 10.222.0.60 () {56 vars in 1096 bytes} [Sun Jul 31 01:04:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:44.170909 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb28e1-0645-427f-893e-5e299d029aa1 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:44.279141 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb28e1-0645-427f-893e-5e299d029aa1 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:44.301685 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:44.318296 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49a4e3-d9f3-4712-999a-2cee86dd73d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:44.319229 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49a4e3-d9f3-4712-999a-2cee86dd73d0 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:44.319701 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49a4e3-d9f3-4712-999a-2cee86dd73d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:44.320031 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49a4e3-d9f3-4712-999a-2cee86dd73d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:44.321342 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f49a4e3-d9f3-4712-999a-2cee86dd73d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:44.321735 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f49a4e3-d9f3-4712-999a-2cee86dd73d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:44.324012 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f49a4e3-d9f3-4712-999a-2cee86dd73d0 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:44.337945 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 604/1181] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:04:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:44.347279 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb72eda-f83c-4445-8666-29d656927637 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:44.444822 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:44.451671 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb72eda-f83c-4445-8666-29d656927637 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:44.489612 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f21aa2-bcef-4e61-85e9-85aa9a1189c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:44.490253 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f21aa2-bcef-4e61-85e9-85aa9a1189c6 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:44.490532 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f21aa2-bcef-4e61-85e9-85aa9a1189c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:44.490813 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f21aa2-bcef-4e61-85e9-85aa9a1189c6 None admin] PATH_INFO: `/v3/users/12a9179a4f7a45a7835c03d5ed6434e3` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:44.504673 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f21aa2-bcef-4e61-85e9-85aa9a1189c6 None admin] RBAC: Authorizing `identity:get_user(user_id=12a9179a4f7a45a7835c03d5ed6434e3)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:44.506117 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f21aa2-bcef-4e61-85e9-85aa9a1189c6 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:44.507764 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 578/1182] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:44 2022] GET /identity/v3/users/12a9179a4f7a45a7835c03d5ed6434e3 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:44.515264 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49a4e3-d9f3-4712-999a-2cee86dd73d0 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:44.620545 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49a4e3-d9f3-4712-999a-2cee86dd73d0 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:44.660444 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd4f7c-a425-41ef-8943-4067012d03bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:44.661057 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd4f7c-a425-41ef-8943-4067012d03bf None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:44.661335 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd4f7c-a425-41ef-8943-4067012d03bf None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:44.661609 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd4f7c-a425-41ef-8943-4067012d03bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:44.716970 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:44.733297 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd4f7c-a425-41ef-8943-4067012d03bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:44.734762 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd4f7c-a425-41ef-8943-4067012d03bf None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:44.838163 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 605/1183] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:04:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:04:44.844984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f21aa2-bcef-4e61-85e9-85aa9a1189c6 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:44.960077 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f21aa2-bcef-4e61-85e9-85aa9a1189c6 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:44.998373 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a962ef9-8062-43f5-8679-30a7a7ebaac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:44.998992 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a962ef9-8062-43f5-8679-30a7a7ebaac8 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:44.999261 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a962ef9-8062-43f5-8679-30a7a7ebaac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:44.999524 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a962ef9-8062-43f5-8679-30a7a7ebaac8 None admin] PATH_INFO: `/v3/projects/859d8c5c1d864e95844e3e15262dd548` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:45.000829 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a962ef9-8062-43f5-8679-30a7a7ebaac8 None admin] RBAC: Authorizing `identity:get_project(project_id=859d8c5c1d864e95844e3e15262dd548)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:45.002613 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a962ef9-8062-43f5-8679-30a7a7ebaac8 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:45.004301 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 579/1184] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:44 2022] GET /identity/v3/projects/859d8c5c1d864e95844e3e15262dd548 => generated 361 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:45.010491 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd4f7c-a425-41ef-8943-4067012d03bf None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:45.102329 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:45.118695 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd4f7c-a425-41ef-8943-4067012d03bf None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:45.156999 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce802613-9c7f-4cc5-91e9-60baff9ed09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:45.157614 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce802613-9c7f-4cc5-91e9-60baff9ed09d None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:45.157888 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce802613-9c7f-4cc5-91e9-60baff9ed09d None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:45.158152 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce802613-9c7f-4cc5-91e9-60baff9ed09d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:45.158929 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce802613-9c7f-4cc5-91e9-60baff9ed09d None admin] RBAC: Adding query filter params (role.id=fef526a7d2e741ce995d107f3ac934ae, scope.project.id=859d8c5c1d864e95844e3e15262dd548, user.id=12a9179a4f7a45a7835c03d5ed6434e3) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:45.159224 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce802613-9c7f-4cc5-91e9-60baff9ed09d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:45.160693 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce802613-9c7f-4cc5-91e9-60baff9ed09d None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:45.166162 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 606/1185] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:04:45 2022] GET /identity/v3/role_assignments?user.id=12a9179a4f7a45a7835c03d5ed6434e3&scope.project.id=859d8c5c1d864e95844e3e15262dd548&role.id=fef526a7d2e741ce995d107f3ac934ae => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:47.125729 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02f0e6-6257-4278-8039-a4f9f7a246c8 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:47.126957 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02f0e6-6257-4278-8039-a4f9f7a246c8 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:47.126957 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02f0e6-6257-4278-8039-a4f9f7a246c8 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:47.129137 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 580/1186] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:04:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:47.137894 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ab414-6d47-4d7a-b314-e839d301935e None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:47.138338 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ab414-6d47-4d7a-b314-e839d301935e None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:47.138440 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ab414-6d47-4d7a-b314-e839d301935e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:47.162275 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-028ab414-6d47-4d7a-b314-e839d301935e None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:47.163585 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-028ab414-6d47-4d7a-b314-e839d301935e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:47.237554 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 607/1187] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:04:47.264321 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa02f0e6-6257-4278-8039-a4f9f7a246c8 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:47.292968 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:47.386331 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa02f0e6-6257-4278-8039-a4f9f7a246c8 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:47.422689 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc9b69-edbe-4ea6-8736-cfae29da72ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:47.423316 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc9b69-edbe-4ea6-8736-cfae29da72ca None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:47.423634 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc9b69-edbe-4ea6-8736-cfae29da72ca None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:47.423904 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc9b69-edbe-4ea6-8736-cfae29da72ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:47.434777 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adc9b69-edbe-4ea6-8736-cfae29da72ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:47.439708 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-3adc9b69-edbe-4ea6-8736-cfae29da72ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:04:47.439708 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:47.439708 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:47.439708 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:47.439708 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:47.439708 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:47.439708 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:47.439708 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:47.439708 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:47.439708 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:47.439708 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:47.439708 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:47.439708 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:47.439708 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:47.439708 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:47.439708 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:47.440820 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:47.440820 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:47.440820 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:47.440820 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:47.440820 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:47.440820 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:47.440820 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:47.440820 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:47.440820 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:47.440820 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:47.440820 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:47.440820 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:47.440820 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:47.440820 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:47.440820 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:47.440820 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:47.442091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:47.442091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:47.442091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:47.442091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:47.442091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:47.442091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:47.442091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:47.442091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:47.442091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:47.442091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:47.442091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:04:47.442091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:04:47.442091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 581/1188] 10.222.0.60 () {56 vars in 1096 bytes} [Sun Jul 31 01:04:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:47.447241 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ab414-6d47-4d7a-b314-e839d301935e None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:47.533637 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:47.553896 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ab414-6d47-4d7a-b314-e839d301935e None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:47.588823 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ace92b-fa1e-4091-96f6-a37f65f1ba5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:47.589441 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ace92b-fa1e-4091-96f6-a37f65f1ba5b None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:47.589720 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ace92b-fa1e-4091-96f6-a37f65f1ba5b None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:47.589991 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ace92b-fa1e-4091-96f6-a37f65f1ba5b None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:47.590737 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ace92b-fa1e-4091-96f6-a37f65f1ba5b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:47.591031 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ace92b-fa1e-4091-96f6-a37f65f1ba5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:47.592583 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ace92b-fa1e-4091-96f6-a37f65f1ba5b None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:47.600820 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 608/1189] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:04:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:47.607203 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc9b69-edbe-4ea6-8736-cfae29da72ca None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:47.694997 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:47.722174 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc9b69-edbe-4ea6-8736-cfae29da72ca None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:47.760155 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2a7c4-0fe0-44d4-891a-a006ff650423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:47.760788 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2a7c4-0fe0-44d4-891a-a006ff650423 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:47.761061 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2a7c4-0fe0-44d4-891a-a006ff650423 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:47.761332 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2a7c4-0fe0-44d4-891a-a006ff650423 None admin] PATH_INFO: `/v3/users/12a9179a4f7a45a7835c03d5ed6434e3` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:47.762630 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f2a7c4-0fe0-44d4-891a-a006ff650423 None admin] RBAC: Authorizing `identity:get_user(user_id=12a9179a4f7a45a7835c03d5ed6434e3)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:47.764153 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f2a7c4-0fe0-44d4-891a-a006ff650423 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:47.765730 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 582/1190] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:47 2022] GET /identity/v3/users/12a9179a4f7a45a7835c03d5ed6434e3 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:47.771922 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ace92b-fa1e-4091-96f6-a37f65f1ba5b None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:47.879920 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ace92b-fa1e-4091-96f6-a37f65f1ba5b None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:47.914331 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef219d-197c-47c6-b742-b11123478340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:47.914955 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef219d-197c-47c6-b742-b11123478340 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:47.915226 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef219d-197c-47c6-b742-b11123478340 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:47.915525 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef219d-197c-47c6-b742-b11123478340 None admin] PATH_INFO: `/v3/projects/859d8c5c1d864e95844e3e15262dd548` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:47.916778 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ef219d-197c-47c6-b742-b11123478340 None admin] RBAC: Authorizing `identity:get_project(project_id=859d8c5c1d864e95844e3e15262dd548)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:47.918227 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ef219d-197c-47c6-b742-b11123478340 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:47.919899 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 609/1191] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:47 2022] GET /identity/v3/projects/859d8c5c1d864e95844e3e15262dd548 => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:47.926626 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2a7c4-0fe0-44d4-891a-a006ff650423 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:48.054570 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2a7c4-0fe0-44d4-891a-a006ff650423 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:48.089583 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db01957-ccf5-4eaf-9336-bbf4245386ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:48.090276 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db01957-ccf5-4eaf-9336-bbf4245386ed None admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:48.090554 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db01957-ccf5-4eaf-9336-bbf4245386ed None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:48.090824 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db01957-ccf5-4eaf-9336-bbf4245386ed None admin] PATH_INFO: `/v3/projects/859d8c5c1d864e95844e3e15262dd548/users/12a9179a4f7a45a7835c03d5ed6434e3/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:48.093130 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db01957-ccf5-4eaf-9336-bbf4245386ed None admin] RBAC: Authorizing `identity:create_grant(project_id=859d8c5c1d864e95844e3e15262dd548, user_id=12a9179a4f7a45a7835c03d5ed6434e3, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:48.094574 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db01957-ccf5-4eaf-9336-bbf4245386ed None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:48.110579 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 583/1192] 10.222.0.60 () {58 vars in 1439 bytes} [Sun Jul 31 01:04:47 2022] PUT /identity/v3/projects/859d8c5c1d864e95844e3e15262dd548/users/12a9179a4f7a45a7835c03d5ed6434e3/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:04:50.075135 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d585387-097c-4855-9982-c7a100485f39 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:50.075727 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d585387-097c-4855-9982-c7a100485f39 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:50.075727 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d585387-097c-4855-9982-c7a100485f39 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:50.077088 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 610/1193] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:04:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:50.083427 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7645f1-7d00-46b1-ad73-d1a731bff71b None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:50.084188 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7645f1-7d00-46b1-ad73-d1a731bff71b None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:50.084334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7645f1-7d00-46b1-ad73-d1a731bff71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:50.105989 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-3e7645f1-7d00-46b1-ad73-d1a731bff71b None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:50.107192 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-3e7645f1-7d00-46b1-ad73-d1a731bff71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:50.110328 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:50.180871 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 584/1194] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:04:50.205069 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d585387-097c-4855-9982-c7a100485f39 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:50.221660 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:50.317893 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d585387-097c-4855-9982-c7a100485f39 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:50.352769 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7ac51-4e05-4185-bc29-22711b734bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:50.353338 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7ac51-4e05-4185-bc29-22711b734bec None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:50.353611 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7ac51-4e05-4185-bc29-22711b734bec None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:50.353878 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7ac51-4e05-4185-bc29-22711b734bec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:50.369738 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d7ac51-4e05-4185-bc29-22711b734bec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:50.375456 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-a3d7ac51-4e05-4185-bc29-22711b734bec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:04:50.375456 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:50.375456 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:50.375456 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:50.375456 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:50.375456 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:50.375456 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:50.375456 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:50.375456 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:50.375456 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:50.375456 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:50.375456 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:50.375456 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:50.375456 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:50.375456 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:50.375456 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:50.376904 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:50.376904 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:50.376904 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:50.376904 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:50.376904 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:50.376904 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:50.376904 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:50.376904 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:50.376904 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:50.376904 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:50.376904 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:50.376904 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:50.376904 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:50.376904 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:50.376904 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:50.376904 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:50.377945 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:50.377945 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:50.377945 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:50.377945 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:50.377945 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:50.377945 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:50.377945 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:50.377945 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:50.377945 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:50.377945 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:50.377945 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:04:50.377945 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:04:50.377945 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 611/1195] 10.222.0.60 () {56 vars in 1096 bytes} [Sun Jul 31 01:04:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:50.383322 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7645f1-7d00-46b1-ad73-d1a731bff71b None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:50.500659 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7645f1-7d00-46b1-ad73-d1a731bff71b None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:50.535308 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165acd6-a127-4cf4-a8b1-0734cbb0e7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:50.535951 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165acd6-a127-4cf4-a8b1-0734cbb0e7e2 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:50.536229 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165acd6-a127-4cf4-a8b1-0734cbb0e7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:50.536502 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165acd6-a127-4cf4-a8b1-0734cbb0e7e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:50.537224 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c165acd6-a127-4cf4-a8b1-0734cbb0e7e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:50.537530 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c165acd6-a127-4cf4-a8b1-0734cbb0e7e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:50.538902 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c165acd6-a127-4cf4-a8b1-0734cbb0e7e2 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:50.546904 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 585/1196] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:04:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:50.553682 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7ac51-4e05-4185-bc29-22711b734bec None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:50.633939 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:50.668844 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7ac51-4e05-4185-bc29-22711b734bec None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:50.715449 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946a003-62ff-4172-b417-8ad572df1035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:50.716139 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946a003-62ff-4172-b417-8ad572df1035 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:50.716418 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946a003-62ff-4172-b417-8ad572df1035 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:50.716694 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946a003-62ff-4172-b417-8ad572df1035 None admin] PATH_INFO: `/v3/users/12a9179a4f7a45a7835c03d5ed6434e3` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:50.717913 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946a003-62ff-4172-b417-8ad572df1035 None admin] RBAC: Authorizing `identity:get_user(user_id=12a9179a4f7a45a7835c03d5ed6434e3)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:50.719335 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946a003-62ff-4172-b417-8ad572df1035 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:50.721047 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 612/1197] 10.222.0.60 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:50 2022] GET /identity/v3/users/12a9179a4f7a45a7835c03d5ed6434e3 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:50.728203 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165acd6-a127-4cf4-a8b1-0734cbb0e7e2 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:50.732641 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:50.839852 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165acd6-a127-4cf4-a8b1-0734cbb0e7e2 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:50.878946 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4e1f7-4283-41af-9d8a-0aca3fef270e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:50.879592 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4e1f7-4283-41af-9d8a-0aca3fef270e None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:50.879873 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4e1f7-4283-41af-9d8a-0aca3fef270e None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:50.880141 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4e1f7-4283-41af-9d8a-0aca3fef270e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:50.948355 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f4e1f7-4283-41af-9d8a-0aca3fef270e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:50.949786 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f4e1f7-4283-41af-9d8a-0aca3fef270e None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:50.951777 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:51.059195 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 586/1198] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:04:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:04:51.066080 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946a003-62ff-4172-b417-8ad572df1035 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:51.170303 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946a003-62ff-4172-b417-8ad572df1035 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:51.208095 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199f871-0417-4343-9c45-c0e10e085163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:51.208656 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199f871-0417-4343-9c45-c0e10e085163 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:51.208902 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199f871-0417-4343-9c45-c0e10e085163 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:51.209198 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199f871-0417-4343-9c45-c0e10e085163 None admin] PATH_INFO: `/v3/projects/859d8c5c1d864e95844e3e15262dd548` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:51.210489 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199f871-0417-4343-9c45-c0e10e085163 None admin] RBAC: Authorizing `identity:get_project(project_id=859d8c5c1d864e95844e3e15262dd548)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:51.211939 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199f871-0417-4343-9c45-c0e10e085163 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:51.213570 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 613/1199] 10.222.0.60 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:51 2022] GET /identity/v3/projects/859d8c5c1d864e95844e3e15262dd548 => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:51.221105 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4e1f7-4283-41af-9d8a-0aca3fef270e None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:51.329464 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4e1f7-4283-41af-9d8a-0aca3fef270e None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:51.331044 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:51.368401 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23487888-bec1-443c-b132-147969e20336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:51.369038 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23487888-bec1-443c-b132-147969e20336 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:51.369308 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23487888-bec1-443c-b132-147969e20336 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:51.369579 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23487888-bec1-443c-b132-147969e20336 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:51.370395 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23487888-bec1-443c-b132-147969e20336 None admin] RBAC: Adding query filter params (role.id=fef526a7d2e741ce995d107f3ac934ae, scope.project.id=859d8c5c1d864e95844e3e15262dd548, user.id=12a9179a4f7a45a7835c03d5ed6434e3) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:51.370683 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23487888-bec1-443c-b132-147969e20336 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:51.372257 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23487888-bec1-443c-b132-147969e20336 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:51.378648 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 587/1200] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:04:51 2022] GET /identity/v3/role_assignments?user.id=12a9179a4f7a45a7835c03d5ed6434e3&scope.project.id=859d8c5c1d864e95844e3e15262dd548&role.id=fef526a7d2e741ce995d107f3ac934ae => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:01.202932 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=97 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:01.375465 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=17 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:46.444732 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356420ed-e2bf-43ab-b6fe-983c872ad3c7 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:46.445347 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356420ed-e2bf-43ab-b6fe-983c872ad3c7 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:46.445347 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356420ed-e2bf-43ab-b6fe-983c872ad3c7 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:46.446652 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 614/1201] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:46.454842 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d0a02-73b0-4a2c-9e3c-c00b40ca04d7 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:46.455390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d0a02-73b0-4a2c-9e3c-c00b40ca04d7 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:46.455390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d0a02-73b0-4a2c-9e3c-c00b40ca04d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:46.474592 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-264d0a02-73b0-4a2c-9e3c-c00b40ca04d7 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:46.475824 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-264d0a02-73b0-4a2c-9e3c-c00b40ca04d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:46.571996 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 588/1202] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:05:46.600403 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356420ed-e2bf-43ab-b6fe-983c872ad3c7 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:46.738510 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356420ed-e2bf-43ab-b6fe-983c872ad3c7 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:46.793068 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1b869-ecd7-4412-840d-a59f2849e7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:46.793859 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1b869-ecd7-4412-840d-a59f2849e7df None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:46.794089 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1b869-ecd7-4412-840d-a59f2849e7df None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:46.794323 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1b869-ecd7-4412-840d-a59f2849e7df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:46.810896 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b1b869-ecd7-4412-840d-a59f2849e7df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:46.812543 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b1b869-ecd7-4412-840d-a59f2849e7df None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:46.831175 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-16b1b869-ecd7-4412-840d-a59f2849e7df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:46.831175 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:46.831175 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:46.831175 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:46.831175 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:46.831175 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:46.831175 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:46.831175 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:46.831175 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:46.831175 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:46.831175 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:46.831175 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:46.831175 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:46.831175 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:46.831175 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:46.832466 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:46.832466 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:46.832466 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:46.832466 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:46.832466 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:46.832466 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:46.832466 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:46.832466 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:46.832466 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:46.832466 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:46.832466 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:46.832466 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:46.832466 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:46.832466 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:46.832466 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:46.832466 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:46.832466 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:46.836802 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:46.836802 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:46.836802 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:46.836802 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:05:46.836802 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 615/1203] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:46.839739 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d0a02-73b0-4a2c-9e3c-c00b40ca04d7 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:46.961736 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d0a02-73b0-4a2c-9e3c-c00b40ca04d7 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:46.993139 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:47.000592 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec655b1b-263f-452a-9bf4-834fe59e8c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:47.001588 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec655b1b-263f-452a-9bf4-834fe59e8c47 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:47.001863 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec655b1b-263f-452a-9bf4-834fe59e8c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:47.002128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec655b1b-263f-452a-9bf4-834fe59e8c47 None admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:47.002828 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec655b1b-263f-452a-9bf4-834fe59e8c47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:47.003125 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec655b1b-263f-452a-9bf4-834fe59e8c47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:47.004675 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec655b1b-263f-452a-9bf4-834fe59e8c47 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:47.023539 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 589/1204] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:05:47.025528 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1b869-ecd7-4412-840d-a59f2849e7df None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:47.090681 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:47.157208 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1b869-ecd7-4412-840d-a59f2849e7df None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:47.199789 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed0fb9f-7658-4dfb-b200-71255783d985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:47.200417 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0fb9f-7658-4dfb-b200-71255783d985 None admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:47.200698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0fb9f-7658-4dfb-b200-71255783d985 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:47.200982 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0fb9f-7658-4dfb-b200-71255783d985 None admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:47.201635 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed0fb9f-7658-4dfb-b200-71255783d985 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:47.203054 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed0fb9f-7658-4dfb-b200-71255783d985 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:47.234429 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 616/1205] 10.222.0.60 () {60 vars in 1132 bytes} [Sun Jul 31 01:05:47 2022] POST /identity/v3/users => generated 251 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:05:49.436065 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f0da5-8acc-4241-99bb-168dff8b299d None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:49.436065 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f0da5-8acc-4241-99bb-168dff8b299d None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:49.436065 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f0da5-8acc-4241-99bb-168dff8b299d None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:49.436065 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 590/1206] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:49.440549 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65abc2-567c-4c5f-8429-f9a24fd55de0 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:49.440982 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65abc2-567c-4c5f-8429-f9a24fd55de0 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:49.441082 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65abc2-567c-4c5f-8429-f9a24fd55de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:49.468194 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-ac65abc2-567c-4c5f-8429-f9a24fd55de0 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:49.469438 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-ac65abc2-567c-4c5f-8429-f9a24fd55de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:49.599610 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 617/1207] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:05:49.624663 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f0da5-8acc-4241-99bb-168dff8b299d None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:49.743217 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f0da5-8acc-4241-99bb-168dff8b299d None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:49.780448 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b532a5-e19c-4f85-9932-9e2eee5e772f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:49.781071 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b532a5-e19c-4f85-9932-9e2eee5e772f None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:49.781348 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b532a5-e19c-4f85-9932-9e2eee5e772f None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:49.781621 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b532a5-e19c-4f85-9932-9e2eee5e772f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:49.793953 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b532a5-e19c-4f85-9932-9e2eee5e772f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:05:49.799218 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-d7b532a5-e19c-4f85-9932-9e2eee5e772f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:05:49.799218 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:49.799218 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:49.799218 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:49.799218 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:49.799218 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:49.799218 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:49.799218 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:49.799218 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:49.799218 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:49.799218 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:49.799218 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:49.799218 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:05:49.799218 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:05:49.799218 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:05:49.799218 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:05:49.800389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:05:49.800389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:05:49.800389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:05:49.800389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:05:49.800389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:49.800389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:49.800389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:49.800389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:49.800389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:49.800389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:49.800389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:49.800389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:49.800389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:49.800389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:49.800389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:49.800389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:49.801248 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:49.801248 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:49.801248 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:49.801248 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:49.801248 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:05:49.801248 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:05:49.801248 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:05:49.801248 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:05:49.801248 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:05:49.801248 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:05:49.801248 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:05:49.801248 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:05:49.805923 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 591/1208] 10.222.0.60 () {56 vars in 1102 bytes} [Sun Jul 31 01:05:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:49.806820 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65abc2-567c-4c5f-8429-f9a24fd55de0 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:49.872765 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:49.970082 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65abc2-567c-4c5f-8429-f9a24fd55de0 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:50.023107 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9928e56-f752-4ab4-ba37-117c3795847e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:50.023976 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9928e56-f752-4ab4-ba37-117c3795847e None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:50.024247 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9928e56-f752-4ab4-ba37-117c3795847e None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:50.024510 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9928e56-f752-4ab4-ba37-117c3795847e None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:50.025477 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9928e56-f752-4ab4-ba37-117c3795847e None admin] RBAC: Adding query filter params (name=service) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:50.025883 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9928e56-f752-4ab4-ba37-117c3795847e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:50.027081 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9928e56-f752-4ab4-ba37-117c3795847e None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:50.036404 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 618/1209] 10.222.0.60 () {56 vars in 1103 bytes} [Sun Jul 31 01:05:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:50.042276 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b532a5-e19c-4f85-9932-9e2eee5e772f None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:50.101664 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:50.168730 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b532a5-e19c-4f85-9932-9e2eee5e772f None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:50.212261 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71553317-5e70-4713-8148-195545bfd967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:50.213052 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71553317-5e70-4713-8148-195545bfd967 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:50.213489 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71553317-5e70-4713-8148-195545bfd967 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:50.213827 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71553317-5e70-4713-8148-195545bfd967 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:50.228013 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71553317-5e70-4713-8148-195545bfd967 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:50.229817 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71553317-5e70-4713-8148-195545bfd967 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:50.246741 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-71553317-5e70-4713-8148-195545bfd967 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:50.246741 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:50.246741 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:50.246741 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:50.246741 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:50.246741 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:50.246741 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:50.246741 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:50.246741 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:50.246741 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:50.246741 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:50.246741 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:50.246741 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:50.246741 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:50.246741 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:50.247784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:50.247784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:50.247784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:50.247784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:50.247784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:50.247784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:50.247784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:50.247784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:50.247784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:50.247784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:50.247784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:50.247784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:50.247784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:50.247784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:50.247784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:50.247784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:50.247784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:50.248699 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:50.248699 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:50.248699 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:50.248699 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:05:50.248699 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 592/1210] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:50.257207 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9928e56-f752-4ab4-ba37-117c3795847e None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:50.386164 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:50.389774 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9928e56-f752-4ab4-ba37-117c3795847e None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:50.427174 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba97e60-c889-4740-afce-3a9ebe2278a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:50.428130 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba97e60-c889-4740-afce-3a9ebe2278a2 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:50.428412 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba97e60-c889-4740-afce-3a9ebe2278a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:50.428724 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba97e60-c889-4740-afce-3a9ebe2278a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:50.429426 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba97e60-c889-4740-afce-3a9ebe2278a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:50.429723 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba97e60-c889-4740-afce-3a9ebe2278a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:50.431061 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba97e60-c889-4740-afce-3a9ebe2278a2 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:50.444447 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 619/1211] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:05:50.449940 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71553317-5e70-4713-8148-195545bfd967 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:50.561182 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71553317-5e70-4713-8148-195545bfd967 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:50.562892 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:50.600390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50658e1-f678-412a-afd9-4fe10ed4a601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:50.601108 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50658e1-f678-412a-afd9-4fe10ed4a601 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:50.601480 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50658e1-f678-412a-afd9-4fe10ed4a601 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:50.601938 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50658e1-f678-412a-afd9-4fe10ed4a601 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:50.614605 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50658e1-f678-412a-afd9-4fe10ed4a601 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:50.614605 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50658e1-f678-412a-afd9-4fe10ed4a601 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:50.627035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-e50658e1-f678-412a-afd9-4fe10ed4a601 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 31 01:05:50.627035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:50.627035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:50.627035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:50.627035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:50.627035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:50.627035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:50.627035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:50.627035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:50.627035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:50.627035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:50.627035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:50.627035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:05:50.627035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:05:50.627035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:05:50.627035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:05:50.628165 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:50.628165 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:50.628165 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:05:50.628165 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:50.628165 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:05:50.628165 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:50.628165 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:50.628165 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:50.628165 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:50.628165 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:50.628165 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:50.628165 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:50.628165 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:50.628165 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:50.628165 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:50.628165 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:50.628165 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:50.628165 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:50.629178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:50.629178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:50.629178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:05:50.629178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:05:50.629178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:05:50.629178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:05:50.629178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:05:50.629178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:05:50.629178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 31 01:05:50.629178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:05:50.629178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 593/1212] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:50.636257 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba97e60-c889-4740-afce-3a9ebe2278a2 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:50.761779 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba97e60-c889-4740-afce-3a9ebe2278a2 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:50.800204 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7389e2-532d-491a-b9e2-ac9c0d6566c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:50.800901 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7389e2-532d-491a-b9e2-ac9c0d6566c2 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:50.801174 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7389e2-532d-491a-b9e2-ac9c0d6566c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:50.801468 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7389e2-532d-491a-b9e2-ac9c0d6566c2 None admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:50.802296 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7389e2-532d-491a-b9e2-ac9c0d6566c2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:50.802623 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7389e2-532d-491a-b9e2-ac9c0d6566c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:50.804228 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7389e2-532d-491a-b9e2-ac9c0d6566c2 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:50.824596 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 620/1213] 10.222.0.60 () {56 vars in 1143 bytes} [Sun Jul 31 01:05:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:50.831950 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50658e1-f678-412a-afd9-4fe10ed4a601 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:50.976870 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50658e1-f678-412a-afd9-4fe10ed4a601 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:51.018218 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17855b62-fe10-47d0-8883-004cc4626509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:51.018879 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17855b62-fe10-47d0-8883-004cc4626509 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:51.019179 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17855b62-fe10-47d0-8883-004cc4626509 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:51.019506 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17855b62-fe10-47d0-8883-004cc4626509 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:51.062436 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:51.109526 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17855b62-fe10-47d0-8883-004cc4626509 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:51.111074 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17855b62-fe10-47d0-8883-004cc4626509 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:51.236848 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 594/1214] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:05:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:05:51.243068 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7389e2-532d-491a-b9e2-ac9c0d6566c2 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:51.265386 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:51.364243 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7389e2-532d-491a-b9e2-ac9c0d6566c2 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:51.398805 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c1f5f-cdac-4c5d-8b88-e55ae9ea353c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:51.399502 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c1f5f-cdac-4c5d-8b88-e55ae9ea353c None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:51.399832 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c1f5f-cdac-4c5d-8b88-e55ae9ea353c None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:51.400075 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c1f5f-cdac-4c5d-8b88-e55ae9ea353c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:51.412090 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c1f5f-cdac-4c5d-8b88-e55ae9ea353c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:51.413614 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c1f5f-cdac-4c5d-8b88-e55ae9ea353c None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:51.430405 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-755c1f5f-cdac-4c5d-8b88-e55ae9ea353c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:51.430405 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:51.430405 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:51.430405 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:51.430405 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:51.430405 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:51.430405 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:51.430405 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:51.430405 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:51.430405 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:51.430405 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:51.430405 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:51.430405 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:51.430405 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:51.430405 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:51.431450 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:51.431450 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:51.431450 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:51.431450 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:51.431450 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:51.431450 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:51.431450 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:51.431450 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:51.431450 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:51.431450 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:51.431450 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:51.431450 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:51.431450 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:51.431450 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:51.431450 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:51.431450 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:51.431450 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:51.432497 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:51.432497 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:51.432497 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:51.432497 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:05:51.432497 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 621/1215] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:51.437960 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17855b62-fe10-47d0-8883-004cc4626509 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:51.511402 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:51.562428 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17855b62-fe10-47d0-8883-004cc4626509 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:51.600583 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12153a30-5574-4cfe-953b-9627e180d0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:51.601232 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12153a30-5574-4cfe-953b-9627e180d0a5 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:51.601508 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12153a30-5574-4cfe-953b-9627e180d0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:51.601783 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12153a30-5574-4cfe-953b-9627e180d0a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:51.602480 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12153a30-5574-4cfe-953b-9627e180d0a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:51.602785 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12153a30-5574-4cfe-953b-9627e180d0a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:51.604227 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12153a30-5574-4cfe-953b-9627e180d0a5 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:51.619645 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 595/1216] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:51.621806 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c1f5f-cdac-4c5d-8b88-e55ae9ea353c None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:51.703954 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:51.744947 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c1f5f-cdac-4c5d-8b88-e55ae9ea353c None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:51.783946 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40e1ed-42c9-4364-861d-773f9d232677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:51.784618 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40e1ed-42c9-4364-861d-773f9d232677 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:51.784891 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40e1ed-42c9-4364-861d-773f9d232677 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:51.785239 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40e1ed-42c9-4364-861d-773f9d232677 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:51.792569 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a40e1ed-42c9-4364-861d-773f9d232677 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:51.794170 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a40e1ed-42c9-4364-861d-773f9d232677 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:51.807056 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-1a40e1ed-42c9-4364-861d-773f9d232677 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:51.807056 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:51.807056 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:51.807056 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:51.807056 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:51.807056 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:51.807056 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:51.807056 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:51.807056 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:51.807056 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:51.807056 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:51.807056 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:51.807056 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:05:51.807056 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:05:51.807056 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:05:51.808228 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:05:51.808228 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:51.808228 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:51.808228 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:51.808228 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:51.808228 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:51.808228 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:51.808228 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:51.808228 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:51.808228 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:51.808228 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:51.808228 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:51.808228 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:51.808228 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:51.808228 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:51.808228 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:51.808228 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:51.809346 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:05:51.809346 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:05:51.809346 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:05:51.809346 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:05:51.809346 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:05:51.809346 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:05:51.809346 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:51.809346 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:05:51.813415 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 622/1217] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:05:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:51.814630 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12153a30-5574-4cfe-953b-9627e180d0a5 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:51.929573 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12153a30-5574-4cfe-953b-9627e180d0a5 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:51.954389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:51.968353 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b2cb1-b8e7-422d-824b-e4b6cd5c6197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:51.968982 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b2cb1-b8e7-422d-824b-e4b6cd5c6197 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:51.970362 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b2cb1-b8e7-422d-824b-e4b6cd5c6197 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:51.970700 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b2cb1-b8e7-422d-824b-e4b6cd5c6197 None admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:51.971722 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b2cb1-b8e7-422d-824b-e4b6cd5c6197 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:51.971953 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b2cb1-b8e7-422d-824b-e4b6cd5c6197 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:51.973516 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b2cb1-b8e7-422d-824b-e4b6cd5c6197 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:51.994395 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 596/1218] 10.222.0.60 () {56 vars in 1148 bytes} [Sun Jul 31 01:05:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:51.995812 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40e1ed-42c9-4364-861d-773f9d232677 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:52.113558 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40e1ed-42c9-4364-861d-773f9d232677 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:52.144330 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:52.150929 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eef665-c4a7-45c5-8373-ec066b618c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:52.151843 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eef665-c4a7-45c5-8373-ec066b618c23 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:52.152321 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eef665-c4a7-45c5-8373-ec066b618c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:52.152704 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eef665-c4a7-45c5-8373-ec066b618c23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:52.153716 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eef665-c4a7-45c5-8373-ec066b618c23 None admin] RBAC: Adding query filter params (role.id=a5d1b78d4ec146848dfa667303603262, scope.project.id=b931b81a237949aa845891d4bb5aa1c0, user.id=657a3f73879e4b31b70a1c4f73e80f5d) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:52.154090 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eef665-c4a7-45c5-8373-ec066b618c23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:52.155777 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eef665-c4a7-45c5-8373-ec066b618c23 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:52.162144 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 623/1219] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:05:51 2022] GET /identity/v3/role_assignments?user.id=657a3f73879e4b31b70a1c4f73e80f5d&scope.project.id=b931b81a237949aa845891d4bb5aa1c0&role.id=a5d1b78d4ec146848dfa667303603262 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:54.178166 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404516e-fb38-4928-adc2-020666ff87aa None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:54.178728 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404516e-fb38-4928-adc2-020666ff87aa None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:54.178822 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404516e-fb38-4928-adc2-020666ff87aa None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:54.180204 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 597/1220] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:54.185912 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402f070-349c-4d56-9292-28193e5aad9a None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:54.186449 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402f070-349c-4d56-9292-28193e5aad9a None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:54.186554 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402f070-349c-4d56-9292-28193e5aad9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:54.208483 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-d402f070-349c-4d56-9292-28193e5aad9a None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:54.209703 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-d402f070-349c-4d56-9292-28193e5aad9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:54.284589 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 624/1221] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:05:54.309118 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404516e-fb38-4928-adc2-020666ff87aa None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:54.424159 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404516e-fb38-4928-adc2-020666ff87aa None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:54.458658 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae5125-9b09-42f8-ab65-ea86e178703d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:54.459360 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae5125-9b09-42f8-ab65-ea86e178703d None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:54.459756 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae5125-9b09-42f8-ab65-ea86e178703d None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:54.460118 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae5125-9b09-42f8-ab65-ea86e178703d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:54.470042 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae5125-9b09-42f8-ab65-ea86e178703d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:05:54.474890 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-daae5125-9b09-42f8-ab65-ea86e178703d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:05:54.474890 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:54.474890 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:54.474890 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:54.474890 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:54.474890 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:54.474890 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:54.474890 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:54.474890 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:54.474890 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:54.474890 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:54.474890 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:54.474890 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:05:54.474890 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:05:54.474890 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:05:54.474890 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:05:54.476123 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:05:54.476123 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:05:54.476123 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:05:54.476123 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:05:54.476123 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:54.476123 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:54.476123 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:54.476123 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:54.476123 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:54.476123 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:54.476123 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:54.476123 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:54.476123 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:54.476123 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:54.476123 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:54.476123 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:54.477249 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:54.477249 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:54.477249 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:54.477249 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:54.477249 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:05:54.477249 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:05:54.477249 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:05:54.477249 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:05:54.477249 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:05:54.477249 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:05:54.477249 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:05:54.477249 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:05:54.477249 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 598/1222] 10.222.0.60 () {56 vars in 1102 bytes} [Sun Jul 31 01:05:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:54.483018 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d402f070-349c-4d56-9292-28193e5aad9a None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:54.595805 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d402f070-349c-4d56-9292-28193e5aad9a None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:54.625115 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:54.638085 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3e2e6-1adb-47cd-9819-c0c06b96b73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:54.638770 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3e2e6-1adb-47cd-9819-c0c06b96b73a None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:54.639054 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3e2e6-1adb-47cd-9819-c0c06b96b73a None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:54.639329 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3e2e6-1adb-47cd-9819-c0c06b96b73a None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:54.640083 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db3e2e6-1adb-47cd-9819-c0c06b96b73a None admin] RBAC: Adding query filter params (name=service) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:54.640394 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db3e2e6-1adb-47cd-9819-c0c06b96b73a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:54.641915 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db3e2e6-1adb-47cd-9819-c0c06b96b73a None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:54.651392 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 625/1223] 10.222.0.60 () {56 vars in 1103 bytes} [Sun Jul 31 01:05:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:05:54.657624 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae5125-9b09-42f8-ab65-ea86e178703d None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:54.704326 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:54.770111 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae5125-9b09-42f8-ab65-ea86e178703d None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:54.806720 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f1236-260c-44c8-bb01-2b216b62d3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:54.807373 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f1236-260c-44c8-bb01-2b216b62d3b2 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:54.807678 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f1236-260c-44c8-bb01-2b216b62d3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:54.807947 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f1236-260c-44c8-bb01-2b216b62d3b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:54.819387 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9f1236-260c-44c8-bb01-2b216b62d3b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:54.820917 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9f1236-260c-44c8-bb01-2b216b62d3b2 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:54.837129 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-ce9f1236-260c-44c8-bb01-2b216b62d3b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:54.837129 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:54.837129 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:54.837129 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:54.837129 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:54.837129 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:54.837129 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:54.837129 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:54.837129 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:54.837129 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:54.837129 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:54.837129 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:54.837129 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:54.837129 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:54.837129 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:54.838482 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:54.838482 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:54.838482 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:54.838482 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:54.838482 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:54.838482 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:54.838482 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:54.838482 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:54.838482 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:54.838482 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:54.838482 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:54.838482 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:54.838482 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:54.838482 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:54.838482 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:54.838482 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:54.838482 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:54.839503 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:54.839503 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:54.839503 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:54.839503 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:05:54.839503 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 599/1224] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:54.844497 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3e2e6-1adb-47cd-9819-c0c06b96b73a None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:54.953726 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3e2e6-1adb-47cd-9819-c0c06b96b73a None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:54.986999 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6205e8-92f6-4fef-8120-7ea97f00a5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:54.987655 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6205e8-92f6-4fef-8120-7ea97f00a5a6 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:54.987935 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6205e8-92f6-4fef-8120-7ea97f00a5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:54.988206 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6205e8-92f6-4fef-8120-7ea97f00a5a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:54.988897 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6205e8-92f6-4fef-8120-7ea97f00a5a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:54.989219 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6205e8-92f6-4fef-8120-7ea97f00a5a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:54.990567 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6205e8-92f6-4fef-8120-7ea97f00a5a6 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:55.002633 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 626/1225] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:05:55.008517 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f1236-260c-44c8-bb01-2b216b62d3b2 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:55.117710 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:55.125508 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f1236-260c-44c8-bb01-2b216b62d3b2 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:55.166063 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0f128-2d54-4f3c-9709-17949f7d00ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:55.166715 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0f128-2d54-4f3c-9709-17949f7d00ee None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:55.166996 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0f128-2d54-4f3c-9709-17949f7d00ee None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:55.167267 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0f128-2d54-4f3c-9709-17949f7d00ee None admin] PATH_INFO: `/v3/users/placement` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:55.175090 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b0f128-2d54-4f3c-9709-17949f7d00ee None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:55.176575 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b0f128-2d54-4f3c-9709-17949f7d00ee None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:55.189873 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-77b0f128-2d54-4f3c-9709-17949f7d00ee None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 31 01:05:55.189873 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:55.189873 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:55.189873 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:55.189873 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:55.189873 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:55.189873 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:55.189873 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:55.189873 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:55.189873 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:55.189873 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:55.189873 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:55.189873 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:05:55.189873 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:05:55.189873 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:05:55.189873 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:05:55.191544 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:55.191544 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:55.191544 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:05:55.191544 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:55.191544 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:05:55.191544 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:55.191544 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:55.191544 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:55.191544 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:55.191544 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:55.191544 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:55.191544 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:55.191544 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:55.191544 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:55.191544 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:55.191544 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:55.191544 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:55.191544 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:55.192506 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:55.192506 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:55.192506 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:05:55.192506 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:05:55.192506 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:05:55.192506 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:05:55.192506 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:05:55.192506 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:05:55.192506 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 31 01:05:55.192506 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:05:55.192506 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 600/1226] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:55.197237 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6205e8-92f6-4fef-8120-7ea97f00a5a6 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:55.247048 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:55.312083 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6205e8-92f6-4fef-8120-7ea97f00a5a6 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:55.353456 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f0fac-587b-4ca7-8d6a-8821b38501d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:55.354319 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f0fac-587b-4ca7-8d6a-8821b38501d4 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:55.354597 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f0fac-587b-4ca7-8d6a-8821b38501d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:55.354865 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f0fac-587b-4ca7-8d6a-8821b38501d4 None admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:55.355812 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2f0fac-587b-4ca7-8d6a-8821b38501d4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:55.358205 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2f0fac-587b-4ca7-8d6a-8821b38501d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:55.358205 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2f0fac-587b-4ca7-8d6a-8821b38501d4 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:55.380900 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 627/1227] 10.222.0.60 () {56 vars in 1143 bytes} [Sun Jul 31 01:05:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:55.386857 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0f128-2d54-4f3c-9709-17949f7d00ee None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:55.496406 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0f128-2d54-4f3c-9709-17949f7d00ee None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:55.531805 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14979874-7a5f-4592-a98b-fefad4e0851e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:55.532503 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14979874-7a5f-4592-a98b-fefad4e0851e None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:55.532790 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14979874-7a5f-4592-a98b-fefad4e0851e None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:55.533059 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14979874-7a5f-4592-a98b-fefad4e0851e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:55.545623 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14979874-7a5f-4592-a98b-fefad4e0851e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:55.547093 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14979874-7a5f-4592-a98b-fefad4e0851e None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:55.565693 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-14979874-7a5f-4592-a98b-fefad4e0851e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:55.565693 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:55.565693 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:55.565693 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:55.565693 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:55.565693 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:55.565693 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:55.565693 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:55.565693 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:55.565693 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:55.565693 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:55.565693 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:55.565693 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:55.565693 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:55.565693 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:55.566792 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:55.566792 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:55.566792 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:55.566792 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:55.566792 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:55.566792 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:55.566792 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:55.566792 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:55.566792 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:55.566792 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:55.566792 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:55.566792 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:55.566792 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:55.566792 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:55.566792 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:55.566792 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:55.566792 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:55.572815 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:55.572815 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:55.572815 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:55.572815 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:05:55.572815 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 601/1228] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:55.573150 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f0fac-587b-4ca7-8d6a-8821b38501d4 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:55.680901 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f0fac-587b-4ca7-8d6a-8821b38501d4 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:55.683150 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:55.715363 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53e695-c0fe-496a-a807-249bd54cb409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:55.716045 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53e695-c0fe-496a-a807-249bd54cb409 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:55.716397 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53e695-c0fe-496a-a807-249bd54cb409 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:55.716699 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53e695-c0fe-496a-a807-249bd54cb409 None admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:55.717341 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf53e695-c0fe-496a-a807-249bd54cb409 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:55.717637 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf53e695-c0fe-496a-a807-249bd54cb409 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:55.719179 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf53e695-c0fe-496a-a807-249bd54cb409 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:55.732165 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 628/1229] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:05:55.739427 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14979874-7a5f-4592-a98b-fefad4e0851e None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:55.750346 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:55.846500 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14979874-7a5f-4592-a98b-fefad4e0851e None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:55.883987 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea221e-26d5-4936-9911-543c5d6d9f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:55.884670 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea221e-26d5-4936-9911-543c5d6d9f40 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:55.884953 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea221e-26d5-4936-9911-543c5d6d9f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:55.885223 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea221e-26d5-4936-9911-543c5d6d9f40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:55.892186 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea221e-26d5-4936-9911-543c5d6d9f40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:55.893629 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea221e-26d5-4936-9911-543c5d6d9f40 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:55.904826 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-d2ea221e-26d5-4936-9911-543c5d6d9f40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:55.904826 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:55.904826 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:55.904826 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:55.904826 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:55.904826 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:55.904826 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:55.904826 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:55.904826 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:55.904826 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:55.904826 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:55.904826 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:55.904826 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:05:55.904826 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:05:55.904826 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:05:55.905863 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:05:55.905863 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:55.905863 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:55.905863 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:55.905863 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:55.905863 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:55.905863 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:55.905863 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:55.905863 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:55.905863 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:55.905863 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:55.905863 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:55.905863 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:55.905863 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:55.905863 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:55.905863 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:55.905863 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:55.906944 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:05:55.906944 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:05:55.906944 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:05:55.906944 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:05:55.906944 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:05:55.906944 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:05:55.906944 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:55.906944 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:05:55.906944 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 602/1230] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:05:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:55.912426 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53e695-c0fe-496a-a807-249bd54cb409 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:56.016818 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53e695-c0fe-496a-a807-249bd54cb409 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:56.052391 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b3fa9-559b-4fc7-8772-167ca062c19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:56.053080 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b3fa9-559b-4fc7-8772-167ca062c19f None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:56.053382 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b3fa9-559b-4fc7-8772-167ca062c19f None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:56.053673 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b3fa9-559b-4fc7-8772-167ca062c19f None admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:56.054454 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b3fa9-559b-4fc7-8772-167ca062c19f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:56.054785 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b3fa9-559b-4fc7-8772-167ca062c19f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:56.056372 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b3fa9-559b-4fc7-8772-167ca062c19f None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:56.073099 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 629/1231] 10.222.0.60 () {56 vars in 1148 bytes} [Sun Jul 31 01:05:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:56.080067 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea221e-26d5-4936-9911-543c5d6d9f40 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:56.150226 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:56.187807 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea221e-26d5-4936-9911-543c5d6d9f40 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:56.223698 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ac14c-c601-4aec-b1d2-aed97bed91cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:56.224586 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ac14c-c601-4aec-b1d2-aed97bed91cd None admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:56.224930 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ac14c-c601-4aec-b1d2-aed97bed91cd None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:56.225249 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ac14c-c601-4aec-b1d2-aed97bed91cd None admin] PATH_INFO: `/v3/projects/b931b81a237949aa845891d4bb5aa1c0/users/657a3f73879e4b31b70a1c4f73e80f5d/roles/a5d1b78d4ec146848dfa667303603262` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:56.244335 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ac14c-c601-4aec-b1d2-aed97bed91cd None admin] RBAC: Authorizing `identity:create_grant(project_id=b931b81a237949aa845891d4bb5aa1c0, user_id=657a3f73879e4b31b70a1c4f73e80f5d, role_id=a5d1b78d4ec146848dfa667303603262)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:56.246008 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ac14c-c601-4aec-b1d2-aed97bed91cd None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:56.259652 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 603/1232] 10.222.0.60 () {58 vars in 1439 bytes} [Sun Jul 31 01:05:56 2022] PUT /identity/v3/projects/b931b81a237949aa845891d4bb5aa1c0/users/657a3f73879e4b31b70a1c4f73e80f5d/roles/a5d1b78d4ec146848dfa667303603262 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:05:58.349511 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51f333-d360-414d-aadf-93851832db4d None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:58.350568 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51f333-d360-414d-aadf-93851832db4d None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:58.350568 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51f333-d360-414d-aadf-93851832db4d None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:58.351426 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 630/1233] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:58.357881 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa1026-59d0-4599-b638-cd0ce28cdd83 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:58.358428 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa1026-59d0-4599-b638-cd0ce28cdd83 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:58.358705 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa1026-59d0-4599-b638-cd0ce28cdd83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:58.382662 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-9ffa1026-59d0-4599-b638-cd0ce28cdd83 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:58.384204 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-9ffa1026-59d0-4599-b638-cd0ce28cdd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:58.456590 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 604/1234] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:05:58.480348 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51f333-d360-414d-aadf-93851832db4d None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:58.506908 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:58.587927 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51f333-d360-414d-aadf-93851832db4d None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:58.633543 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447bc9b-2488-416a-ab56-e9ea325e87d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:58.634179 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447bc9b-2488-416a-ab56-e9ea325e87d3 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:58.634455 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447bc9b-2488-416a-ab56-e9ea325e87d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:58.634804 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447bc9b-2488-416a-ab56-e9ea325e87d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:58.646317 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0447bc9b-2488-416a-ab56-e9ea325e87d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:05:58.651584 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-0447bc9b-2488-416a-ab56-e9ea325e87d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:05:58.651584 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:58.651584 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:58.651584 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:58.651584 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:58.651584 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:58.651584 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:58.651584 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:58.651584 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:58.651584 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:58.651584 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:58.651584 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:58.651584 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:05:58.651584 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:05:58.651584 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:05:58.651584 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:05:58.652745 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:05:58.652745 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:05:58.652745 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:05:58.652745 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:05:58.652745 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:58.652745 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:58.652745 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:58.652745 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:58.652745 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:58.652745 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:58.652745 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:58.652745 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:58.652745 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:58.652745 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:58.652745 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:58.652745 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:58.653617 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:58.653617 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:58.653617 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:58.653617 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:58.653617 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:05:58.653617 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:05:58.653617 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:05:58.653617 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:05:58.653617 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:05:58.653617 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:05:58.653617 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:05:58.653617 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:05:58.653617 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 631/1235] 10.222.0.60 () {56 vars in 1102 bytes} [Sun Jul 31 01:05:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:58.659334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa1026-59d0-4599-b638-cd0ce28cdd83 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:58.711823 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:58.782437 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa1026-59d0-4599-b638-cd0ce28cdd83 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:58.823367 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208ada6-d17f-4dd9-bf7d-ad8d0f0d4982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:58.824024 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208ada6-d17f-4dd9-bf7d-ad8d0f0d4982 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:58.824298 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208ada6-d17f-4dd9-bf7d-ad8d0f0d4982 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:58.824563 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208ada6-d17f-4dd9-bf7d-ad8d0f0d4982 None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:58.825281 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6208ada6-d17f-4dd9-bf7d-ad8d0f0d4982 None admin] RBAC: Adding query filter params (name=service) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:58.825577 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6208ada6-d17f-4dd9-bf7d-ad8d0f0d4982 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:58.827090 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6208ada6-d17f-4dd9-bf7d-ad8d0f0d4982 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:58.836209 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 605/1236] 10.222.0.60 () {56 vars in 1103 bytes} [Sun Jul 31 01:05:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:58.842389 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447bc9b-2488-416a-ab56-e9ea325e87d3 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:58.932387 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:58.949951 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447bc9b-2488-416a-ab56-e9ea325e87d3 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:58.988788 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26925d-76d4-48f1-8aa2-60e1295de52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:58.989548 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26925d-76d4-48f1-8aa2-60e1295de52c None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:58.989915 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26925d-76d4-48f1-8aa2-60e1295de52c None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:58.990276 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26925d-76d4-48f1-8aa2-60e1295de52c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:59.000493 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd26925d-76d4-48f1-8aa2-60e1295de52c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:59.002301 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd26925d-76d4-48f1-8aa2-60e1295de52c None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:59.019557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-fd26925d-76d4-48f1-8aa2-60e1295de52c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:59.019557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:59.019557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:59.019557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:59.019557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:59.019557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:59.019557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:59.019557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:59.019557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:59.019557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:59.019557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:59.019557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:59.019557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:59.019557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:59.019557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:59.026147 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:59.026147 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:59.026147 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:59.026147 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:59.026147 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:59.026147 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:59.026147 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:59.026147 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:59.026147 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:59.026147 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:59.026147 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:59.026147 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:59.026147 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:59.026147 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:59.026147 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:59.026147 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:59.026147 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:59.027268 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:59.027268 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:59.027268 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:59.027268 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:05:59.027268 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 632/1237] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:59.027652 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208ada6-d17f-4dd9-bf7d-ad8d0f0d4982 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:59.145077 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208ada6-d17f-4dd9-bf7d-ad8d0f0d4982 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:59.156000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:59.189080 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9d034-6184-4ce2-a530-185c0cb293e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:59.189626 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9d034-6184-4ce2-a530-185c0cb293e4 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:59.189946 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9d034-6184-4ce2-a530-185c0cb293e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:59.190158 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9d034-6184-4ce2-a530-185c0cb293e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:59.190857 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d9d034-6184-4ce2-a530-185c0cb293e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:59.191156 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d9d034-6184-4ce2-a530-185c0cb293e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:59.192758 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d9d034-6184-4ce2-a530-185c0cb293e4 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:59.206714 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 606/1238] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:59.213172 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26925d-76d4-48f1-8aa2-60e1295de52c None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:59.332267 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26925d-76d4-48f1-8aa2-60e1295de52c None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:59.379574 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01e5f9-b047-458b-b4a0-9cf58122e435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:59.380270 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01e5f9-b047-458b-b4a0-9cf58122e435 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:59.380534 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01e5f9-b047-458b-b4a0-9cf58122e435 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:59.380822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01e5f9-b047-458b-b4a0-9cf58122e435 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:59.383552 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:59.389430 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e01e5f9-b047-458b-b4a0-9cf58122e435 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:59.390881 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e01e5f9-b047-458b-b4a0-9cf58122e435 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:59.404223 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-7e01e5f9-b047-458b-b4a0-9cf58122e435 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 31 01:05:59.404223 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:59.404223 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:59.404223 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:59.404223 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:59.404223 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:59.404223 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:59.404223 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:59.404223 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:59.404223 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:59.404223 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:59.404223 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:59.404223 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:05:59.404223 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:05:59.404223 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:05:59.404223 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:05:59.405291 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:59.405291 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:59.405291 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:05:59.405291 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:59.405291 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:05:59.405291 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:59.405291 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:59.405291 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:59.405291 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:59.405291 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:59.405291 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:59.405291 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:59.405291 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:59.405291 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:59.405291 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:59.405291 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:59.405291 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:59.405291 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:59.406423 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:59.406423 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:59.406423 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:05:59.406423 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:05:59.406423 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:05:59.406423 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:05:59.406423 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:05:59.406423 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:05:59.406423 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 31 01:05:59.406423 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:05:59.406423 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 633/1239] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:59.412215 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9d034-6184-4ce2-a530-185c0cb293e4 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:59.517806 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9d034-6184-4ce2-a530-185c0cb293e4 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:59.555714 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63db3bb-d527-49d7-ad6f-5f7d3f65061a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:59.556475 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63db3bb-d527-49d7-ad6f-5f7d3f65061a None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:59.556863 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63db3bb-d527-49d7-ad6f-5f7d3f65061a None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:59.557203 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63db3bb-d527-49d7-ad6f-5f7d3f65061a None admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:59.558078 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63db3bb-d527-49d7-ad6f-5f7d3f65061a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:59.558458 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63db3bb-d527-49d7-ad6f-5f7d3f65061a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:59.559992 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63db3bb-d527-49d7-ad6f-5f7d3f65061a None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:59.583623 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 607/1240] 10.222.0.60 () {56 vars in 1143 bytes} [Sun Jul 31 01:05:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:59.584848 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01e5f9-b047-458b-b4a0-9cf58122e435 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:59.696101 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01e5f9-b047-458b-b4a0-9cf58122e435 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:59.733029 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b3542e-fd2c-419b-8aa8-75f61b606d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:59.733977 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3542e-fd2c-419b-8aa8-75f61b606d58 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:59.734524 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3542e-fd2c-419b-8aa8-75f61b606d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:59.734901 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3542e-fd2c-419b-8aa8-75f61b606d58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:59.804197 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:59.811375 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b3542e-fd2c-419b-8aa8-75f61b606d58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:59.812883 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b3542e-fd2c-419b-8aa8-75f61b606d58 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:59.912014 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 634/1241] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:05:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:05:59.918231 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63db3bb-d527-49d7-ad6f-5f7d3f65061a None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:59.948528 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:00.043146 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63db3bb-d527-49d7-ad6f-5f7d3f65061a None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:00.086273 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95fc68-813d-40f0-9259-32380df4596d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:00.087122 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95fc68-813d-40f0-9259-32380df4596d None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:00.087523 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95fc68-813d-40f0-9259-32380df4596d None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:00.087934 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95fc68-813d-40f0-9259-32380df4596d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:00.101734 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95fc68-813d-40f0-9259-32380df4596d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:00.103767 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95fc68-813d-40f0-9259-32380df4596d None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:00.120972 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-2a95fc68-813d-40f0-9259-32380df4596d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:06:00.120972 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:00.120972 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:00.120972 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:00.120972 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:00.120972 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:00.120972 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:00.120972 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:00.120972 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:00.120972 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:00.120972 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:00.120972 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:00.120972 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:06:00.120972 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:06:00.120972 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:06:00.122139 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:06:00.122139 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:00.122139 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:00.122139 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:00.122139 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:00.122139 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:00.122139 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:00.122139 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:00.122139 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:00.122139 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:00.122139 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:00.122139 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:00.122139 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:00.122139 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:00.122139 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:00.122139 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:00.122139 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:00.123244 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:06:00.123244 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:06:00.123244 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:06:00.123244 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:06:00.124506 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 608/1242] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:06:00.131393 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b3542e-fd2c-419b-8aa8-75f61b606d58 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:00.227640 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:00.234107 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b3542e-fd2c-419b-8aa8-75f61b606d58 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:00.275345 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809c0a1-da84-4979-b579-b223b7a61134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:00.276017 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809c0a1-da84-4979-b579-b223b7a61134 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:00.276327 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809c0a1-da84-4979-b579-b223b7a61134 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:00.276552 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809c0a1-da84-4979-b579-b223b7a61134 None admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:00.277246 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8809c0a1-da84-4979-b579-b223b7a61134 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:00.277538 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8809c0a1-da84-4979-b579-b223b7a61134 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:00.278926 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8809c0a1-da84-4979-b579-b223b7a61134 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:00.291074 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 635/1243] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:00.297966 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95fc68-813d-40f0-9259-32380df4596d None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:00.386757 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:00.411977 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95fc68-813d-40f0-9259-32380df4596d None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:00.450071 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b540c-7a48-421f-b7e9-7a30dfdf94ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:00.450896 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b540c-7a48-421f-b7e9-7a30dfdf94ac None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:00.451182 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b540c-7a48-421f-b7e9-7a30dfdf94ac None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:00.451474 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b540c-7a48-421f-b7e9-7a30dfdf94ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:00.458493 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5b540c-7a48-421f-b7e9-7a30dfdf94ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:00.459979 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5b540c-7a48-421f-b7e9-7a30dfdf94ac None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:00.472414 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-cc5b540c-7a48-421f-b7e9-7a30dfdf94ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:06:00.472414 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:00.472414 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:00.472414 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:00.472414 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:00.472414 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:00.472414 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:00.472414 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:00.472414 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:00.472414 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:00.472414 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:00.472414 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:00.472414 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:06:00.472414 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:06:00.472414 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:06:00.473380 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:06:00.473380 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:00.473380 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:00.473380 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:00.473380 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:00.473380 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:00.473380 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:00.473380 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:00.473380 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:00.473380 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:00.473380 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:00.473380 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:00.473380 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:00.473380 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:00.473380 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:00.473380 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:00.473380 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:00.474491 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:06:00.474491 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:06:00.474491 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:06:00.474491 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:06:00.474491 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:06:00.474491 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:06:00.474491 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:06:00.474491 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:06:00.474491 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 609/1244] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:06:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:06:00.480139 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809c0a1-da84-4979-b579-b223b7a61134 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:00.585784 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809c0a1-da84-4979-b579-b223b7a61134 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:00.622251 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3dde8-90f1-47c3-b7e9-fea439d5b6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:00.622952 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3dde8-90f1-47c3-b7e9-fea439d5b6f1 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:00.623395 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3dde8-90f1-47c3-b7e9-fea439d5b6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:00.623768 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3dde8-90f1-47c3-b7e9-fea439d5b6f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:00.624665 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f3dde8-90f1-47c3-b7e9-fea439d5b6f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:00.625039 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f3dde8-90f1-47c3-b7e9-fea439d5b6f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:00.627027 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f3dde8-90f1-47c3-b7e9-fea439d5b6f1 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:00.642713 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 636/1245] 10.222.0.60 () {56 vars in 1148 bytes} [Sun Jul 31 01:06:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:00.649508 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b540c-7a48-421f-b7e9-7a30dfdf94ac None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:00.760171 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b540c-7a48-421f-b7e9-7a30dfdf94ac None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:00.795908 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef52017-d2b2-4575-9e28-09b7f9c788c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:00.796544 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef52017-d2b2-4575-9e28-09b7f9c788c9 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:00.796823 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef52017-d2b2-4575-9e28-09b7f9c788c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:00.797096 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef52017-d2b2-4575-9e28-09b7f9c788c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:00.797967 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef52017-d2b2-4575-9e28-09b7f9c788c9 None admin] RBAC: Adding query filter params (role.id=a5d1b78d4ec146848dfa667303603262, scope.project.id=b931b81a237949aa845891d4bb5aa1c0, user.id=657a3f73879e4b31b70a1c4f73e80f5d) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:00.798289 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef52017-d2b2-4575-9e28-09b7f9c788c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:00.799951 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef52017-d2b2-4575-9e28-09b7f9c788c9 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:00.806403 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 610/1246] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:06:00 2022] GET /identity/v3/role_assignments?user.id=657a3f73879e4b31b70a1c4f73e80f5d&scope.project.id=b931b81a237949aa845891d4bb5aa1c0&role.id=a5d1b78d4ec146848dfa667303603262 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:02.988664 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1553fb-d7bf-442d-a28a-6917423356d3 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:02.989255 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1553fb-d7bf-442d-a28a-6917423356d3 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:02.989255 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1553fb-d7bf-442d-a28a-6917423356d3 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:02.991233 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 637/1247] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:06:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:06:02.997593 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367c7bf-4127-456e-b2ed-618e042d9a1c None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:02.998044 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367c7bf-4127-456e-b2ed-618e042d9a1c None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:02.998151 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367c7bf-4127-456e-b2ed-618e042d9a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:03.005485 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:03.019848 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-4367c7bf-4127-456e-b2ed-618e042d9a1c None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:03.021298 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-4367c7bf-4127-456e-b2ed-618e042d9a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:03.102063 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 611/1248] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:06:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:06:03.126846 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1553fb-d7bf-442d-a28a-6917423356d3 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:03.146138 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:03.248878 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1553fb-d7bf-442d-a28a-6917423356d3 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:03.293414 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a9fa9-3ce4-43c1-ac1c-79cfbf58c483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:03.294198 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a9fa9-3ce4-43c1-ac1c-79cfbf58c483 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:03.294514 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a9fa9-3ce4-43c1-ac1c-79cfbf58c483 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:03.294808 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a9fa9-3ce4-43c1-ac1c-79cfbf58c483 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:03.306692 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a9fa9-3ce4-43c1-ac1c-79cfbf58c483 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:06:03.311736 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-4f9a9fa9-3ce4-43c1-ac1c-79cfbf58c483 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:06:03.311736 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:03.311736 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:03.311736 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:03.311736 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:03.311736 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:03.311736 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:03.311736 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:03.311736 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:03.311736 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:03.311736 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:03.311736 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:03.311736 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:06:03.311736 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:06:03.311736 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:06:03.311736 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:06:03.312722 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:06:03.312722 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:06:03.312722 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:06:03.312722 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:06:03.312722 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:03.312722 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:03.312722 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:03.312722 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:03.312722 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:03.312722 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:03.312722 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:03.312722 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:03.312722 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:03.312722 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:03.312722 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:03.312722 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:03.313585 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:03.313585 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:03.313585 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:03.313585 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:03.313585 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:06:03.313585 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:06:03.313585 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:06:03.313585 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:06:03.313585 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:06:03.313585 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:06:03.313585 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:06:03.313585 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:06:03.313585 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 638/1249] 10.222.0.60 () {56 vars in 1096 bytes} [Sun Jul 31 01:06:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:06:03.319338 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367c7bf-4127-456e-b2ed-618e042d9a1c None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:03.439793 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367c7bf-4127-456e-b2ed-618e042d9a1c None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:03.484405 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:03.490878 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262db3f-48cc-4a2c-99ff-124b99421f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:03.491595 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262db3f-48cc-4a2c-99ff-124b99421f00 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:03.491873 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262db3f-48cc-4a2c-99ff-124b99421f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:03.492184 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262db3f-48cc-4a2c-99ff-124b99421f00 None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:03.493029 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262db3f-48cc-4a2c-99ff-124b99421f00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:03.493448 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262db3f-48cc-4a2c-99ff-124b99421f00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:03.495299 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262db3f-48cc-4a2c-99ff-124b99421f00 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:03.511432 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 612/1250] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:06:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:03.513130 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a9fa9-3ce4-43c1-ac1c-79cfbf58c483 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:03.603848 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:03.628935 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a9fa9-3ce4-43c1-ac1c-79cfbf58c483 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:03.666395 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105ee2e-aa06-4e8e-a55e-0c751f4feff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:03.667188 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105ee2e-aa06-4e8e-a55e-0c751f4feff7 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:03.667471 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105ee2e-aa06-4e8e-a55e-0c751f4feff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:03.667889 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105ee2e-aa06-4e8e-a55e-0c751f4feff7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:03.680168 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7105ee2e-aa06-4e8e-a55e-0c751f4feff7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:03.681989 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7105ee2e-aa06-4e8e-a55e-0c751f4feff7 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:03.698894 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-7105ee2e-aa06-4e8e-a55e-0c751f4feff7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:06:03.698894 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:03.698894 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:03.698894 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:03.698894 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:03.698894 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:03.698894 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:03.698894 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:03.698894 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:03.698894 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:03.698894 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:03.698894 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:03.698894 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:06:03.698894 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:06:03.698894 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:06:03.699995 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:06:03.699995 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:03.699995 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:03.699995 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:03.699995 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:03.699995 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:03.699995 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:03.699995 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:03.699995 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:03.699995 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:03.699995 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:03.699995 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:03.699995 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:03.699995 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:03.699995 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:03.699995 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:03.699995 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:03.701195 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:06:03.701195 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:06:03.701195 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:06:03.701195 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:06:03.701195 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 639/1251] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:06:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:06:03.706590 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262db3f-48cc-4a2c-99ff-124b99421f00 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:03.825236 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262db3f-48cc-4a2c-99ff-124b99421f00 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:03.862353 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531bd3ab-db01-4fe2-922f-ca1d2be77773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:03.863053 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bd3ab-db01-4fe2-922f-ca1d2be77773 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:03.863298 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bd3ab-db01-4fe2-922f-ca1d2be77773 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:03.863598 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bd3ab-db01-4fe2-922f-ca1d2be77773 None admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:03.864348 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531bd3ab-db01-4fe2-922f-ca1d2be77773 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:03.864639 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531bd3ab-db01-4fe2-922f-ca1d2be77773 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:03.866136 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531bd3ab-db01-4fe2-922f-ca1d2be77773 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:03.882628 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 613/1252] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:06:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:03.888685 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105ee2e-aa06-4e8e-a55e-0c751f4feff7 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:04.005082 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105ee2e-aa06-4e8e-a55e-0c751f4feff7 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:04.039319 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:04.048896 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f545fe-e6d6-4d7e-80a5-bb0229f93a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:04.049654 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f545fe-e6d6-4d7e-80a5-bb0229f93a14 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:04.049934 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f545fe-e6d6-4d7e-80a5-bb0229f93a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:04.050232 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f545fe-e6d6-4d7e-80a5-bb0229f93a14 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:04.060092 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f545fe-e6d6-4d7e-80a5-bb0229f93a14 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:04.061780 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f545fe-e6d6-4d7e-80a5-bb0229f93a14 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:04.076429 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-09f545fe-e6d6-4d7e-80a5-bb0229f93a14 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 31 01:06:04.076429 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:04.076429 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:04.076429 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:04.076429 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:04.076429 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:04.076429 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:04.076429 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:04.076429 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:04.076429 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:04.076429 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:04.076429 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:04.076429 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:06:04.076429 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:06:04.076429 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:06:04.076429 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:06:04.077903 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:04.077903 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:04.077903 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:06:04.077903 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:06:04.077903 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:06:04.077903 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:06:04.077903 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:04.077903 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:04.077903 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:04.077903 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:04.077903 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:04.077903 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:04.077903 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:04.077903 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:04.077903 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:04.077903 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:04.077903 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:04.077903 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:04.078936 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:04.078936 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:04.078936 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:06:04.078936 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:06:04.078936 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:06:04.078936 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:06:04.078936 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:06:04.078936 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:06:04.078936 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 31 01:06:04.078936 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:06:04.078936 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 640/1253] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:06:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:06:04.084666 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531bd3ab-db01-4fe2-922f-ca1d2be77773 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:04.152584 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:04.201063 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531bd3ab-db01-4fe2-922f-ca1d2be77773 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:04.238851 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f3d1d-4016-455d-b1a4-cd3001399a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:04.239590 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f3d1d-4016-455d-b1a4-cd3001399a02 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:04.239869 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f3d1d-4016-455d-b1a4-cd3001399a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:04.240140 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f3d1d-4016-455d-b1a4-cd3001399a02 None admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:04.241048 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f3d1d-4016-455d-b1a4-cd3001399a02 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:04.241465 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f3d1d-4016-455d-b1a4-cd3001399a02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:04.243145 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f3d1d-4016-455d-b1a4-cd3001399a02 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:04.264184 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 614/1254] 10.222.0.60 () {56 vars in 1143 bytes} [Sun Jul 31 01:06:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:04.270211 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f545fe-e6d6-4d7e-80a5-bb0229f93a14 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:04.383921 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f545fe-e6d6-4d7e-80a5-bb0229f93a14 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:04.420036 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd384f-a494-4824-a33b-e49956bebe05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:04.421241 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd384f-a494-4824-a33b-e49956bebe05 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:04.421504 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd384f-a494-4824-a33b-e49956bebe05 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:04.421881 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd384f-a494-4824-a33b-e49956bebe05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:04.483789 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:04.497332 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd384f-a494-4824-a33b-e49956bebe05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:04.498930 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd384f-a494-4824-a33b-e49956bebe05 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:04.605798 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 641/1255] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:06:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:06:04.612752 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f3d1d-4016-455d-b1a4-cd3001399a02 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:04.732398 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f3d1d-4016-455d-b1a4-cd3001399a02 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:04.753343 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:04.782630 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f3fdbd-ef98-47dc-964c-dec764cc8410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:04.783319 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3fdbd-ef98-47dc-964c-dec764cc8410 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:04.783634 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3fdbd-ef98-47dc-964c-dec764cc8410 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:04.783907 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3fdbd-ef98-47dc-964c-dec764cc8410 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:04.796609 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f3fdbd-ef98-47dc-964c-dec764cc8410 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:04.798074 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f3fdbd-ef98-47dc-964c-dec764cc8410 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:04.816512 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-31f3fdbd-ef98-47dc-964c-dec764cc8410 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:06:04.816512 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:04.816512 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:04.816512 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:04.816512 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:04.816512 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:04.816512 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:04.816512 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:04.816512 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:04.816512 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:04.816512 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:04.816512 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:04.816512 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:06:04.816512 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:06:04.816512 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:06:04.817818 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:06:04.817818 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:04.817818 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:04.817818 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:04.817818 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:04.817818 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:04.817818 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:04.817818 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:04.817818 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:04.817818 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:04.817818 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:04.817818 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:04.817818 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:04.817818 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:04.817818 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:04.817818 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:04.817818 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:04.818931 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:06:04.818931 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:06:04.818931 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:06:04.818931 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:06:04.818931 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 615/1256] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:06:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:06:04.826733 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd384f-a494-4824-a33b-e49956bebe05 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:04.925773 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:04.939250 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd384f-a494-4824-a33b-e49956bebe05 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:04.979301 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0b9ec-94df-40e1-8e90-d42d6e718189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:04.980004 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0b9ec-94df-40e1-8e90-d42d6e718189 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:04.980282 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0b9ec-94df-40e1-8e90-d42d6e718189 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:04.980558 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0b9ec-94df-40e1-8e90-d42d6e718189 None admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:04.981247 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea0b9ec-94df-40e1-8e90-d42d6e718189 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:04.981591 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea0b9ec-94df-40e1-8e90-d42d6e718189 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:04.983793 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea0b9ec-94df-40e1-8e90-d42d6e718189 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:04.997457 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 642/1257] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:05.004225 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f3fdbd-ef98-47dc-964c-dec764cc8410 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:05.130285 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f3fdbd-ef98-47dc-964c-dec764cc8410 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:05.164922 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13c7853-fd72-41fb-a880-d507c87b7569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:05.165613 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c7853-fd72-41fb-a880-d507c87b7569 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:05.165915 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c7853-fd72-41fb-a880-d507c87b7569 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:05.166181 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c7853-fd72-41fb-a880-d507c87b7569 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:05.173405 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13c7853-fd72-41fb-a880-d507c87b7569 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:05.174856 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13c7853-fd72-41fb-a880-d507c87b7569 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:05.186352 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-a13c7853-fd72-41fb-a880-d507c87b7569 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:06:05.186352 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:05.186352 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:05.186352 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:05.186352 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:05.186352 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:05.186352 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:05.186352 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:05.186352 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:05.186352 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:05.186352 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:05.186352 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:05.186352 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:06:05.186352 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:06:05.186352 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:06:05.187385 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:06:05.187385 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:05.187385 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:05.187385 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:05.187385 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:05.187385 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:05.187385 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:05.187385 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:05.187385 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:05.187385 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:05.187385 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:05.187385 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:05.187385 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:05.187385 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:05.187385 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:05.187385 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:05.187385 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:05.188415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:06:05.188415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:06:05.188415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:06:05.188415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:06:05.188415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:06:05.188415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:06:05.188415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:06:05.188415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:06:05.192623 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 616/1258] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:06:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:06:05.193651 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0b9ec-94df-40e1-8e90-d42d6e718189 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:05.296841 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0b9ec-94df-40e1-8e90-d42d6e718189 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:05.333713 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b99e1e-4b4a-4d64-8f7e-db18302c0f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:05.334451 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b99e1e-4b4a-4d64-8f7e-db18302c0f93 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:05.334798 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b99e1e-4b4a-4d64-8f7e-db18302c0f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:05.335118 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b99e1e-4b4a-4d64-8f7e-db18302c0f93 None admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:05.336115 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b99e1e-4b4a-4d64-8f7e-db18302c0f93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:05.336454 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b99e1e-4b4a-4d64-8f7e-db18302c0f93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:05.338338 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b99e1e-4b4a-4d64-8f7e-db18302c0f93 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:05.351524 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 643/1259] 10.222.0.60 () {56 vars in 1148 bytes} [Sun Jul 31 01:06:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:05.358136 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13c7853-fd72-41fb-a880-d507c87b7569 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:05.386617 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:05.471760 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13c7853-fd72-41fb-a880-d507c87b7569 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:05.513550 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b98e5a-566a-4f6b-baee-ebe6b1afbd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:05.514436 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b98e5a-566a-4f6b-baee-ebe6b1afbd6a None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:05.514863 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b98e5a-566a-4f6b-baee-ebe6b1afbd6a None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:05.515315 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b98e5a-566a-4f6b-baee-ebe6b1afbd6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:05.516389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b98e5a-566a-4f6b-baee-ebe6b1afbd6a None admin] RBAC: Adding query filter params (role.id=fef526a7d2e741ce995d107f3ac934ae, scope.project.id=b931b81a237949aa845891d4bb5aa1c0, user.id=657a3f73879e4b31b70a1c4f73e80f5d) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:05.516697 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b98e5a-566a-4f6b-baee-ebe6b1afbd6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:05.518104 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b98e5a-566a-4f6b-baee-ebe6b1afbd6a None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:05.524587 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 617/1260] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:06:05 2022] GET /identity/v3/role_assignments?user.id=657a3f73879e4b31b70a1c4f73e80f5d&scope.project.id=b931b81a237949aa845891d4bb5aa1c0&role.id=fef526a7d2e741ce995d107f3ac934ae => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:07.724482 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c5f04-d81f-4bd9-b18b-1bdd718344ed None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:07.725026 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c5f04-d81f-4bd9-b18b-1bdd718344ed None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:07.725320 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c5f04-d81f-4bd9-b18b-1bdd718344ed None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:07.727057 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 644/1261] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:06:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:07.732508 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9507b-de1e-4a6d-8add-0ab348c91931 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:07.732935 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9507b-de1e-4a6d-8add-0ab348c91931 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:07.733101 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9507b-de1e-4a6d-8add-0ab348c91931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:07.754552 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-cce9507b-de1e-4a6d-8add-0ab348c91931 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:07.756068 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-cce9507b-de1e-4a6d-8add-0ab348c91931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:07.835457 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 618/1262] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:06:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:06:07.858423 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c5f04-d81f-4bd9-b18b-1bdd718344ed None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:07.870834 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:07.967345 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c5f04-d81f-4bd9-b18b-1bdd718344ed None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:08.005224 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30918838-43cc-4c3f-bc01-a7fbf8bd906b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:08.005782 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30918838-43cc-4c3f-bc01-a7fbf8bd906b None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:08.006058 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30918838-43cc-4c3f-bc01-a7fbf8bd906b None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:08.006322 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30918838-43cc-4c3f-bc01-a7fbf8bd906b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:08.017573 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30918838-43cc-4c3f-bc01-a7fbf8bd906b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:06:08.022557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-30918838-43cc-4c3f-bc01-a7fbf8bd906b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:06:08.022557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:08.022557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:08.022557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:08.022557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:08.022557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:08.022557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:08.022557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:08.022557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:08.022557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:08.022557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:08.022557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:08.022557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:06:08.022557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:06:08.022557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:06:08.022557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:06:08.023698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:06:08.023698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:06:08.023698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:06:08.023698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:06:08.023698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:08.023698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:08.023698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:08.023698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:08.023698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:08.023698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:08.023698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:08.023698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:08.023698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:08.023698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:08.023698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:08.023698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:08.024546 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:08.024546 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:08.024546 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:08.024546 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:08.024546 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:06:08.024546 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:06:08.024546 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:06:08.024546 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:06:08.024546 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:06:08.024546 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:06:08.024546 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:06:08.024546 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:06:08.024546 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 645/1263] 10.222.0.60 () {56 vars in 1096 bytes} [Sun Jul 31 01:06:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:06:08.030200 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9507b-de1e-4a6d-8add-0ab348c91931 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:08.050783 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:08.146669 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9507b-de1e-4a6d-8add-0ab348c91931 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:08.186887 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42e4ba-fc93-4669-ab10-22017b07c91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:08.187544 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42e4ba-fc93-4669-ab10-22017b07c91f None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:08.187829 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42e4ba-fc93-4669-ab10-22017b07c91f None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:08.188094 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42e4ba-fc93-4669-ab10-22017b07c91f None admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:08.188823 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d42e4ba-fc93-4669-ab10-22017b07c91f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:08.189122 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d42e4ba-fc93-4669-ab10-22017b07c91f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:08.190497 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d42e4ba-fc93-4669-ab10-22017b07c91f None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:08.200076 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 619/1264] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:06:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:08.206056 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30918838-43cc-4c3f-bc01-a7fbf8bd906b None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:08.275533 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:08.308722 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30918838-43cc-4c3f-bc01-a7fbf8bd906b None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:08.342923 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf1e745-7855-4cb5-bd3b-7db81183d6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:08.343627 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf1e745-7855-4cb5-bd3b-7db81183d6de None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:08.343904 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf1e745-7855-4cb5-bd3b-7db81183d6de None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:08.344173 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf1e745-7855-4cb5-bd3b-7db81183d6de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:08.354389 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf1e745-7855-4cb5-bd3b-7db81183d6de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:08.355884 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf1e745-7855-4cb5-bd3b-7db81183d6de None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:08.372375 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-acf1e745-7855-4cb5-bd3b-7db81183d6de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:06:08.372375 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:08.372375 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:08.372375 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:08.372375 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:08.372375 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:08.372375 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:08.372375 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:08.372375 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:08.372375 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:08.372375 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:08.372375 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:08.372375 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:06:08.372375 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:06:08.372375 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:06:08.373353 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:06:08.373353 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:08.373353 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:08.373353 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:08.373353 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:08.373353 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:08.373353 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:08.373353 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:08.373353 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:08.373353 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:08.373353 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:08.373353 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:08.373353 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:08.373353 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:08.373353 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:08.373353 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:08.373353 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:08.374263 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:06:08.374263 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:06:08.374263 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:06:08.374263 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:06:08.374263 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 646/1265] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:06:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:06:08.379872 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42e4ba-fc93-4669-ab10-22017b07c91f None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:08.465034 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:08.483873 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42e4ba-fc93-4669-ab10-22017b07c91f None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:08.518090 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba636b29-720c-40c3-b45b-6c6d421fd3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:08.518706 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba636b29-720c-40c3-b45b-6c6d421fd3ec None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:08.518982 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba636b29-720c-40c3-b45b-6c6d421fd3ec None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:08.519253 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba636b29-720c-40c3-b45b-6c6d421fd3ec None admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:08.519981 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba636b29-720c-40c3-b45b-6c6d421fd3ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:08.520264 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba636b29-720c-40c3-b45b-6c6d421fd3ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:08.521623 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba636b29-720c-40c3-b45b-6c6d421fd3ec None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:08.533403 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 620/1266] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:08.542258 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf1e745-7855-4cb5-bd3b-7db81183d6de None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:08.658491 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf1e745-7855-4cb5-bd3b-7db81183d6de None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:08.681146 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:08.697671 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f988a-91fd-4ac4-965f-14d8fb983515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:08.698317 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f988a-91fd-4ac4-965f-14d8fb983515 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:08.698592 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f988a-91fd-4ac4-965f-14d8fb983515 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:08.698863 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f988a-91fd-4ac4-965f-14d8fb983515 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:08.706637 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f988a-91fd-4ac4-965f-14d8fb983515 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:08.708107 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f988a-91fd-4ac4-965f-14d8fb983515 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:08.720133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-b56f988a-91fd-4ac4-965f-14d8fb983515 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 31 01:06:08.720133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:08.720133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:08.720133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:08.720133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:08.720133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:08.720133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:08.720133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:08.720133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:08.720133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:08.720133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:08.720133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:08.720133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:06:08.720133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:06:08.720133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:06:08.720133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:06:08.721213 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:08.721213 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:08.721213 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:06:08.721213 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:06:08.721213 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:06:08.721213 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:06:08.721213 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:08.721213 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:08.721213 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:08.721213 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:08.721213 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:08.721213 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:08.721213 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:08.721213 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:08.721213 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:08.721213 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:08.721213 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:08.721213 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:08.722274 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:08.722274 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:08.722274 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:06:08.722274 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:06:08.722274 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:06:08.722274 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:06:08.722274 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:06:08.722274 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:06:08.722274 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 31 01:06:08.722274 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:06:08.722274 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 647/1267] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:06:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:06:08.728234 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba636b29-720c-40c3-b45b-6c6d421fd3ec None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:08.836057 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba636b29-720c-40c3-b45b-6c6d421fd3ec None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:08.873048 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e3512a-c850-495e-b26c-92e8c1c0be6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:08.873683 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3512a-c850-495e-b26c-92e8c1c0be6d None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:08.873932 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3512a-c850-495e-b26c-92e8c1c0be6d None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:08.874202 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3512a-c850-495e-b26c-92e8c1c0be6d None admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:08.874997 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e3512a-c850-495e-b26c-92e8c1c0be6d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:08.875301 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e3512a-c850-495e-b26c-92e8c1c0be6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:08.877114 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e3512a-c850-495e-b26c-92e8c1c0be6d None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:08.885658 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:08.894304 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 621/1268] 10.222.0.60 () {56 vars in 1143 bytes} [Sun Jul 31 01:06:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:08.902433 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f988a-91fd-4ac4-965f-14d8fb983515 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:09.018059 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f988a-91fd-4ac4-965f-14d8fb983515 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:09.059051 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc6adb4-cae6-45d4-b6ab-10f64779b185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:09.059863 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6adb4-cae6-45d4-b6ab-10f64779b185 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:09.060182 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6adb4-cae6-45d4-b6ab-10f64779b185 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:09.060484 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6adb4-cae6-45d4-b6ab-10f64779b185 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:09.073247 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc6adb4-cae6-45d4-b6ab-10f64779b185 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:09.075257 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc6adb4-cae6-45d4-b6ab-10f64779b185 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:09.093031 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-cdc6adb4-cae6-45d4-b6ab-10f64779b185 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:06:09.093031 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:09.093031 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:09.093031 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:09.093031 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:09.093031 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:09.093031 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:09.093031 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:09.093031 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:09.093031 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:09.093031 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:09.093031 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:09.093031 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:06:09.093031 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:06:09.093031 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:06:09.094572 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:06:09.094572 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:09.094572 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:09.094572 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:09.094572 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:09.094572 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:09.094572 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:09.094572 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:09.094572 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:09.094572 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:09.094572 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:09.094572 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:09.094572 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:09.094572 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:09.094572 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:09.094572 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:09.094572 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:09.096289 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:06:09.096289 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:06:09.096289 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:06:09.096289 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:06:09.096289 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 648/1269] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:06:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:06:09.100751 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e3512a-c850-495e-b26c-92e8c1c0be6d None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:09.203279 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e3512a-c850-495e-b26c-92e8c1c0be6d None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:09.238808 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae94ee5-84a7-4116-966c-e20750f21469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:09.239852 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae94ee5-84a7-4116-966c-e20750f21469 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:09.240352 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae94ee5-84a7-4116-966c-e20750f21469 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:09.240840 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae94ee5-84a7-4116-966c-e20750f21469 None admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:09.242122 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae94ee5-84a7-4116-966c-e20750f21469 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:09.242689 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae94ee5-84a7-4116-966c-e20750f21469 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:09.245066 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae94ee5-84a7-4116-966c-e20750f21469 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:09.260709 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 622/1270] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:06:09.270008 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc6adb4-cae6-45d4-b6ab-10f64779b185 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:09.311368 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:09.383326 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc6adb4-cae6-45d4-b6ab-10f64779b185 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:09.419899 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e7a64-7e8f-4ab0-adf1-23eb7ff9af3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:09.420537 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e7a64-7e8f-4ab0-adf1-23eb7ff9af3e None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:09.420812 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e7a64-7e8f-4ab0-adf1-23eb7ff9af3e None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:09.421079 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e7a64-7e8f-4ab0-adf1-23eb7ff9af3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:09.428390 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e7a64-7e8f-4ab0-adf1-23eb7ff9af3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:09.429848 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e7a64-7e8f-4ab0-adf1-23eb7ff9af3e None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:09.441476 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-795e7a64-7e8f-4ab0-adf1-23eb7ff9af3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:06:09.441476 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:09.441476 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:09.441476 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:09.441476 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:09.441476 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:09.441476 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:09.441476 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:09.441476 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:09.441476 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:09.441476 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:09.441476 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:09.441476 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:06:09.441476 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:06:09.441476 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:06:09.442562 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:06:09.442562 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:09.442562 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:09.442562 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:09.442562 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:09.442562 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:09.442562 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:09.442562 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:09.442562 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:09.442562 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:09.442562 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:09.442562 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:09.442562 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:09.442562 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:09.442562 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:09.442562 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:09.442562 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:09.443770 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:06:09.443770 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:06:09.443770 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:06:09.443770 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:06:09.443770 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:06:09.443770 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:06:09.443770 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:06:09.443770 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:06:09.447698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 649/1271] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:06:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:06:09.448753 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae94ee5-84a7-4116-966c-e20750f21469 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:09.508514 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:09.557081 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae94ee5-84a7-4116-966c-e20750f21469 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:09.592608 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d47aa7-fbf9-4a6d-9697-1284f17fa915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:09.593215 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d47aa7-fbf9-4a6d-9697-1284f17fa915 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:09.593491 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d47aa7-fbf9-4a6d-9697-1284f17fa915 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:09.593759 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d47aa7-fbf9-4a6d-9697-1284f17fa915 None admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:09.594512 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d47aa7-fbf9-4a6d-9697-1284f17fa915 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:09.594821 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d47aa7-fbf9-4a6d-9697-1284f17fa915 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:09.596283 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d47aa7-fbf9-4a6d-9697-1284f17fa915 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:09.608335 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 623/1272] 10.222.0.60 () {56 vars in 1148 bytes} [Sun Jul 31 01:06:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:06:09.615423 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e7a64-7e8f-4ab0-adf1-23eb7ff9af3e None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:09.711783 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:09.722199 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e7a64-7e8f-4ab0-adf1-23eb7ff9af3e None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:09.758022 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5e879-9167-4c48-bc96-9b05a084428b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:09.758685 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5e879-9167-4c48-bc96-9b05a084428b None admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:09.758958 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5e879-9167-4c48-bc96-9b05a084428b None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:09.759240 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5e879-9167-4c48-bc96-9b05a084428b None admin] PATH_INFO: `/v3/projects/b931b81a237949aa845891d4bb5aa1c0/users/657a3f73879e4b31b70a1c4f73e80f5d/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:09.761530 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f5e879-9167-4c48-bc96-9b05a084428b None admin] RBAC: Authorizing `identity:create_grant(project_id=b931b81a237949aa845891d4bb5aa1c0, user_id=657a3f73879e4b31b70a1c4f73e80f5d, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:09.762958 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f5e879-9167-4c48-bc96-9b05a084428b None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:09.778449 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 650/1273] 10.222.0.60 () {58 vars in 1439 bytes} [Sun Jul 31 01:06:09 2022] PUT /identity/v3/projects/b931b81a237949aa845891d4bb5aa1c0/users/657a3f73879e4b31b70a1c4f73e80f5d/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:06:11.756972 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a360c7f-99f5-4c5e-94ab-c9183fb9bfa5 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:11.757538 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a360c7f-99f5-4c5e-94ab-c9183fb9bfa5 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:11.757538 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a360c7f-99f5-4c5e-94ab-c9183fb9bfa5 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:11.758953 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 624/1274] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:06:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:11.765981 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75da75f-3b5d-4b60-978d-3e162fd3bf4b None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:11.766701 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75da75f-3b5d-4b60-978d-3e162fd3bf4b None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:11.766928 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75da75f-3b5d-4b60-978d-3e162fd3bf4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:11.796998 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-f75da75f-3b5d-4b60-978d-3e162fd3bf4b None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:11.798933 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-f75da75f-3b5d-4b60-978d-3e162fd3bf4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:11.879946 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 651/1275] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:06:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:06:11.912057 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a360c7f-99f5-4c5e-94ab-c9183fb9bfa5 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:12.028236 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a360c7f-99f5-4c5e-94ab-c9183fb9bfa5 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:12.046677 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:12.067012 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4da21-9bad-49f8-958e-3f6cb3f8e446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:12.067774 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4da21-9bad-49f8-958e-3f6cb3f8e446 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:12.068060 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4da21-9bad-49f8-958e-3f6cb3f8e446 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:12.068443 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4da21-9bad-49f8-958e-3f6cb3f8e446 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:12.081508 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4da21-9bad-49f8-958e-3f6cb3f8e446 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:06:12.086848 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-98b4da21-9bad-49f8-958e-3f6cb3f8e446 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:06:12.086848 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:12.086848 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:12.086848 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:12.086848 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:12.086848 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:12.086848 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:12.086848 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:12.086848 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:12.086848 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:12.086848 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:12.086848 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:12.086848 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:06:12.086848 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:06:12.086848 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:06:12.086848 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:06:12.087952 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:06:12.087952 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:06:12.087952 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:06:12.087952 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:06:12.087952 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:12.087952 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:12.087952 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:12.087952 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:12.087952 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:12.087952 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:12.087952 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:12.087952 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:12.087952 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:12.087952 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:12.087952 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:12.087952 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:12.088976 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:12.088976 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:12.088976 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:12.088976 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:12.088976 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:06:12.088976 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:06:12.088976 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:06:12.088976 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:06:12.088976 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:06:12.088976 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:06:12.088976 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:06:12.088976 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:06:12.088976 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 625/1276] 10.222.0.60 () {56 vars in 1096 bytes} [Sun Jul 31 01:06:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:06:12.095165 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75da75f-3b5d-4b60-978d-3e162fd3bf4b None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:12.183350 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:12.201921 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75da75f-3b5d-4b60-978d-3e162fd3bf4b None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:12.235918 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf0fe0-f5ac-4139-b6f2-0602892d3f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:12.236535 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf0fe0-f5ac-4139-b6f2-0602892d3f1f None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:12.236811 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf0fe0-f5ac-4139-b6f2-0602892d3f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:12.237082 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf0fe0-f5ac-4139-b6f2-0602892d3f1f None admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:12.237787 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf0fe0-f5ac-4139-b6f2-0602892d3f1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:12.238087 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf0fe0-f5ac-4139-b6f2-0602892d3f1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:12.239463 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf0fe0-f5ac-4139-b6f2-0602892d3f1f None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:12.247835 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 652/1277] 10.222.0.60 () {56 vars in 1099 bytes} [Sun Jul 31 01:06:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:12.257420 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4da21-9bad-49f8-958e-3f6cb3f8e446 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:12.364144 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4da21-9bad-49f8-958e-3f6cb3f8e446 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:12.412775 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90186e4e-1a04-4c6a-8504-85eafb56e804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:12.413407 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90186e4e-1a04-4c6a-8504-85eafb56e804 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:12.413683 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90186e4e-1a04-4c6a-8504-85eafb56e804 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:12.413952 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90186e4e-1a04-4c6a-8504-85eafb56e804 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:12.425192 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90186e4e-1a04-4c6a-8504-85eafb56e804 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:12.426690 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90186e4e-1a04-4c6a-8504-85eafb56e804 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:12.440990 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-90186e4e-1a04-4c6a-8504-85eafb56e804 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:06:12.440990 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:12.440990 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:12.440990 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:12.440990 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:12.440990 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:12.440990 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:12.440990 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:12.440990 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:12.440990 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:12.440990 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:12.440990 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:12.440990 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:06:12.440990 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:06:12.440990 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:06:12.442010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:06:12.442010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:12.442010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:12.442010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:12.442010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:12.442010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:12.442010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:12.442010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:12.442010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:12.442010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:12.442010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:12.442010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:12.442010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:12.442010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:12.442010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:12.442010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:12.442010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:12.443068 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:06:12.443068 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:06:12.443068 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:06:12.443068 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:06:12.443068 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 626/1278] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:06:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:06:12.448992 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf0fe0-f5ac-4139-b6f2-0602892d3f1f None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:12.555120 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf0fe0-f5ac-4139-b6f2-0602892d3f1f None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:12.589943 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71b964-f384-4ac0-92b5-5865e91d6a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:12.590550 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71b964-f384-4ac0-92b5-5865e91d6a0b None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:12.590827 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71b964-f384-4ac0-92b5-5865e91d6a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:12.591100 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71b964-f384-4ac0-92b5-5865e91d6a0b None admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:12.591837 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a71b964-f384-4ac0-92b5-5865e91d6a0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:12.592139 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a71b964-f384-4ac0-92b5-5865e91d6a0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:12.593506 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a71b964-f384-4ac0-92b5-5865e91d6a0b None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:12.605241 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 653/1279] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:06:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:12.614262 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90186e4e-1a04-4c6a-8504-85eafb56e804 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:12.649162 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:12.737071 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90186e4e-1a04-4c6a-8504-85eafb56e804 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:12.780022 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc1f07-13d1-4d30-8e1e-d009b2f738df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:12.780756 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc1f07-13d1-4d30-8e1e-d009b2f738df None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:12.780896 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc1f07-13d1-4d30-8e1e-d009b2f738df None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:12.781192 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc1f07-13d1-4d30-8e1e-d009b2f738df None admin] PATH_INFO: `/v3/users/placement` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:12.789668 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc1f07-13d1-4d30-8e1e-d009b2f738df None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:12.791174 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc1f07-13d1-4d30-8e1e-d009b2f738df None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:12.802509 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-50cc1f07-13d1-4d30-8e1e-d009b2f738df None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 31 01:06:12.802509 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:12.802509 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:12.802509 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:12.802509 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:12.802509 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:12.802509 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:12.802509 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:12.802509 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:12.802509 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:12.802509 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:12.802509 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:12.802509 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:06:12.802509 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:06:12.802509 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:06:12.802509 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:06:12.803628 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:12.803628 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:12.803628 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:06:12.803628 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:06:12.803628 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:06:12.803628 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:06:12.803628 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:12.803628 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:12.803628 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:12.803628 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:12.803628 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:12.803628 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:12.803628 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:12.803628 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:12.803628 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:12.803628 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:12.803628 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:12.803628 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:12.804968 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:12.804968 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:12.804968 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:06:12.804968 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:06:12.804968 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:06:12.804968 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:06:12.804968 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:06:12.804968 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:06:12.804968 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 31 01:06:12.804968 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:06:12.804968 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 627/1280] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:06:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:06:12.809873 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71b964-f384-4ac0-92b5-5865e91d6a0b None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:12.814272 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:12.919354 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71b964-f384-4ac0-92b5-5865e91d6a0b None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:12.953805 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc812af2-b0bb-4a34-9283-03b0cd8d035b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:12.954416 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc812af2-b0bb-4a34-9283-03b0cd8d035b None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:12.954692 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc812af2-b0bb-4a34-9283-03b0cd8d035b None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:12.954961 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc812af2-b0bb-4a34-9283-03b0cd8d035b None admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:12.955781 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc812af2-b0bb-4a34-9283-03b0cd8d035b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:12.956091 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc812af2-b0bb-4a34-9283-03b0cd8d035b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:12.957520 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc812af2-b0bb-4a34-9283-03b0cd8d035b None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:12.974169 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 654/1281] 10.222.0.60 () {56 vars in 1143 bytes} [Sun Jul 31 01:06:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:12.980929 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc1f07-13d1-4d30-8e1e-d009b2f738df None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:13.092115 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:13.102411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc1f07-13d1-4d30-8e1e-d009b2f738df None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:13.140886 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81143bfb-5ee0-4b26-9a0d-d1e97d535614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:13.141493 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81143bfb-5ee0-4b26-9a0d-d1e97d535614 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:13.141773 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81143bfb-5ee0-4b26-9a0d-d1e97d535614 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:13.142043 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81143bfb-5ee0-4b26-9a0d-d1e97d535614 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:13.210665 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81143bfb-5ee0-4b26-9a0d-d1e97d535614 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:13.212067 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81143bfb-5ee0-4b26-9a0d-d1e97d535614 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:13.302423 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:13.312852 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 628/1282] 10.222.0.60 () {58 vars in 1282 bytes} [Sun Jul 31 01:06:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:06:13.319113 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc812af2-b0bb-4a34-9283-03b0cd8d035b None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:13.383521 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:13.430782 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc812af2-b0bb-4a34-9283-03b0cd8d035b None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:13.469681 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106038a-1416-4d7b-a4cf-82b974e45315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:13.470234 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106038a-1416-4d7b-a4cf-82b974e45315 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:13.470508 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106038a-1416-4d7b-a4cf-82b974e45315 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:13.470770 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106038a-1416-4d7b-a4cf-82b974e45315 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:13.480633 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d106038a-1416-4d7b-a4cf-82b974e45315 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:13.482062 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d106038a-1416-4d7b-a4cf-82b974e45315 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:13.496286 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-d106038a-1416-4d7b-a4cf-82b974e45315 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:06:13.496286 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:13.496286 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:13.496286 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:13.496286 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:13.496286 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:13.496286 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:13.496286 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:13.496286 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:13.496286 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:13.496286 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:13.496286 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:13.496286 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:06:13.496286 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:06:13.496286 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:06:13.497296 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:06:13.497296 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:13.497296 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:13.497296 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:13.497296 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:13.497296 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:13.497296 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:13.497296 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:13.497296 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:13.497296 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:13.497296 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:13.497296 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:13.497296 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:13.497296 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:13.497296 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:13.497296 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:13.497296 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:13.498312 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:06:13.498312 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:06:13.498312 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:06:13.498312 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:06:13.498312 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 655/1283] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:06:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:06:13.504591 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81143bfb-5ee0-4b26-9a0d-d1e97d535614 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:13.628096 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81143bfb-5ee0-4b26-9a0d-d1e97d535614 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:13.662863 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634b40b-1d29-4e76-9592-71cb28e5d994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:13.663644 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634b40b-1d29-4e76-9592-71cb28e5d994 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:13.663926 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634b40b-1d29-4e76-9592-71cb28e5d994 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:13.664195 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634b40b-1d29-4e76-9592-71cb28e5d994 None admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:13.664885 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d634b40b-1d29-4e76-9592-71cb28e5d994 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:13.665192 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d634b40b-1d29-4e76-9592-71cb28e5d994 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:13.666597 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d634b40b-1d29-4e76-9592-71cb28e5d994 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:13.677877 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 629/1284] 10.222.0.60 () {56 vars in 1109 bytes} [Sun Jul 31 01:06:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:13.686180 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106038a-1416-4d7b-a4cf-82b974e45315 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:13.788659 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106038a-1416-4d7b-a4cf-82b974e45315 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:13.801929 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:13.825672 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ddbbe-f537-4b01-955e-bc938ac80cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:13.826267 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ddbbe-f537-4b01-955e-bc938ac80cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:13.826565 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ddbbe-f537-4b01-955e-bc938ac80cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:13.826830 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ddbbe-f537-4b01-955e-bc938ac80cb1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:13.833519 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ddbbe-f537-4b01-955e-bc938ac80cb1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:13.834965 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ddbbe-f537-4b01-955e-bc938ac80cb1 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:13.848007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application [None req-128ddbbe-f537-4b01-955e-bc938ac80cb1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:06:13.848007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:13.848007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:13.848007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:13.848007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:13.848007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:13.848007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:13.848007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:13.848007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:13.848007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:13.848007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:13.848007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:13.848007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:06:13.848007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:06:13.848007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:06:13.849036 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:06:13.849036 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:13.849036 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:13.849036 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:13.849036 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:13.849036 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:13.849036 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:13.849036 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:13.849036 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:13.849036 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:13.849036 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:13.849036 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:13.849036 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:13.849036 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:13.849036 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:13.849036 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:13.849036 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:13.850095 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:06:13.850095 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:06:13.850095 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:06:13.850095 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:06:13.850095 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:06:13.850095 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:06:13.850095 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:06:13.850095 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: ERROR keystone.server.flask.application Jul 31 01:06:13.850095 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 656/1285] 10.222.0.60 () {56 vars in 1111 bytes} [Sun Jul 31 01:06:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:06:13.855463 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634b40b-1d29-4e76-9592-71cb28e5d994 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:13.912815 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:13.964719 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634b40b-1d29-4e76-9592-71cb28e5d994 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:13.999040 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ecf0d2-7be0-4a43-9a4a-f0f9f1d398e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:13.999690 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ecf0d2-7be0-4a43-9a4a-f0f9f1d398e2 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:13.999967 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ecf0d2-7be0-4a43-9a4a-f0f9f1d398e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:14.000234 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ecf0d2-7be0-4a43-9a4a-f0f9f1d398e2 None admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:14.001345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ecf0d2-7be0-4a43-9a4a-f0f9f1d398e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:14.001646 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ecf0d2-7be0-4a43-9a4a-f0f9f1d398e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:14.003074 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ecf0d2-7be0-4a43-9a4a-f0f9f1d398e2 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:14.014895 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 630/1286] 10.222.0.60 () {56 vars in 1148 bytes} [Sun Jul 31 01:06:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:14.021569 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ddbbe-f537-4b01-955e-bc938ac80cb1 None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:14.129587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ddbbe-f537-4b01-955e-bc938ac80cb1 None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:14.166223 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e2474-5747-4739-9cea-1c9078cbc3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:14.166827 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e2474-5747-4739-9cea-1c9078cbc3a1 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:14.167107 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e2474-5747-4739-9cea-1c9078cbc3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:14.167377 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e2474-5747-4739-9cea-1c9078cbc3a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:14.168192 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e2474-5747-4739-9cea-1c9078cbc3a1 None admin] RBAC: Adding query filter params (role.id=fef526a7d2e741ce995d107f3ac934ae, scope.project.id=b931b81a237949aa845891d4bb5aa1c0, user.id=657a3f73879e4b31b70a1c4f73e80f5d) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:14.168495 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e2474-5747-4739-9cea-1c9078cbc3a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:14.169931 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e2474-5747-4739-9cea-1c9078cbc3a1 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:14.175923 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 657/1287] 10.222.0.60 () {56 vars in 1374 bytes} [Sun Jul 31 01:06:14 2022] GET /identity/v3/role_assignments?user.id=657a3f73879e4b31b70a1c4f73e80f5d&scope.project.id=b931b81a237949aa845891d4bb5aa1c0&role.id=fef526a7d2e741ce995d107f3ac934ae => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:06:16.195754 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd5313-ea12-464b-9a4b-c50c4094a5d0 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:16.196645 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd5313-ea12-464b-9a4b-c50c4094a5d0 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:16.196645 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd5313-ea12-464b-9a4b-c50c4094a5d0 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:16.198799 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 631/1288] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:06:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:16.207356 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e8929-d075-440f-a7d0-69d039d1726c None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:16.207810 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e8929-d075-440f-a7d0-69d039d1726c None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:16.207968 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e8929-d075-440f-a7d0-69d039d1726c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:16.228720 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-e58e8929-d075-440f-a7d0-69d039d1726c None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:16.229919 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-e58e8929-d075-440f-a7d0-69d039d1726c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:16.262057 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:16.301023 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 658/1289] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:06:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:06:16.324548 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd5313-ea12-464b-9a4b-c50c4094a5d0 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:16.438446 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd5313-ea12-464b-9a4b-c50c4094a5d0 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:16.449377 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:16.475624 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243cd412-1f52-4409-a65d-1c73874eb49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:16.476260 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243cd412-1f52-4409-a65d-1c73874eb49a None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:16.476539 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243cd412-1f52-4409-a65d-1c73874eb49a None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:16.476809 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243cd412-1f52-4409-a65d-1c73874eb49a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:16.477438 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243cd412-1f52-4409-a65d-1c73874eb49a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:16.478844 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243cd412-1f52-4409-a65d-1c73874eb49a None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:16.487928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-243cd412-1f52-4409-a65d-1c73874eb49a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 31 01:06:16.487928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:16.487928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:06:16.487928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:06:16.487928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:06:16.487928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:06:16.487928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:06:16.487928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:06:16.487928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 31 01:06:16.487928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:06:16.487928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:06:16.487928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:06:16.487928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:16.487928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:16.487928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:16.487928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:16.487928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:16.493505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:16.493505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:16.493505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:16.493505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:16.493505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:16.493505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:16.493505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:06:16.493505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:06:16.493505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:06:16.493505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:06:16.493505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:16.493505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:16.493505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:16.493505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:16.493505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:16.493505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:16.494648 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:16.494648 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:16.494648 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:16.494648 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:16.494648 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:16.494648 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:16.494648 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:16.494648 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:16.494648 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:16.494648 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:16.494648 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:06:16.494648 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:06:16.494648 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 31 01:06:16.494648 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:06:16.494648 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 632/1290] 10.222.0.60 () {56 vars in 1117 bytes} [Sun Jul 31 01:06:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:06:16.495690 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e8929-d075-440f-a7d0-69d039d1726c None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:16.611140 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e8929-d075-440f-a7d0-69d039d1726c None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:16.645453 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ee3bf-60a4-43ab-8f01-cc76e2174311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:16.646055 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ee3bf-60a4-43ab-8f01-cc76e2174311 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:16.646311 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ee3bf-60a4-43ab-8f01-cc76e2174311 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:16.646582 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ee3bf-60a4-43ab-8f01-cc76e2174311 None admin] PATH_INFO: `/v3/services` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:16.647252 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ee3bf-60a4-43ab-8f01-cc76e2174311 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:16.647573 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ee3bf-60a4-43ab-8f01-cc76e2174311 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:16.648957 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ee3bf-60a4-43ab-8f01-cc76e2174311 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:16.653712 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 659/1291] 10.222.0.60 () {56 vars in 1116 bytes} [Sun Jul 31 01:06:16 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:16.660329 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243cd412-1f52-4409-a65d-1c73874eb49a None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:16.771330 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243cd412-1f52-4409-a65d-1c73874eb49a None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:16.809378 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d8c53-916b-410e-a301-eeac83a187f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:16.809988 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d8c53-916b-410e-a301-eeac83a187f2 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:16.810265 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d8c53-916b-410e-a301-eeac83a187f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:16.810536 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d8c53-916b-410e-a301-eeac83a187f2 None admin] PATH_INFO: `/v3/services` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:16.811210 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d8c53-916b-410e-a301-eeac83a187f2 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:16.811528 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d8c53-916b-410e-a301-eeac83a187f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:16.812899 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d8c53-916b-410e-a301-eeac83a187f2 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:16.818024 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 633/1292] 10.222.0.60 () {56 vars in 1116 bytes} [Sun Jul 31 01:06:16 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:18.819526 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb84af6-6d5a-4a56-9eb5-449eaec6011b None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:18.820154 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb84af6-6d5a-4a56-9eb5-449eaec6011b None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:18.820154 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb84af6-6d5a-4a56-9eb5-449eaec6011b None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:18.821494 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 660/1293] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:18.828050 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ca86f-67d3-4475-a12a-6caa3261dc81 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:18.828849 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ca86f-67d3-4475-a12a-6caa3261dc81 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:18.829016 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ca86f-67d3-4475-a12a-6caa3261dc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:18.856126 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-655ca86f-67d3-4475-a12a-6caa3261dc81 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:18.857317 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-655ca86f-67d3-4475-a12a-6caa3261dc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:18.890311 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:18.939328 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 634/1294] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:06:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:06:18.962042 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb84af6-6d5a-4a56-9eb5-449eaec6011b None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:18.996598 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:19.086078 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb84af6-6d5a-4a56-9eb5-449eaec6011b None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:19.123881 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100080e9-b685-47fe-9c55-300e1e8633e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:19.124445 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100080e9-b685-47fe-9c55-300e1e8633e2 None admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:19.124781 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100080e9-b685-47fe-9c55-300e1e8633e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:19.124984 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100080e9-b685-47fe-9c55-300e1e8633e2 None admin] PATH_INFO: `/v3/services` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:19.126030 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100080e9-b685-47fe-9c55-300e1e8633e2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:19.127395 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100080e9-b685-47fe-9c55-300e1e8633e2 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:19.143314 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 661/1295] 10.222.0.60 () {60 vars in 1141 bytes} [Sun Jul 31 01:06:18 2022] POST /identity/v3/services => generated 246 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:06:21.114091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e17dd-ecbb-48bf-9d56-89e36c34a4b1 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:21.114984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e17dd-ecbb-48bf-9d56-89e36c34a4b1 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:21.114984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e17dd-ecbb-48bf-9d56-89e36c34a4b1 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:21.117088 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 635/1296] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:06:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:21.126098 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3eddb7-9b56-46f7-ae45-a27cbe85e07b None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:21.126512 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3eddb7-9b56-46f7-ae45-a27cbe85e07b None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:21.126669 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3eddb7-9b56-46f7-ae45-a27cbe85e07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:21.148749 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-3c3eddb7-9b56-46f7-ae45-a27cbe85e07b None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:21.149924 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-3c3eddb7-9b56-46f7-ae45-a27cbe85e07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:21.225275 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 662/1297] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:06:21 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:06:21.247748 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e17dd-ecbb-48bf-9d56-89e36c34a4b1 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:21.363748 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e17dd-ecbb-48bf-9d56-89e36c34a4b1 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:21.401753 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7dfe1-9bfc-44f1-8fe2-4d1aa0cd6755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:21.402413 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7dfe1-9bfc-44f1-8fe2-4d1aa0cd6755 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:21.402686 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7dfe1-9bfc-44f1-8fe2-4d1aa0cd6755 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:21.402951 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7dfe1-9bfc-44f1-8fe2-4d1aa0cd6755 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:21.403610 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d7dfe1-9bfc-44f1-8fe2-4d1aa0cd6755 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:21.404968 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d7dfe1-9bfc-44f1-8fe2-4d1aa0cd6755 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:21.418432 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-19d7dfe1-9bfc-44f1-8fe2-4d1aa0cd6755 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 31 01:06:21.418432 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:21.418432 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:06:21.418432 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:06:21.418432 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:06:21.418432 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:06:21.418432 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:06:21.418432 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:06:21.418432 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 31 01:06:21.418432 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:06:21.418432 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:06:21.418432 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:06:21.418432 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:21.418432 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:21.418432 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:21.418432 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:21.418432 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:21.419582 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:21.419582 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:21.419582 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:21.419582 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:21.419582 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:21.419582 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:21.419582 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:06:21.419582 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:06:21.419582 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:06:21.419582 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:06:21.419582 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:21.419582 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:21.419582 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:21.419582 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:21.419582 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:21.419582 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:21.420912 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:21.420912 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:21.420912 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:21.420912 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:21.420912 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:21.420912 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:21.420912 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:21.420912 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:21.420912 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:21.420912 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:21.420912 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:06:21.420912 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:06:21.420912 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 31 01:06:21.420912 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:06:21.420912 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 636/1298] 10.222.0.60 () {56 vars in 1117 bytes} [Sun Jul 31 01:06:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:06:21.426510 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3eddb7-9b56-46f7-ae45-a27cbe85e07b None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:21.447414 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:21.530054 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3eddb7-9b56-46f7-ae45-a27cbe85e07b None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:21.564422 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5d6e9-ff16-42be-bfa8-6ab0b8504b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:21.565065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5d6e9-ff16-42be-bfa8-6ab0b8504b5e None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:21.565336 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5d6e9-ff16-42be-bfa8-6ab0b8504b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:21.565602 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5d6e9-ff16-42be-bfa8-6ab0b8504b5e None admin] PATH_INFO: `/v3/services` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:21.566266 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5d6e9-ff16-42be-bfa8-6ab0b8504b5e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:21.566564 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5d6e9-ff16-42be-bfa8-6ab0b8504b5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:21.567963 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5d6e9-ff16-42be-bfa8-6ab0b8504b5e None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:21.573085 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 663/1299] 10.222.0.60 () {56 vars in 1116 bytes} [Sun Jul 31 01:06:21 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:21.582309 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7dfe1-9bfc-44f1-8fe2-4d1aa0cd6755 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:21.615519 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:21.687922 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7dfe1-9bfc-44f1-8fe2-4d1aa0cd6755 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:21.722518 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800be4b-6638-4aed-9438-85c3c9ea44af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:21.723119 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800be4b-6638-4aed-9438-85c3c9ea44af None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:21.723389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800be4b-6638-4aed-9438-85c3c9ea44af None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:21.723691 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800be4b-6638-4aed-9438-85c3c9ea44af None admin] PATH_INFO: `/v3/endpoints` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:21.724447 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a800be4b-6638-4aed-9438-85c3c9ea44af None admin] RBAC: Adding query filter params (interface=public, service_id=1101dc77027349f6b1dcbe13eea94783, region_id=RegionOne) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:21.724748 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a800be4b-6638-4aed-9438-85c3c9ea44af None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:21.726099 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a800be4b-6638-4aed-9438-85c3c9ea44af None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:21.731262 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 637/1300] 10.222.0.60 () {56 vars in 1251 bytes} [Sun Jul 31 01:06:21 2022] GET /identity/v3/endpoints?service_id=1101dc77027349f6b1dcbe13eea94783&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:21.739559 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5d6e9-ff16-42be-bfa8-6ab0b8504b5e None admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:21.835466 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:21.854533 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5d6e9-ff16-42be-bfa8-6ab0b8504b5e None admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:21.890099 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c557a4-d05b-4319-88df-326d6a858d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:21.890710 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c557a4-d05b-4319-88df-326d6a858d54 None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:21.890988 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c557a4-d05b-4319-88df-326d6a858d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:21.891263 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c557a4-d05b-4319-88df-326d6a858d54 None admin] PATH_INFO: `/v3/services` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:21.891945 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c557a4-d05b-4319-88df-326d6a858d54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:21.893326 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c557a4-d05b-4319-88df-326d6a858d54 None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:21.900265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 664/1301] 10.222.0.60 () {56 vars in 1087 bytes} [Sun Jul 31 01:06:21 2022] GET /identity/v3/services => generated 2191 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:06:23.892736 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f10d78-236f-460d-9db7-d74d6a449095 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:23.893659 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f10d78-236f-460d-9db7-d74d6a449095 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:23.893659 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f10d78-236f-460d-9db7-d74d6a449095 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:23.895840 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 638/1302] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:06:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:23.901279 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b628dbb-4ceb-42c3-825b-24802e0a235a None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:23.901794 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b628dbb-4ceb-42c3-825b-24802e0a235a None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:23.901896 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b628dbb-4ceb-42c3-825b-24802e0a235a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:23.921141 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-3b628dbb-4ceb-42c3-825b-24802e0a235a None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:23.922309 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-3b628dbb-4ceb-42c3-825b-24802e0a235a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:23.994932 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 665/1303] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:06:23 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:06:24.018352 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f10d78-236f-460d-9db7-d74d6a449095 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:24.138840 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:24.146581 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f10d78-236f-460d-9db7-d74d6a449095 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:24.182335 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e3954-f3e1-49ea-9833-5b0e77656844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:24.182977 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e3954-f3e1-49ea-9833-5b0e77656844 None admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:24.183251 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e3954-f3e1-49ea-9833-5b0e77656844 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:24.183534 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e3954-f3e1-49ea-9833-5b0e77656844 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:24.184169 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e3954-f3e1-49ea-9833-5b0e77656844 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:24.185525 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e3954-f3e1-49ea-9833-5b0e77656844 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:24.194678 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application [None req-842e3954-f3e1-49ea-9833-5b0e77656844 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 31 01:06:24.194678 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:24.194678 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:06:24.194678 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:06:24.194678 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:06:24.194678 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:06:24.194678 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:06:24.194678 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:06:24.194678 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 31 01:06:24.194678 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:06:24.194678 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:06:24.194678 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:06:24.194678 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:24.194678 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:24.194678 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:24.194678 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:24.194678 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:24.195817 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:24.195817 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:24.195817 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:24.195817 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:24.195817 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:24.195817 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:24.195817 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:06:24.195817 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:06:24.195817 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:06:24.195817 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:06:24.195817 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:24.195817 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:24.195817 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:24.195817 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:24.195817 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:24.195817 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:24.196745 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:24.196745 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:24.196745 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:24.196745 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:24.196745 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:24.196745 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:24.196745 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:24.196745 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:24.196745 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:24.196745 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:24.196745 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:06:24.196745 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:06:24.196745 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 31 01:06:24.196745 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: ERROR keystone.server.flask.application Jul 31 01:06:24.196745 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 639/1304] 10.222.0.60 () {56 vars in 1117 bytes} [Sun Jul 31 01:06:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:06:24.202869 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b628dbb-4ceb-42c3-825b-24802e0a235a None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:24.292943 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:24.316530 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b628dbb-4ceb-42c3-825b-24802e0a235a None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:24.351129 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8e977-92af-466b-8087-59639797ad6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:24.351773 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8e977-92af-466b-8087-59639797ad6b None admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:24.352022 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8e977-92af-466b-8087-59639797ad6b None admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:24.352300 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8e977-92af-466b-8087-59639797ad6b None admin] PATH_INFO: `/v3/services` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:24.353060 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d8e977-92af-466b-8087-59639797ad6b None admin] RBAC: Adding query filter params (name=placement) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:24.353355 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d8e977-92af-466b-8087-59639797ad6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:24.354719 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d8e977-92af-466b-8087-59639797ad6b None admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:24.361159 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 666/1305] 10.222.0.60 () {56 vars in 1116 bytes} [Sun Jul 31 01:06:24 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:24.368726 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e3954-f3e1-49ea-9833-5b0e77656844 None admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:24.477334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e3954-f3e1-49ea-9833-5b0e77656844 None admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:24.513076 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07d3cf-b17e-4b5d-bc6d-e82f0ac86cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:24.513699 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07d3cf-b17e-4b5d-bc6d-e82f0ac86cb5 None admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:24.514008 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07d3cf-b17e-4b5d-bc6d-e82f0ac86cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:24.514312 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07d3cf-b17e-4b5d-bc6d-e82f0ac86cb5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:24.515052 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c07d3cf-b17e-4b5d-bc6d-e82f0ac86cb5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:24.516487 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c07d3cf-b17e-4b5d-bc6d-e82f0ac86cb5 None admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:24.540806 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 640/1306] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:06:24 2022] POST /identity/v3/endpoints => generated 331 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:06:34.357099 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=30 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:34.535654 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:27.912246 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d9247-697e-4479-9598-64f90804a981 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:27.913367 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d9247-697e-4479-9598-64f90804a981 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:27.913862 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d9247-697e-4479-9598-64f90804a981 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:27.920106 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 667/1307] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:07:27 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:07:27.921481 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0115f91-d086-40e9-a86b-a802e70e421d None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:27.921950 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0115f91-d086-40e9-a86b-a802e70e421d None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:27.922030 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0115f91-d086-40e9-a86b-a802e70e421d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:28.117857 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-f0115f91-d086-40e9-a86b-a802e70e421d None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:07:28.119573 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-f0115f91-d086-40e9-a86b-a802e70e421d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:28.352211 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 641/1308] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:07:28.395903 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876e524-b68d-4b71-9ee7-f92c1e362084 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:28.396366 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876e524-b68d-4b71-9ee7-f92c1e362084 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:28.396710 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876e524-b68d-4b71-9ee7-f92c1e362084 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:28.398470 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 668/1309] 10.222.0.60 () {54 vars in 965 bytes} [Sun Jul 31 01:07:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:07:28.409618 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5791e0-a016-4ace-9dad-c37dffba873d None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:28.409913 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5791e0-a016-4ace-9dad-c37dffba873d None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:28.410195 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5791e0-a016-4ace-9dad-c37dffba873d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:28.531592 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-ee5791e0-a016-4ace-9dad-c37dffba873d None None] MFA Rules not processed for user `81117154f6d1474c805a69c5617c307d`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:07:28.532817 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-ee5791e0-a016-4ace-9dad-c37dffba873d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:28.564735 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:28.682734 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876e524-b68d-4b71-9ee7-f92c1e362084 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:07:28.684533 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-4876e524-b68d-4b71-9ee7-f92c1e362084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:28.693180 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 642/1310] 10.222.0.60 () {58 vars in 1062 bytes} [Sun Jul 31 01:07:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:07:28.827434 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876e524-b68d-4b71-9ee7-f92c1e362084 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:07:28.913978 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba523e3f-35f6-4c80-a3f5-fc6ea6c9fa3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:07:28.914763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba523e3f-35f6-4c80-a3f5-fc6ea6c9fa3d service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:28.915145 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba523e3f-35f6-4c80-a3f5-fc6ea6c9fa3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:28.915569 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba523e3f-35f6-4c80-a3f5-fc6ea6c9fa3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:28.917313 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-ba523e3f-35f6-4c80-a3f5-fc6ea6c9fa3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:28.978854 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:29.037724 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba523e3f-35f6-4c80-a3f5-fc6ea6c9fa3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:07:29.039359 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba523e3f-35f6-4c80-a3f5-fc6ea6c9fa3d service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:07:29.060392 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 669/1311] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:07:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:07:31.380309 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b6653-6cc8-49d4-b19e-813fda65ead4 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:31.380828 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b6653-6cc8-49d4-b19e-813fda65ead4 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:31.380922 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b6653-6cc8-49d4-b19e-813fda65ead4 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:31.382247 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 643/1312] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:07:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:07:31.387700 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd21d1-7543-4210-ae5b-67d464acc170 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:31.388145 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd21d1-7543-4210-ae5b-67d464acc170 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:31.388246 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd21d1-7543-4210-ae5b-67d464acc170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:31.467697 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-fddd21d1-7543-4210-ae5b-67d464acc170 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:07:31.468950 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-fddd21d1-7543-4210-ae5b-67d464acc170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:31.574061 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 670/1313] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:07:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:07:31.619026 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b6653-6cc8-49d4-b19e-813fda65ead4 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:07:31.620743 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-381b6653-6cc8-49d4-b19e-813fda65ead4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:31.730744 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b6653-6cc8-49d4-b19e-813fda65ead4 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:07:31.805574 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:31.808467 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34b1e4-2ca2-4e56-884f-93eaac8bf9af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:07:31.809100 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34b1e4-2ca2-4e56-884f-93eaac8bf9af service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:31.809380 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34b1e4-2ca2-4e56-884f-93eaac8bf9af service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:31.809649 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34b1e4-2ca2-4e56-884f-93eaac8bf9af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:31.812160 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-ae34b1e4-2ca2-4e56-884f-93eaac8bf9af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:31.929103 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34b1e4-2ca2-4e56-884f-93eaac8bf9af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:07:31.930762 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34b1e4-2ca2-4e56-884f-93eaac8bf9af service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:07:31.949422 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 644/1314] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:07:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:07:34.273607 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb7523-d9a1-4268-87e0-b2cdd10ab136 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:34.274469 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb7523-d9a1-4268-87e0-b2cdd10ab136 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:34.274724 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb7523-d9a1-4268-87e0-b2cdd10ab136 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:34.276201 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 671/1315] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:07:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:07:34.282004 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549726c-a01a-421a-91c5-31887d5f2ef0 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:34.282447 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549726c-a01a-421a-91c5-31887d5f2ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:34.282561 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549726c-a01a-421a-91c5-31887d5f2ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:34.358363 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-2549726c-a01a-421a-91c5-31887d5f2ef0 None None] MFA Rules not processed for user `dbf5aa0cc934479191a679aa5d44ed32`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:07:34.359570 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-2549726c-a01a-421a-91c5-31887d5f2ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:34.421357 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:34.471222 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 645/1316] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:07:34 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:07:34.515891 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb7523-d9a1-4268-87e0-b2cdd10ab136 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:07:34.517458 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-f3bb7523-d9a1-4268-87e0-b2cdd10ab136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:34.528223 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:34.633650 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb7523-d9a1-4268-87e0-b2cdd10ab136 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:07:34.713163 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce861c-f9b6-4810-842e-d98b49ed067a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:07:34.716541 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce861c-f9b6-4810-842e-d98b49ed067a service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:34.716818 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce861c-f9b6-4810-842e-d98b49ed067a service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:34.717095 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce861c-f9b6-4810-842e-d98b49ed067a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:34.718779 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-30ce861c-f9b6-4810-842e-d98b49ed067a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:34.784617 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:34.832199 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce861c-f9b6-4810-842e-d98b49ed067a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:07:34.833648 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce861c-f9b6-4810-842e-d98b49ed067a service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:07:34.851873 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 672/1317] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:07:34 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:07:37.381033 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ac204-6c12-42a8-81a3-c528c04a740b None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:37.381575 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ac204-6c12-42a8-81a3-c528c04a740b None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:37.381575 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ac204-6c12-42a8-81a3-c528c04a740b None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:37.382975 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 646/1318] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:07:37.389169 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30ac1f-e13d-4e93-9846-d3153be6c03c None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:37.389656 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30ac1f-e13d-4e93-9846-d3153be6c03c None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:37.389759 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30ac1f-e13d-4e93-9846-d3153be6c03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:37.464851 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-8b30ac1f-e13d-4e93-9846-d3153be6c03c None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:07:37.466063 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-8b30ac1f-e13d-4e93-9846-d3153be6c03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:37.574253 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 673/1319] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:07:37 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:07:37.638026 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7eae1-bb82-431b-9c92-7835e4d000be None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:37.638318 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7eae1-bb82-431b-9c92-7835e4d000be None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:37.638585 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7eae1-bb82-431b-9c92-7835e4d000be None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:37.640030 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 647/1320] 10.222.0.60 () {54 vars in 965 bytes} [Sun Jul 31 01:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:07:37.646659 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4468956-2712-4a5c-92eb-619a54a98bd0 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:37.647047 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4468956-2712-4a5c-92eb-619a54a98bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:37.647400 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4468956-2712-4a5c-92eb-619a54a98bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:37.676687 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:37.736427 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-b4468956-2712-4a5c-92eb-619a54a98bd0 None None] MFA Rules not processed for user `81117154f6d1474c805a69c5617c307d`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:07:37.737648 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-b4468956-2712-4a5c-92eb-619a54a98bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:37.814769 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 674/1321] 10.222.0.60 () {58 vars in 1062 bytes} [Sun Jul 31 01:07:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:07:37.824245 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7eae1-bb82-431b-9c92-7835e4d000be None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:07:37.825796 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-1fd7eae1-bb82-431b-9c92-7835e4d000be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:37.943541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7eae1-bb82-431b-9c92-7835e4d000be None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:07:38.027403 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd28342e-802e-4290-b7ac-9d666dfe0eaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:07:38.028068 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28342e-802e-4290-b7ac-9d666dfe0eaf service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:38.028345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28342e-802e-4290-b7ac-9d666dfe0eaf service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:38.028618 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28342e-802e-4290-b7ac-9d666dfe0eaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:38.030259 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-fd28342e-802e-4290-b7ac-9d666dfe0eaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:38.038335 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:38.156015 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd28342e-802e-4290-b7ac-9d666dfe0eaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:07:38.157463 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd28342e-802e-4290-b7ac-9d666dfe0eaf service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:07:38.177845 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 648/1322] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:07:37 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:07:41.297355 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8210863-0e22-4d5c-85c7-feb225cd3f42 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:41.297937 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8210863-0e22-4d5c-85c7-feb225cd3f42 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:41.297937 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8210863-0e22-4d5c-85c7-feb225cd3f42 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:41.299232 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 675/1323] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:07:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:07:41.304489 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f71ad3-fb0a-489d-a72d-e7b57d2ff1ef None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:41.305010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f71ad3-fb0a-489d-a72d-e7b57d2ff1ef None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:41.305010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f71ad3-fb0a-489d-a72d-e7b57d2ff1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:41.376734 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-00f71ad3-fb0a-489d-a72d-e7b57d2ff1ef None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:07:41.378024 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-00f71ad3-fb0a-489d-a72d-e7b57d2ff1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:41.439302 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:41.484759 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 649/1324] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:07:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:07:41.521792 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8210863-0e22-4d5c-85c7-feb225cd3f42 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:07:41.523340 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-e8210863-0e22-4d5c-85c7-feb225cd3f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:41.636865 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8210863-0e22-4d5c-85c7-feb225cd3f42 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:07:41.650862 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:41.715285 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab2e67-d725-428c-a8d1-1bc41950ea82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:07:41.715943 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab2e67-d725-428c-a8d1-1bc41950ea82 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:41.716230 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab2e67-d725-428c-a8d1-1bc41950ea82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:41.716489 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab2e67-d725-428c-a8d1-1bc41950ea82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:41.718150 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-09ab2e67-d725-428c-a8d1-1bc41950ea82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:41.828467 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ab2e67-d725-428c-a8d1-1bc41950ea82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:07:41.829900 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ab2e67-d725-428c-a8d1-1bc41950ea82 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:07:41.848729 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 676/1325] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:07:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:07:43.924584 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d0c2f-c64a-4e9a-b065-a22a7f796b2a None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:43.925120 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d0c2f-c64a-4e9a-b065-a22a7f796b2a None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:43.925120 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d0c2f-c64a-4e9a-b065-a22a7f796b2a None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:43.926574 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 650/1326] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:07:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:07:43.931952 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4591a7-37ef-4ff9-b003-9cee6780d724 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:43.932424 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4591a7-37ef-4ff9-b003-9cee6780d724 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:43.932662 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4591a7-37ef-4ff9-b003-9cee6780d724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:43.983654 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:44.002570 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-ef4591a7-37ef-4ff9-b003-9cee6780d724 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:07:44.003824 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-ef4591a7-37ef-4ff9-b003-9cee6780d724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:44.101539 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 677/1327] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:07:44.139094 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d0c2f-c64a-4e9a-b065-a22a7f796b2a None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:07:44.140690 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-718d0c2f-c64a-4e9a-b065-a22a7f796b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:44.244444 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d0c2f-c64a-4e9a-b065-a22a7f796b2a None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:07:44.331581 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1031b-8a68-4fc7-81fd-4ca01fc200f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:07:44.332233 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1031b-8a68-4fc7-81fd-4ca01fc200f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:44.332509 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1031b-8a68-4fc7-81fd-4ca01fc200f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:44.332782 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1031b-8a68-4fc7-81fd-4ca01fc200f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:44.334520 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-5ed1031b-8a68-4fc7-81fd-4ca01fc200f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:44.353331 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:44.455467 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed1031b-8a68-4fc7-81fd-4ca01fc200f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:07:44.456950 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed1031b-8a68-4fc7-81fd-4ca01fc200f7 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:07:44.475385 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 651/1328] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:07:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:07:46.536360 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81940abc-c9cf-4308-b07a-a158a4af2a3a None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:46.536966 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81940abc-c9cf-4308-b07a-a158a4af2a3a None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:46.536966 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81940abc-c9cf-4308-b07a-a158a4af2a3a None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:46.538274 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 678/1329] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:07:46.543738 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29feacd4-e270-4e10-9cf0-311ad62f1398 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:46.544191 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29feacd4-e270-4e10-9cf0-311ad62f1398 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:46.544421 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29feacd4-e270-4e10-9cf0-311ad62f1398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:46.616607 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-29feacd4-e270-4e10-9cf0-311ad62f1398 None None] MFA Rules not processed for user `dbf5aa0cc934479191a679aa5d44ed32`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:07:46.618030 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-29feacd4-e270-4e10-9cf0-311ad62f1398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:46.688045 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:46.723900 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 652/1330] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:07:46 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:07:46.761588 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81940abc-c9cf-4308-b07a-a158a4af2a3a None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:07:46.763165 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-81940abc-c9cf-4308-b07a-a158a4af2a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:46.873045 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81940abc-c9cf-4308-b07a-a158a4af2a3a None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:07:46.895094 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:46.952220 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715394b5-ce54-44ad-b87f-f366ea75a8ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:07:46.952907 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715394b5-ce54-44ad-b87f-f366ea75a8ca service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:46.953373 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715394b5-ce54-44ad-b87f-f366ea75a8ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:46.953849 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715394b5-ce54-44ad-b87f-f366ea75a8ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:46.955524 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-715394b5-ce54-44ad-b87f-f366ea75a8ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:47.075019 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715394b5-ce54-44ad-b87f-f366ea75a8ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:07:47.076537 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715394b5-ce54-44ad-b87f-f366ea75a8ca service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:07:47.098019 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 679/1331] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:07:46 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:07:49.337009 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfc534-b454-4090-a5ae-9e22592e7aac None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:49.337673 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfc534-b454-4090-a5ae-9e22592e7aac None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:49.337673 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfc534-b454-4090-a5ae-9e22592e7aac None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:49.339266 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 653/1332] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:07:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:07:49.344852 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c5311e-aa03-4c11-a9eb-950c855376e4 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:49.345301 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c5311e-aa03-4c11-a9eb-950c855376e4 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:49.345394 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c5311e-aa03-4c11-a9eb-950c855376e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:49.410593 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:49.413551 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-f4c5311e-aa03-4c11-a9eb-950c855376e4 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:07:49.415725 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-f4c5311e-aa03-4c11-a9eb-950c855376e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:49.520924 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 680/1333] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:07:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:07:49.559611 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcfc534-b454-4090-a5ae-9e22592e7aac None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:07:49.561176 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-8fcfc534-b454-4090-a5ae-9e22592e7aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:49.683070 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcfc534-b454-4090-a5ae-9e22592e7aac None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:07:49.757454 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19d5f5-d383-4b55-8227-7e8e3258ee5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:07:49.758156 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19d5f5-d383-4b55-8227-7e8e3258ee5d service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:49.758526 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19d5f5-d383-4b55-8227-7e8e3258ee5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:49.758692 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19d5f5-d383-4b55-8227-7e8e3258ee5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:49.760359 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-3e19d5f5-d383-4b55-8227-7e8e3258ee5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:49.786899 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:49.876982 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e19d5f5-d383-4b55-8227-7e8e3258ee5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:07:49.878455 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e19d5f5-d383-4b55-8227-7e8e3258ee5d service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:07:49.897225 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 654/1334] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:07:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:07:51.968476 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c00a6b-2ad5-4078-bb58-e697dcc2a043 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:51.969353 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c00a6b-2ad5-4078-bb58-e697dcc2a043 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:51.969353 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c00a6b-2ad5-4078-bb58-e697dcc2a043 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:51.971700 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 681/1335] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:07:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:07:51.977775 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee697d-25f2-4705-9fcb-13fb0ee180df None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:51.978217 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee697d-25f2-4705-9fcb-13fb0ee180df None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:51.978316 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee697d-25f2-4705-9fcb-13fb0ee180df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:52.055410 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-7bee697d-25f2-4705-9fcb-13fb0ee180df None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:07:52.057306 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-7bee697d-25f2-4705-9fcb-13fb0ee180df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:52.142707 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:52.168597 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 655/1336] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:07:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:07:52.210791 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c00a6b-2ad5-4078-bb58-e697dcc2a043 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:07:52.212475 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-a1c00a6b-2ad5-4078-bb58-e697dcc2a043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:52.318395 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c00a6b-2ad5-4078-bb58-e697dcc2a043 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:07:52.348294 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:52.403578 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475c5fc-35df-472b-b8a7-4080ccd452a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:07:52.404169 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475c5fc-35df-472b-b8a7-4080ccd452a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:52.404444 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475c5fc-35df-472b-b8a7-4080ccd452a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:52.404706 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475c5fc-35df-472b-b8a7-4080ccd452a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:52.406345 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-d475c5fc-35df-472b-b8a7-4080ccd452a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:52.525069 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475c5fc-35df-472b-b8a7-4080ccd452a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:07:52.526516 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475c5fc-35df-472b-b8a7-4080ccd452a4 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:07:52.544733 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 682/1337] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:07:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:07:55.010939 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4faf9b-d22e-4d2a-a974-7a0ae4b1948b None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:55.011554 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4faf9b-d22e-4d2a-a974-7a0ae4b1948b None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:55.011554 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4faf9b-d22e-4d2a-a974-7a0ae4b1948b None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:55.013135 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 656/1338] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:07:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:07:55.018644 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f1c23-acae-4c66-9f62-54dbc62b0647 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:55.019126 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f1c23-acae-4c66-9f62-54dbc62b0647 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:55.019126 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f1c23-acae-4c66-9f62-54dbc62b0647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:55.094791 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-b26f1c23-acae-4c66-9f62-54dbc62b0647 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:07:55.096042 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-b26f1c23-acae-4c66-9f62-54dbc62b0647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:55.105059 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:55.205898 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 683/1339] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:07:55 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:07:55.245466 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4faf9b-d22e-4d2a-a974-7a0ae4b1948b None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:07:55.247994 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-8d4faf9b-d22e-4d2a-a974-7a0ae4b1948b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:55.376096 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4faf9b-d22e-4d2a-a974-7a0ae4b1948b None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:07:55.458701 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0f0f3-7c83-4e5c-9edd-31168060af88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:07:55.459318 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0f0f3-7c83-4e5c-9edd-31168060af88 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:55.459624 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0f0f3-7c83-4e5c-9edd-31168060af88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:55.459881 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0f0f3-7c83-4e5c-9edd-31168060af88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:55.461527 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-f0a0f0f3-7c83-4e5c-9edd-31168060af88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:55.498219 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:55.578489 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a0f0f3-7c83-4e5c-9edd-31168060af88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:07:55.579966 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a0f0f3-7c83-4e5c-9edd-31168060af88 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:07:55.599961 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 657/1340] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:07:55 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:07:59.595921 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b157a8-3eb1-491f-8bf3-e8a5ce3c2d62 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:59.596466 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b157a8-3eb1-491f-8bf3-e8a5ce3c2d62 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:59.596466 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b157a8-3eb1-491f-8bf3-e8a5ce3c2d62 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:59.597716 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 684/1341] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:07:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:07:59.603109 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd0bb3-95aa-4372-9eca-fe4a9bbffaab None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:59.603581 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd0bb3-95aa-4372-9eca-fe4a9bbffaab None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:59.603686 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd0bb3-95aa-4372-9eca-fe4a9bbffaab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:59.671095 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-94dd0bb3-95aa-4372-9eca-fe4a9bbffaab None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:07:59.672333 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-94dd0bb3-95aa-4372-9eca-fe4a9bbffaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:59.760449 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:59.772026 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 658/1342] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:07:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:07:59.811367 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b157a8-3eb1-491f-8bf3-e8a5ce3c2d62 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:07:59.813867 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-c4b157a8-3eb1-491f-8bf3-e8a5ce3c2d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:59.930124 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b157a8-3eb1-491f-8bf3-e8a5ce3c2d62 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:07:59.967757 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:00.006351 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a552f95d-ec19-4965-8e86-a435b75c3f11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:00.006979 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552f95d-ec19-4965-8e86-a435b75c3f11 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:00.007257 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552f95d-ec19-4965-8e86-a435b75c3f11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:00.007533 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552f95d-ec19-4965-8e86-a435b75c3f11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:00.009362 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-a552f95d-ec19-4965-8e86-a435b75c3f11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:00.124151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a552f95d-ec19-4965-8e86-a435b75c3f11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:00.125951 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a552f95d-ec19-4965-8e86-a435b75c3f11 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:00.144521 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 685/1343] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:07:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:08:02.693354 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb88066-6caa-49b2-81ce-a72aac2bd627 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:02.693921 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb88066-6caa-49b2-81ce-a72aac2bd627 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:02.693921 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb88066-6caa-49b2-81ce-a72aac2bd627 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:02.695326 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 659/1344] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:08:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:08:02.701452 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8a3a7-3818-43ec-bdd1-c3281346e3a9 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:02.702034 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8a3a7-3818-43ec-bdd1-c3281346e3a9 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:02.702034 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8a3a7-3818-43ec-bdd1-c3281346e3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:02.772511 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-5eb8a3a7-3818-43ec-bdd1-c3281346e3a9 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:08:02.773828 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-5eb8a3a7-3818-43ec-bdd1-c3281346e3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:02.794247 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:02.878683 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 686/1345] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:08:02 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:08:02.916060 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb88066-6caa-49b2-81ce-a72aac2bd627 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:02.918091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-beb88066-6caa-49b2-81ce-a72aac2bd627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:03.025216 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb88066-6caa-49b2-81ce-a72aac2bd627 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:03.108749 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f415ac6-8d94-4679-b0be-1db16f6c7722 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:03.109346 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f415ac6-8d94-4679-b0be-1db16f6c7722 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:03.109751 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f415ac6-8d94-4679-b0be-1db16f6c7722 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:03.110036 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f415ac6-8d94-4679-b0be-1db16f6c7722 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:03.112023 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-3f415ac6-8d94-4679-b0be-1db16f6c7722 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:03.155994 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:03.228900 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f415ac6-8d94-4679-b0be-1db16f6c7722 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:03.230354 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f415ac6-8d94-4679-b0be-1db16f6c7722 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:03.249605 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 660/1346] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:08:02 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:08:07.260592 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6d2ed-1ff2-4c5f-878c-f7162a9aed8c None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:07.261188 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6d2ed-1ff2-4c5f-878c-f7162a9aed8c None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:07.261188 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6d2ed-1ff2-4c5f-878c-f7162a9aed8c None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:07.262717 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 687/1347] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:08:07.268309 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88611b60-5814-4e7b-91b2-df719a4645cb None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:07.268744 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88611b60-5814-4e7b-91b2-df719a4645cb None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:07.268910 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88611b60-5814-4e7b-91b2-df719a4645cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:07.338379 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-88611b60-5814-4e7b-91b2-df719a4645cb None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:08:07.339647 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-88611b60-5814-4e7b-91b2-df719a4645cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:07.439882 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:07.442590 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 661/1348] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:08:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:08:07.482819 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6d2ed-1ff2-4c5f-878c-f7162a9aed8c None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:07.484395 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-72d6d2ed-1ff2-4c5f-878c-f7162a9aed8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:07.612568 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6d2ed-1ff2-4c5f-878c-f7162a9aed8c None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:07.667730 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:07.695568 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60aea3f-6985-4f05-9285-893b1330fdcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:07.696226 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60aea3f-6985-4f05-9285-893b1330fdcd service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:07.696501 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60aea3f-6985-4f05-9285-893b1330fdcd service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:07.696768 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60aea3f-6985-4f05-9285-893b1330fdcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:07.698403 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-e60aea3f-6985-4f05-9285-893b1330fdcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:07.819321 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60aea3f-6985-4f05-9285-893b1330fdcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:07.820991 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60aea3f-6985-4f05-9285-893b1330fdcd service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:07.839419 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 688/1349] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:08:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:08:12.795624 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf47d4-bf50-4111-8342-2af0c1541c34 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:12.796461 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf47d4-bf50-4111-8342-2af0c1541c34 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:12.796872 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf47d4-bf50-4111-8342-2af0c1541c34 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:12.798705 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 662/1350] 10.222.0.60 () {54 vars in 921 bytes} [Sun Jul 31 01:08:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:08:12.803829 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18553a-a2a9-4859-a543-f6821232bf26 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:12.804610 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18553a-a2a9-4859-a543-f6821232bf26 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:12.805034 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18553a-a2a9-4859-a543-f6821232bf26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:12.927961 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-fa18553a-a2a9-4859-a543-f6821232bf26 None None] MFA Rules not processed for user `657a3f73879e4b31b70a1c4f73e80f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:08:12.929414 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-fa18553a-a2a9-4859-a543-f6821232bf26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:12.949412 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:13.045013 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 689/1351] 10.222.0.60 () {58 vars in 1018 bytes} [Sun Jul 31 01:08:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:08:17.220061 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e3d3f-cb3f-4154-a0b5-51502b73b031 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:17.220474 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e3d3f-cb3f-4154-a0b5-51502b73b031 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:17.220739 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e3d3f-cb3f-4154-a0b5-51502b73b031 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:17.222253 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 663/1352] 10.222.0.60 () {54 vars in 921 bytes} [Sun Jul 31 01:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:08:17.228814 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946cf44-68bb-4915-9c1a-2edf998a87f7 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:17.229349 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946cf44-68bb-4915-9c1a-2edf998a87f7 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:17.229434 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946cf44-68bb-4915-9c1a-2edf998a87f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:17.314444 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-3946cf44-68bb-4915-9c1a-2edf998a87f7 None None] MFA Rules not processed for user `657a3f73879e4b31b70a1c4f73e80f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:08:17.315842 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-3946cf44-68bb-4915-9c1a-2edf998a87f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:17.395453 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:17.433476 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 690/1353] 10.222.0.60 () {58 vars in 1018 bytes} [Sun Jul 31 01:08:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:08:18.544384 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac2f5c-9d5a-4fbb-84d3-595e022a24f9 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:18.544930 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac2f5c-9d5a-4fbb-84d3-595e022a24f9 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:18.545174 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac2f5c-9d5a-4fbb-84d3-595e022a24f9 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:18.547605 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 664/1354] 10.222.0.60 () {54 vars in 921 bytes} [Sun Jul 31 01:08:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:08:18.553700 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08bf1fe-a983-400c-bf39-cbd9d6f1c3c6 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:18.554592 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08bf1fe-a983-400c-bf39-cbd9d6f1c3c6 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:18.555148 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08bf1fe-a983-400c-bf39-cbd9d6f1c3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:18.636238 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-f08bf1fe-a983-400c-bf39-cbd9d6f1c3c6 None None] MFA Rules not processed for user `657a3f73879e4b31b70a1c4f73e80f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:08:18.637434 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-f08bf1fe-a983-400c-bf39-cbd9d6f1c3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:18.744881 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 691/1355] 10.222.0.60 () {58 vars in 1018 bytes} [Sun Jul 31 01:08:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:08:22.159214 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b02f96-9dbf-4210-bfc5-60f60ad962a4 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:22.160138 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b02f96-9dbf-4210-bfc5-60f60ad962a4 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:22.160582 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b02f96-9dbf-4210-bfc5-60f60ad962a4 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:22.168724 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676842a6-a481-4a76-80ee-d5fc46a760af None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:22.169555 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676842a6-a481-4a76-80ee-d5fc46a760af None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:22.169990 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676842a6-a481-4a76-80ee-d5fc46a760af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:22.170958 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 665/1356] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:08:22 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:08:22.209981 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:22.244610 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-676842a6-a481-4a76-80ee-d5fc46a760af None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:08:22.246154 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-676842a6-a481-4a76-80ee-d5fc46a760af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:22.355641 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 692/1357] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:08:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:08:22.409834 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86131cdd-fd1f-403d-a40c-2097173c9a23 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:22.410166 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86131cdd-fd1f-403d-a40c-2097173c9a23 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:22.410388 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86131cdd-fd1f-403d-a40c-2097173c9a23 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:22.411754 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 666/1358] 10.222.0.60 () {54 vars in 962 bytes} [Sun Jul 31 01:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:08:22.420875 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0971e2a-eab9-4fb5-9eb5-69b7547e47d5 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:22.421158 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0971e2a-eab9-4fb5-9eb5-69b7547e47d5 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:22.421429 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0971e2a-eab9-4fb5-9eb5-69b7547e47d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:22.505212 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-b0971e2a-eab9-4fb5-9eb5-69b7547e47d5 None None] MFA Rules not processed for user `04591cd035ef4961b8b7a93e294eb881`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:08:22.506895 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-b0971e2a-eab9-4fb5-9eb5-69b7547e47d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:22.559265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:22.633593 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 693/1359] 10.222.0.60 () {58 vars in 1059 bytes} [Sun Jul 31 01:08:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:08:22.641936 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86131cdd-fd1f-403d-a40c-2097173c9a23 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:22.643611 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-86131cdd-fd1f-403d-a40c-2097173c9a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:22.799606 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86131cdd-fd1f-403d-a40c-2097173c9a23 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:22.875177 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:22.916946 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f242b-bbab-40ef-b29b-952423dbeb6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:22.917610 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f242b-bbab-40ef-b29b-952423dbeb6c service nova] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:22.917991 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f242b-bbab-40ef-b29b-952423dbeb6c service nova] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:22.918363 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f242b-bbab-40ef-b29b-952423dbeb6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:22.920088 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-f22f242b-bbab-40ef-b29b-952423dbeb6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:23.023287 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f242b-bbab-40ef-b29b-952423dbeb6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:23.025194 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f242b-bbab-40ef-b29b-952423dbeb6c service nova] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:23.044776 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 667/1360] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:08:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:08:25.253342 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116222b1-fc27-479d-80fa-4a36ea5211ef None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:25.253921 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116222b1-fc27-479d-80fa-4a36ea5211ef None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:25.253921 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116222b1-fc27-479d-80fa-4a36ea5211ef None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:25.255459 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 694/1361] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:08:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:08:25.261436 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ab04a-e07f-4bf8-9a81-b2ff3ba328b0 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:25.261917 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ab04a-e07f-4bf8-9a81-b2ff3ba328b0 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:25.261917 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ab04a-e07f-4bf8-9a81-b2ff3ba328b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:25.330748 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-835ab04a-e07f-4bf8-9a81-b2ff3ba328b0 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:08:25.331995 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-835ab04a-e07f-4bf8-9a81-b2ff3ba328b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:25.372416 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:25.437024 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 668/1362] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:08:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:08:25.483133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116222b1-fc27-479d-80fa-4a36ea5211ef None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:25.485060 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-116222b1-fc27-479d-80fa-4a36ea5211ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:25.649393 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116222b1-fc27-479d-80fa-4a36ea5211ef None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:25.659439 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:25.775905 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adee600-014c-4b1d-9a80-adf9fb3850fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:25.776532 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adee600-014c-4b1d-9a80-adf9fb3850fa service nova] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:25.776804 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adee600-014c-4b1d-9a80-adf9fb3850fa service nova] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:25.777069 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adee600-014c-4b1d-9a80-adf9fb3850fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:25.778662 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-6adee600-014c-4b1d-9a80-adf9fb3850fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:25.885234 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adee600-014c-4b1d-9a80-adf9fb3850fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:25.886844 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adee600-014c-4b1d-9a80-adf9fb3850fa service nova] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:25.905883 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 695/1363] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:08:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:08:28.223380 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d28157-a5d8-4d42-9ffa-53629ce4d3d8 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:28.223900 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d28157-a5d8-4d42-9ffa-53629ce4d3d8 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:28.224055 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d28157-a5d8-4d42-9ffa-53629ce4d3d8 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:28.225574 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 669/1364] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:08:28.230886 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdd956-73bb-4b14-94d5-7c726e569d93 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:28.231321 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdd956-73bb-4b14-94d5-7c726e569d93 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:28.231407 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdd956-73bb-4b14-94d5-7c726e569d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:28.247961 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:28.320561 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-49bdd956-73bb-4b14-94d5-7c726e569d93 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:08:28.322227 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-49bdd956-73bb-4b14-94d5-7c726e569d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:28.455333 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 696/1365] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:08:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:08:28.502870 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cff42-168e-4757-a0cd-7ebdea99d3dc None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:28.503273 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cff42-168e-4757-a0cd-7ebdea99d3dc None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:28.503591 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cff42-168e-4757-a0cd-7ebdea99d3dc None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:28.505262 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 670/1366] 10.222.0.60 () {54 vars in 962 bytes} [Sun Jul 31 01:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:08:28.511467 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79c04c-3317-4a97-ac3d-b638b5b2b937 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:28.511818 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79c04c-3317-4a97-ac3d-b638b5b2b937 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:28.512062 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79c04c-3317-4a97-ac3d-b638b5b2b937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:28.598924 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-dc79c04c-3317-4a97-ac3d-b638b5b2b937 None None] MFA Rules not processed for user `04591cd035ef4961b8b7a93e294eb881`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:08:28.600271 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-dc79c04c-3317-4a97-ac3d-b638b5b2b937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:28.642655 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:28.734017 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 697/1367] 10.222.0.60 () {58 vars in 1059 bytes} [Sun Jul 31 01:08:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:08:28.742085 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617cff42-168e-4757-a0cd-7ebdea99d3dc None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:28.743580 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-617cff42-168e-4757-a0cd-7ebdea99d3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:28.945044 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617cff42-168e-4757-a0cd-7ebdea99d3dc None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:28.974248 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:29.081643 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13493f69-ab54-4fe7-97d6-a3c696bbb4ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:29.082375 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13493f69-ab54-4fe7-97d6-a3c696bbb4ff service nova] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:29.082728 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13493f69-ab54-4fe7-97d6-a3c696bbb4ff service nova] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:29.083613 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13493f69-ab54-4fe7-97d6-a3c696bbb4ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:29.085366 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-13493f69-ab54-4fe7-97d6-a3c696bbb4ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:29.215220 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13493f69-ab54-4fe7-97d6-a3c696bbb4ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:29.218640 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13493f69-ab54-4fe7-97d6-a3c696bbb4ff service nova] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:29.253861 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 671/1368] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:08:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:08:31.500953 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151c169-c695-49bc-aadb-a50402721aa3 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:31.501453 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151c169-c695-49bc-aadb-a50402721aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:31.501564 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151c169-c695-49bc-aadb-a50402721aa3 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:31.508081 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 698/1369] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:08:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:08:31.513272 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d2c89-bd25-43da-a1ac-e1d2a1a5ff59 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:31.513869 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d2c89-bd25-43da-a1ac-e1d2a1a5ff59 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:31.514164 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d2c89-bd25-43da-a1ac-e1d2a1a5ff59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:31.579518 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:31.647317 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-844d2c89-bd25-43da-a1ac-e1d2a1a5ff59 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:08:31.649932 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-844d2c89-bd25-43da-a1ac-e1d2a1a5ff59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:31.874169 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 672/1370] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:08:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:08:31.924697 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151c169-c695-49bc-aadb-a50402721aa3 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:31.926260 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-a151c169-c695-49bc-aadb-a50402721aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:32.135551 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:32.141564 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151c169-c695-49bc-aadb-a50402721aa3 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:32.266668 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f011b4-c91b-4821-a391-b708f79175dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:32.267303 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f011b4-c91b-4821-a391-b708f79175dc service nova] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:32.267610 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f011b4-c91b-4821-a391-b708f79175dc service nova] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:32.267882 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f011b4-c91b-4821-a391-b708f79175dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:32.269521 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-f9f011b4-c91b-4821-a391-b708f79175dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:32.365223 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f011b4-c91b-4821-a391-b708f79175dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:32.366893 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f011b4-c91b-4821-a391-b708f79175dc service nova] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:32.383904 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:32.391733 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 699/1371] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:08:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:08:33.579704 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f4536-90db-458a-9f64-3da1c0fd69b0 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:33.579704 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f4536-90db-458a-9f64-3da1c0fd69b0 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:33.579704 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f4536-90db-458a-9f64-3da1c0fd69b0 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:33.580513 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbafa9b-52a3-4efa-8278-42d15f6592d0 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:33.580513 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbafa9b-52a3-4efa-8278-42d15f6592d0 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:33.580513 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbafa9b-52a3-4efa-8278-42d15f6592d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:33.583810 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 673/1372] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:08:33 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:08:33.676749 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-fcbafa9b-52a3-4efa-8278-42d15f6592d0 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:08:33.677989 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-fcbafa9b-52a3-4efa-8278-42d15f6592d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:33.778332 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 700/1373] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:08:34.129209 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13205d07-dc9a-4485-96a2-5159e57a0a24 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:34.129570 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13205d07-dc9a-4485-96a2-5159e57a0a24 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:34.129952 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13205d07-dc9a-4485-96a2-5159e57a0a24 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:34.132101 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 674/1374] 10.222.0.60 () {54 vars in 964 bytes} [Sun Jul 31 01:08:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:08:34.138388 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b10f4-13b2-4543-8c29-a1123b1fdfd7 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:34.138674 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b10f4-13b2-4543-8c29-a1123b1fdfd7 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:34.138948 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b10f4-13b2-4543-8c29-a1123b1fdfd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:34.224487 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-d58b10f4-13b2-4543-8c29-a1123b1fdfd7 None None] MFA Rules not processed for user `a1943ab629b6411d81327a845b77c8c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:08:34.225734 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-d58b10f4-13b2-4543-8c29-a1123b1fdfd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:34.247406 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:34.306617 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 701/1375] 10.222.0.60 () {58 vars in 1061 bytes} [Sun Jul 31 01:08:34 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:08:34.314677 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13205d07-dc9a-4485-96a2-5159e57a0a24 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:34.316502 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-13205d07-dc9a-4485-96a2-5159e57a0a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:34.444082 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13205d07-dc9a-4485-96a2-5159e57a0a24 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:34.448321 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:34.513015 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63f8fc-7860-40ba-987e-eda19410659b None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:34.513375 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63f8fc-7860-40ba-987e-eda19410659b None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:34.513572 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63f8fc-7860-40ba-987e-eda19410659b None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:34.515381 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 702/1376] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:08:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:08:34.521049 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9421584-f5e0-4c6b-b36a-fba20edde116 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:34.521565 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9421584-f5e0-4c6b-b36a-fba20edde116 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:34.521766 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9421584-f5e0-4c6b-b36a-fba20edde116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:34.531256 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d8e4d-7846-483e-b7e8-782c1b606fff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1943ab629b6411d81327a845b77c8c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:34.532379 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d8e4d-7846-483e-b7e8-782c1b606fff service cinder] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:34.532660 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d8e4d-7846-483e-b7e8-782c1b606fff service cinder] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:34.532935 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d8e4d-7846-483e-b7e8-782c1b606fff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:34.535005 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-a67d8e4d-7846-483e-b7e8-782c1b606fff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:34.591228 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-f9421584-f5e0-4c6b-b36a-fba20edde116 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:08:34.592642 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-f9421584-f5e0-4c6b-b36a-fba20edde116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:34.653925 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d8e4d-7846-483e-b7e8-782c1b606fff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:34.655963 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d8e4d-7846-483e-b7e8-782c1b606fff service cinder] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:34.675763 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 675/1377] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:08:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:08:34.696832 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 703/1378] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:08:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:08:34.742121 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d8e4d-7846-483e-b7e8-782c1b606fff service cinder] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:34.743373 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-a67d8e4d-7846-483e-b7e8-782c1b606fff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:34.781671 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:34.848566 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d8e4d-7846-483e-b7e8-782c1b606fff service cinder] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:34.972612 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8a9ee-da51-44cd-b7d4-de9b4018417b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:34.973134 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8a9ee-da51-44cd-b7d4-de9b4018417b service nova] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:34.973407 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8a9ee-da51-44cd-b7d4-de9b4018417b service nova] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:34.973677 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8a9ee-da51-44cd-b7d4-de9b4018417b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:34.975304 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-a0d8a9ee-da51-44cd-b7d4-de9b4018417b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:35.029536 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:35.082207 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d8a9ee-da51-44cd-b7d4-de9b4018417b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:35.084024 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d8a9ee-da51-44cd-b7d4-de9b4018417b service nova] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:35.104603 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 676/1379] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:08:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:08:37.143467 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da285070-1815-455f-a927-37d7b2dfd39f None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:37.143993 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da285070-1815-455f-a927-37d7b2dfd39f None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:37.144075 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da285070-1815-455f-a927-37d7b2dfd39f None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:37.145397 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 704/1380] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:08:37.151331 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0231a7-41a1-42d8-a3c0-b7630185439e None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:37.151839 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0231a7-41a1-42d8-a3c0-b7630185439e None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:37.152108 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0231a7-41a1-42d8-a3c0-b7630185439e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:37.234080 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-7b0231a7-41a1-42d8-a3c0-b7630185439e None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:08:37.235423 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-7b0231a7-41a1-42d8-a3c0-b7630185439e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:37.392759 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 677/1381] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:08:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:08:37.436697 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da285070-1815-455f-a927-37d7b2dfd39f None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:37.438250 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-da285070-1815-455f-a927-37d7b2dfd39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:37.470747 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:37.610169 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da285070-1815-455f-a927-37d7b2dfd39f None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:37.751587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:37.784407 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c553c6-538f-43e1-bdce-5199c75341ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:37.785351 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c553c6-538f-43e1-bdce-5199c75341ba service nova] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:37.785788 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c553c6-538f-43e1-bdce-5199c75341ba service nova] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:37.786221 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c553c6-538f-43e1-bdce-5199c75341ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:37.788481 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-34c553c6-538f-43e1-bdce-5199c75341ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:37.891020 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c553c6-538f-43e1-bdce-5199c75341ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:37.892846 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c553c6-538f-43e1-bdce-5199c75341ba service nova] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:37.911330 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 705/1382] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:08:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:08:40.026564 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e861a06-059b-467c-a5af-fd68bc7e4d55 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:40.027021 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e861a06-059b-467c-a5af-fd68bc7e4d55 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:40.027136 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e861a06-059b-467c-a5af-fd68bc7e4d55 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:40.033784 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2c2de-eaba-4f76-860c-a0ddbd103e93 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:40.034261 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2c2de-eaba-4f76-860c-a0ddbd103e93 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:40.034356 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2c2de-eaba-4f76-860c-a0ddbd103e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:40.038915 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 678/1383] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:08:40 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:08:40.107148 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-83d2c2de-eaba-4f76-860c-a0ddbd103e93 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:08:40.108367 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-83d2c2de-eaba-4f76-860c-a0ddbd103e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:40.165425 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:40.207549 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 706/1384] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:08:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:08:40.253891 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e861a06-059b-467c-a5af-fd68bc7e4d55 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:40.255742 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-0e861a06-059b-467c-a5af-fd68bc7e4d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:40.290845 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:40.466427 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e861a06-059b-467c-a5af-fd68bc7e4d55 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:40.585895 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:40.612367 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8457e9-da20-4882-b4c8-5b4c25ac5a91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:40.615427 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8457e9-da20-4882-b4c8-5b4c25ac5a91 service nova] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:40.616102 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8457e9-da20-4882-b4c8-5b4c25ac5a91 service nova] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:40.616527 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8457e9-da20-4882-b4c8-5b4c25ac5a91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:40.618347 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-9d8457e9-da20-4882-b4c8-5b4c25ac5a91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:40.724818 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8457e9-da20-4882-b4c8-5b4c25ac5a91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:40.726733 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8457e9-da20-4882-b4c8-5b4c25ac5a91 service nova] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:40.758082 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 679/1385] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:08:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:08:42.793440 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc030a-6043-4e3c-8b95-f121c7d2cb07 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:42.794193 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc030a-6043-4e3c-8b95-f121c7d2cb07 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:42.794193 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc030a-6043-4e3c-8b95-f121c7d2cb07 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:42.795608 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 707/1386] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:08:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:08:42.801788 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f678b3f-ee74-418c-a010-c9c8160cf3f4 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:42.802269 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f678b3f-ee74-418c-a010-c9c8160cf3f4 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:42.802367 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f678b3f-ee74-418c-a010-c9c8160cf3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:42.875392 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-0f678b3f-ee74-418c-a010-c9c8160cf3f4 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:08:42.876759 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-0f678b3f-ee74-418c-a010-c9c8160cf3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:42.950615 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:42.999682 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 680/1387] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:08:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:08:43.062324 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc030a-6043-4e3c-8b95-f121c7d2cb07 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:43.064363 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-e6dc030a-6043-4e3c-8b95-f121c7d2cb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:43.228019 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc030a-6043-4e3c-8b95-f121c7d2cb07 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:43.276732 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:43.364490 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346a366-9266-4897-8ec0-d48ecef27733 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:43.365439 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346a366-9266-4897-8ec0-d48ecef27733 service nova] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:43.365784 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346a366-9266-4897-8ec0-d48ecef27733 service nova] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:43.366382 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346a366-9266-4897-8ec0-d48ecef27733 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:43.368112 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-f346a366-9266-4897-8ec0-d48ecef27733 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:43.479722 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f346a366-9266-4897-8ec0-d48ecef27733 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:43.481498 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f346a366-9266-4897-8ec0-d48ecef27733 service nova] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:43.501355 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 708/1388] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:08:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:08:45.630658 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ff127-cb45-45de-8716-bcaf26dbedea None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:45.631278 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ff127-cb45-45de-8716-bcaf26dbedea None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:45.631278 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ff127-cb45-45de-8716-bcaf26dbedea None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:45.632779 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 681/1389] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:08:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:08:45.639309 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70b633-9a0b-4fdf-aa06-58d958cdfe20 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:45.640030 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70b633-9a0b-4fdf-aa06-58d958cdfe20 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:45.640415 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70b633-9a0b-4fdf-aa06-58d958cdfe20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:45.715824 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:45.719194 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-1c70b633-9a0b-4fdf-aa06-58d958cdfe20 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:08:45.721080 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-1c70b633-9a0b-4fdf-aa06-58d958cdfe20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:45.831216 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 709/1390] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:08:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:08:45.879654 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ff127-cb45-45de-8716-bcaf26dbedea None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:45.881743 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-976ff127-cb45-45de-8716-bcaf26dbedea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:46.044902 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ff127-cb45-45de-8716-bcaf26dbedea None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:46.089145 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:46.176998 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff9b9f-2078-4e65-925a-2e79329f259c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:46.177583 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff9b9f-2078-4e65-925a-2e79329f259c service nova] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:46.177870 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff9b9f-2078-4e65-925a-2e79329f259c service nova] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:46.178151 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff9b9f-2078-4e65-925a-2e79329f259c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:46.181106 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-8fff9b9f-2078-4e65-925a-2e79329f259c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:46.294291 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff9b9f-2078-4e65-925a-2e79329f259c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:46.296127 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff9b9f-2078-4e65-925a-2e79329f259c service nova] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:46.315678 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 682/1391] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:08:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:08:48.461956 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aee9ff-4505-44f9-89e9-75f2ce69ef66 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:48.462615 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aee9ff-4505-44f9-89e9-75f2ce69ef66 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:48.462615 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aee9ff-4505-44f9-89e9-75f2ce69ef66 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:48.464342 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 710/1392] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:08:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:08:48.475593 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf356eb7-4df8-4a12-a187-965f50600cb8 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:48.476128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf356eb7-4df8-4a12-a187-965f50600cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:48.476128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf356eb7-4df8-4a12-a187-965f50600cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:48.542407 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:48.550453 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-cf356eb7-4df8-4a12-a187-965f50600cb8 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:08:48.551991 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-cf356eb7-4df8-4a12-a187-965f50600cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:48.653528 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 683/1393] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:08:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:08:48.698215 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aee9ff-4505-44f9-89e9-75f2ce69ef66 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:48.699799 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-f0aee9ff-4505-44f9-89e9-75f2ce69ef66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:48.835787 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:48.855527 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aee9ff-4505-44f9-89e9-75f2ce69ef66 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:48.969663 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb86d38-6adc-4bae-bada-6d7e11a1d504 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:48.970214 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb86d38-6adc-4bae-bada-6d7e11a1d504 service nova] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:48.970493 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb86d38-6adc-4bae-bada-6d7e11a1d504 service nova] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:48.970766 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb86d38-6adc-4bae-bada-6d7e11a1d504 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:48.972559 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-0cb86d38-6adc-4bae-bada-6d7e11a1d504 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:49.065102 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb86d38-6adc-4bae-bada-6d7e11a1d504 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:49.066736 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb86d38-6adc-4bae-bada-6d7e11a1d504 service nova] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:49.072404 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:49.092557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 711/1394] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:08:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:08:50.042326 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2c309-57b3-457f-a6f7-4c34a4524eaf None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:50.042934 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2c309-57b3-457f-a6f7-4c34a4524eaf None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:50.042934 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2c309-57b3-457f-a6f7-4c34a4524eaf None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:50.044262 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 684/1395] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:08:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:08:50.049722 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2638fa-b609-4ec9-9695-ab1ace2b9c28 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:50.050164 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2638fa-b609-4ec9-9695-ab1ace2b9c28 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:50.050295 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2638fa-b609-4ec9-9695-ab1ace2b9c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:50.132067 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-1b2638fa-b609-4ec9-9695-ab1ace2b9c28 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:08:50.133331 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-1b2638fa-b609-4ec9-9695-ab1ace2b9c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:50.256164 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 712/1396] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:08:50.304867 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5dbfe4-7c38-4fb4-a0fc-84f9ec22193e None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:50.305148 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5dbfe4-7c38-4fb4-a0fc-84f9ec22193e None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:50.305550 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5dbfe4-7c38-4fb4-a0fc-84f9ec22193e None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:50.307169 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 685/1397] 10.222.0.60 () {54 vars in 966 bytes} [Sun Jul 31 01:08:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:08:50.312830 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24122fb-616c-455b-b115-2a2d2f00e98c None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:50.313117 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24122fb-616c-455b-b115-2a2d2f00e98c None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:50.313388 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24122fb-616c-455b-b115-2a2d2f00e98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:50.405324 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-a24122fb-616c-455b-b115-2a2d2f00e98c None None] MFA Rules not processed for user `fdebcb0a2a7548a09b3e9d3cf085e40e`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:08:50.406521 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-a24122fb-616c-455b-b115-2a2d2f00e98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:50.414623 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:50.482026 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 713/1398] 10.222.0.60 () {58 vars in 1063 bytes} [Sun Jul 31 01:08:50 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:08:50.489686 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5dbfe4-7c38-4fb4-a0fc-84f9ec22193e None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:50.491263 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-5c5dbfe4-7c38-4fb4-a0fc-84f9ec22193e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:50.596966 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5dbfe4-7c38-4fb4-a0fc-84f9ec22193e None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:50.624644 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:50.671653 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce3ff6-1334-4f8e-aad5-c07337a9dd06 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdebcb0a2a7548a09b3e9d3cf085e40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:50.672283 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce3ff6-1334-4f8e-aad5-c07337a9dd06 service glance] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:50.672554 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce3ff6-1334-4f8e-aad5-c07337a9dd06 service glance] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:50.672818 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce3ff6-1334-4f8e-aad5-c07337a9dd06 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:50.674498 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-b4ce3ff6-1334-4f8e-aad5-c07337a9dd06 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:50.786150 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ce3ff6-1334-4f8e-aad5-c07337a9dd06 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:50.787623 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ce3ff6-1334-4f8e-aad5-c07337a9dd06 service glance] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:50.806287 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 686/1399] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:08:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:08:51.119465 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04cb1a-256a-411d-a02d-c89bb784512d None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:51.120211 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04cb1a-256a-411d-a02d-c89bb784512d None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:51.120211 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04cb1a-256a-411d-a02d-c89bb784512d None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:51.121734 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 714/1400] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:08:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:08:51.127478 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eeeb38-c324-4d04-91d9-f84724ff2f49 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:51.127964 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eeeb38-c324-4d04-91d9-f84724ff2f49 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:51.128082 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eeeb38-c324-4d04-91d9-f84724ff2f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:51.196634 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-61eeeb38-c324-4d04-91d9-f84724ff2f49 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:08:51.197754 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-61eeeb38-c324-4d04-91d9-f84724ff2f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:51.204725 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:51.298300 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 687/1401] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:08:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:08:51.343780 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04cb1a-256a-411d-a02d-c89bb784512d None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:51.345330 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-0e04cb1a-256a-411d-a02d-c89bb784512d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:51.505844 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04cb1a-256a-411d-a02d-c89bb784512d None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:51.523165 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:51.554120 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e11883c-e495-4722-bc7e-aaa5408bf85a None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:51.555049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e11883c-e495-4722-bc7e-aaa5408bf85a None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:51.555330 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e11883c-e495-4722-bc7e-aaa5408bf85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:51.620376 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2aecd-ad19-49e9-86b7-97106c35d743 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:51.621006 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2aecd-ad19-49e9-86b7-97106c35d743 service nova] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:51.621286 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2aecd-ad19-49e9-86b7-97106c35d743 service nova] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:51.621558 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2aecd-ad19-49e9-86b7-97106c35d743 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:51.623199 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-20b2aecd-ad19-49e9-86b7-97106c35d743 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:51.624998 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-7e11883c-e495-4722-bc7e-aaa5408bf85a None None] MFA Rules not processed for user `02ed9040d575462db4b270a5b57063f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:08:51.626188 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-7e11883c-e495-4722-bc7e-aaa5408bf85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:51.711820 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:51.714489 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b2aecd-ad19-49e9-86b7-97106c35d743 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:51.715026 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 688/1402] 10.222.0.60 () {58 vars in 1009 bytes} [Sun Jul 31 01:08:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:08:51.716299 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b2aecd-ad19-49e9-86b7-97106c35d743 service nova] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:51.734802 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 715/1403] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:08:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:08:51.762492 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb974c4b-79c9-4b8a-8cbf-5036268b9ccf None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:51.762780 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb974c4b-79c9-4b8a-8cbf-5036268b9ccf None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:51.763104 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb974c4b-79c9-4b8a-8cbf-5036268b9ccf None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:51.764519 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 689/1404] 10.222.0.60 () {54 vars in 943 bytes} [Sun Jul 31 01:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:08:51.771257 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ca306-3a6a-4a28-96f9-864ddbb0d6c6 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:51.772327 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ca306-3a6a-4a28-96f9-864ddbb0d6c6 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:51.772327 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ca306-3a6a-4a28-96f9-864ddbb0d6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:51.800131 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:51.857740 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-b67ca306-3a6a-4a28-96f9-864ddbb0d6c6 None None] MFA Rules not processed for user `0c8c98c1e2d24de89c7d07753fae02e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:08:51.858967 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-b67ca306-3a6a-4a28-96f9-864ddbb0d6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:51.978390 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 716/1405] 10.222.0.60 () {58 vars in 1040 bytes} [Sun Jul 31 01:08:51 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:08:51.987774 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb974c4b-79c9-4b8a-8cbf-5036268b9ccf None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:51.989318 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-eb974c4b-79c9-4b8a-8cbf-5036268b9ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:52.127993 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb974c4b-79c9-4b8a-8cbf-5036268b9ccf None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:52.217894 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:52.238616 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d32d37-7b80-4986-900e-8e24f58c475b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c8c98c1e2d24de89c7d07753fae02e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:52.239252 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d32d37-7b80-4986-900e-8e24f58c475b service swift] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:52.239565 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d32d37-7b80-4986-900e-8e24f58c475b service swift] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:52.239829 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d32d37-7b80-4986-900e-8e24f58c475b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:52.241720 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-06d32d37-7b80-4986-900e-8e24f58c475b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:52.327558 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d32d37-7b80-4986-900e-8e24f58c475b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:52.329214 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d32d37-7b80-4986-900e-8e24f58c475b service swift] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:52.337838 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 690/1406] 10.222.0.60 () {60 vars in 1384 bytes} [Sun Jul 31 01:08:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 01:08:53.803455 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344db37-56e5-41b0-b2a2-3705312a5182 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:53.804055 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344db37-56e5-41b0-b2a2-3705312a5182 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:53.804055 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344db37-56e5-41b0-b2a2-3705312a5182 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:53.805595 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 717/1407] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:08:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:08:53.810784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbe10c-ff36-4a06-8635-71da2b789c2e None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:53.811226 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbe10c-ff36-4a06-8635-71da2b789c2e None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:53.811331 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbe10c-ff36-4a06-8635-71da2b789c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:53.886377 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-06dbe10c-ff36-4a06-8635-71da2b789c2e None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:08:53.887801 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-06dbe10c-ff36-4a06-8635-71da2b789c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:53.963834 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:54.011632 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 691/1408] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:08:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:08:54.050316 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344db37-56e5-41b0-b2a2-3705312a5182 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:54.051908 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-4344db37-56e5-41b0-b2a2-3705312a5182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:54.141163 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:54.215992 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344db37-56e5-41b0-b2a2-3705312a5182 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:54.347841 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8acbfac-8e89-4d33-b214-231b7237d8c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:54.348880 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acbfac-8e89-4d33-b214-231b7237d8c2 service nova] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:54.349243 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acbfac-8e89-4d33-b214-231b7237d8c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:54.349585 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acbfac-8e89-4d33-b214-231b7237d8c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:54.351276 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-f8acbfac-8e89-4d33-b214-231b7237d8c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:54.397300 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:54.451612 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8acbfac-8e89-4d33-b214-231b7237d8c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:54.453413 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8acbfac-8e89-4d33-b214-231b7237d8c2 service nova] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:54.474987 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 718/1409] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:08:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:09:04.001948 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=10 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:04.472252 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=27 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:14.943538 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f427c8-5926-4dfe-8c10-74578dc9e2cb None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:14.944264 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f427c8-5926-4dfe-8c10-74578dc9e2cb None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:14.944264 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f427c8-5926-4dfe-8c10-74578dc9e2cb None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:14.945667 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 692/1410] 10.222.0.60 () {54 vars in 918 bytes} [Sun Jul 31 01:09:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:09:14.953594 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4c917-aa55-4ac3-bdb8-c47b63359962 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:14.954329 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4c917-aa55-4ac3-bdb8-c47b63359962 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:14.954516 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4c917-aa55-4ac3-bdb8-c47b63359962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:15.032272 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-abf4c917-aa55-4ac3-bdb8-c47b63359962 None None] MFA Rules not processed for user `657a3f73879e4b31b70a1c4f73e80f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:09:15.033466 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-abf4c917-aa55-4ac3-bdb8-c47b63359962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:15.149029 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 719/1411] 10.222.0.60 () {58 vars in 1015 bytes} [Sun Jul 31 01:09:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:09:15.164047 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ca659-7183-4a93-ad5c-dd896d080b76 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:15.164325 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ca659-7183-4a93-ad5c-dd896d080b76 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:15.164598 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ca659-7183-4a93-ad5c-dd896d080b76 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:15.166022 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 693/1412] 10.222.0.60 () {54 vars in 918 bytes} [Sun Jul 31 01:09:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:09:15.170823 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79fe53-9da3-424c-934f-795620cfebf3 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:15.171113 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79fe53-9da3-424c-934f-795620cfebf3 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:15.171421 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79fe53-9da3-424c-934f-795620cfebf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:15.248335 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:15.252207 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-bb79fe53-9da3-424c-934f-795620cfebf3 None None] MFA Rules not processed for user `04591cd035ef4961b8b7a93e294eb881`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:09:15.254158 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-bb79fe53-9da3-424c-934f-795620cfebf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:15.381449 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 720/1413] 10.222.0.60 () {58 vars in 1015 bytes} [Sun Jul 31 01:09:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:09:17.854729 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c03657-10cc-4cbf-afc3-b94023849d6f None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:17.855401 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c03657-10cc-4cbf-afc3-b94023849d6f None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:17.855401 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c03657-10cc-4cbf-afc3-b94023849d6f None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:17.856627 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 694/1414] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 01:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:09:17.862187 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87dc60-453c-4a33-ace6-b956d25a16f5 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:17.862650 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87dc60-453c-4a33-ace6-b956d25a16f5 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:17.862756 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87dc60-453c-4a33-ace6-b956d25a16f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:17.931791 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-0e87dc60-453c-4a33-ace6-b956d25a16f5 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:09:17.933003 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-0e87dc60-453c-4a33-ace6-b956d25a16f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:17.995102 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:18.049822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 721/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 01:09:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:09:18.093339 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c03657-10cc-4cbf-afc3-b94023849d6f None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:09:18.095996 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-79c03657-10cc-4cbf-afc3-b94023849d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:18.258990 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c03657-10cc-4cbf-afc3-b94023849d6f None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:09:18.332611 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:18.374272 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ac40d-0b99-49a0-a0d2-d8e5bcc986c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:09:18.374908 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ac40d-0b99-49a0-a0d2-d8e5bcc986c0 service nova] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:18.375181 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ac40d-0b99-49a0-a0d2-d8e5bcc986c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:18.375450 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ac40d-0b99-49a0-a0d2-d8e5bcc986c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:18.377090 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-564ac40d-0b99-49a0-a0d2-d8e5bcc986c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:18.482205 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ac40d-0b99-49a0-a0d2-d8e5bcc986c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:09:18.483865 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ac40d-0b99-49a0-a0d2-d8e5bcc986c0 service nova] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:09:18.506959 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 695/1416] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:09:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:09:19.439094 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aae6a1-53a9-4c7a-a4d4-5f2ebfd41013 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:19.439707 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aae6a1-53a9-4c7a-a4d4-5f2ebfd41013 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:19.439707 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aae6a1-53a9-4c7a-a4d4-5f2ebfd41013 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:19.441066 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 722/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 31 01:09:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:09:19.447373 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bb70a-bbe6-44e0-973b-2b5031a9897d None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:19.447857 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bb70a-bbe6-44e0-973b-2b5031a9897d None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:19.447967 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bb70a-bbe6-44e0-973b-2b5031a9897d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:19.530626 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-a57bb70a-bbe6-44e0-973b-2b5031a9897d None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:09:19.531856 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-a57bb70a-bbe6-44e0-973b-2b5031a9897d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:19.559072 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:19.634885 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 696/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 31 01:09:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:09:19.795434 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aae6a1-53a9-4c7a-a4d4-5f2ebfd41013 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:09:19.797890 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-53aae6a1-53a9-4c7a-a4d4-5f2ebfd41013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:19.948383 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aae6a1-53a9-4c7a-a4d4-5f2ebfd41013 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:09:19.991863 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:20.069551 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8948d93-97d4-4d46-9f64-3fa4f95ddfb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:09:20.070290 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8948d93-97d4-4d46-9f64-3fa4f95ddfb8 service nova] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:20.070652 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8948d93-97d4-4d46-9f64-3fa4f95ddfb8 service nova] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:20.070808 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8948d93-97d4-4d46-9f64-3fa4f95ddfb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:20.072889 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-e8948d93-97d4-4d46-9f64-3fa4f95ddfb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:20.172890 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8948d93-97d4-4d46-9f64-3fa4f95ddfb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:09:20.174428 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8948d93-97d4-4d46-9f64-3fa4f95ddfb8 service nova] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:09:20.193729 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 723/1419] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:09:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:09:21.070160 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c11db-39c9-4714-b234-b77e4e8a5b7a None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:21.070775 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c11db-39c9-4714-b234-b77e4e8a5b7a None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:21.070775 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c11db-39c9-4714-b234-b77e4e8a5b7a None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:21.072236 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 697/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 31 01:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:09:21.078654 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6859a0-4ad8-4420-b04b-3d5675799134 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:21.079096 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6859a0-4ad8-4420-b04b-3d5675799134 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:21.079342 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6859a0-4ad8-4420-b04b-3d5675799134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:21.140253 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:21.167469 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-dc6859a0-4ad8-4420-b04b-3d5675799134 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:09:21.168721 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-dc6859a0-4ad8-4420-b04b-3d5675799134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:21.274676 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 724/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 31 01:09:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:09:21.441316 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c11db-39c9-4714-b234-b77e4e8a5b7a None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:09:21.442849 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-7d7c11db-39c9-4714-b234-b77e4e8a5b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:21.596960 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c11db-39c9-4714-b234-b77e4e8a5b7a None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:09:21.611646 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:21.736794 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f86515-7db6-4f7a-8870-976a0e606727 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:09:21.737676 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f86515-7db6-4f7a-8870-976a0e606727 service nova] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:21.738076 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f86515-7db6-4f7a-8870-976a0e606727 service nova] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:21.738975 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f86515-7db6-4f7a-8870-976a0e606727 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:21.741484 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-19f86515-7db6-4f7a-8870-976a0e606727 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:21.843709 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f86515-7db6-4f7a-8870-976a0e606727 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:09:21.845353 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f86515-7db6-4f7a-8870-976a0e606727 service nova] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:09:21.864944 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 698/1422] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:09:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:09:22.722552 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f6a46-1a34-4988-916c-dd66d243edca None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:22.723159 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f6a46-1a34-4988-916c-dd66d243edca None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:22.723159 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f6a46-1a34-4988-916c-dd66d243edca None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:22.724515 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 725/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 31 01:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:09:22.730822 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c6343-9d95-4ad4-a07b-8ddebcda15cf None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:22.731588 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c6343-9d95-4ad4-a07b-8ddebcda15cf None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:22.731714 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c6343-9d95-4ad4-a07b-8ddebcda15cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:22.756441 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:22.814500 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-293c6343-9d95-4ad4-a07b-8ddebcda15cf None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:09:22.815753 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-293c6343-9d95-4ad4-a07b-8ddebcda15cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:22.915753 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 699/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 31 01:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:09:23.065409 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f6a46-1a34-4988-916c-dd66d243edca None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:09:23.067809 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-133f6a46-1a34-4988-916c-dd66d243edca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:23.183730 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:23.220619 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f6a46-1a34-4988-916c-dd66d243edca None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:09:23.339856 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceba173-de21-4f47-8c80-e6ecef27e799 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:09:23.340384 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceba173-de21-4f47-8c80-e6ecef27e799 service nova] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:23.340658 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceba173-de21-4f47-8c80-e6ecef27e799 service nova] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:23.340918 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceba173-de21-4f47-8c80-e6ecef27e799 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:23.342616 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-5ceba173-de21-4f47-8c80-e6ecef27e799 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:23.422145 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:23.436498 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceba173-de21-4f47-8c80-e6ecef27e799 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:09:23.438128 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceba173-de21-4f47-8c80-e6ecef27e799 service nova] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:09:23.456184 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 726/1425] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:09:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:09:24.337292 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5008e-cad2-4fe6-b5df-59faa09ed988 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:24.337850 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5008e-cad2-4fe6-b5df-59faa09ed988 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:24.337850 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5008e-cad2-4fe6-b5df-59faa09ed988 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:24.339636 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 700/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 31 01:09:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:09:24.347918 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bec531-3885-46d0-981f-a532902d186e None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:24.348330 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bec531-3885-46d0-981f-a532902d186e None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:24.348483 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bec531-3885-46d0-981f-a532902d186e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:24.436312 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-27bec531-3885-46d0-981f-a532902d186e None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:09:24.437538 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-27bec531-3885-46d0-981f-a532902d186e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:24.551961 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 727/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 31 01:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:09:24.718375 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5008e-cad2-4fe6-b5df-59faa09ed988 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:09:24.720843 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-6cd5008e-cad2-4fe6-b5df-59faa09ed988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:24.815533 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:24.884154 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5008e-cad2-4fe6-b5df-59faa09ed988 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:09:25.016672 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdcc6a1-5fcd-427a-9ae9-6c5afa20a6af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:09:25.017419 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdcc6a1-5fcd-427a-9ae9-6c5afa20a6af service nova] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:25.017692 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdcc6a1-5fcd-427a-9ae9-6c5afa20a6af service nova] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:25.017967 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdcc6a1-5fcd-427a-9ae9-6c5afa20a6af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:25.019694 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-5bdcc6a1-5fcd-427a-9ae9-6c5afa20a6af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:25.066775 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:25.111590 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdcc6a1-5fcd-427a-9ae9-6c5afa20a6af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:09:25.113225 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdcc6a1-5fcd-427a-9ae9-6c5afa20a6af service nova] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:09:25.131305 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 701/1428] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:09:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:09:25.957724 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44c9e3-18e7-4682-8543-0ab7f74bb7db None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:25.958242 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44c9e3-18e7-4682-8543-0ab7f74bb7db None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:25.958242 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44c9e3-18e7-4682-8543-0ab7f74bb7db None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:25.959658 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 728/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 31 01:09:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:09:25.965801 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55960146-943b-4f45-a725-9d371b732ad2 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:25.966584 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55960146-943b-4f45-a725-9d371b732ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:25.966758 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55960146-943b-4f45-a725-9d371b732ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:26.047324 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-55960146-943b-4f45-a725-9d371b732ad2 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:09:26.048534 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-55960146-943b-4f45-a725-9d371b732ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:26.156440 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 702/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 31 01:09:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:09:26.306756 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b44c9e3-18e7-4682-8543-0ab7f74bb7db None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:09:26.308390 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-4b44c9e3-18e7-4682-8543-0ab7f74bb7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:26.361249 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:26.466769 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b44c9e3-18e7-4682-8543-0ab7f74bb7db None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:09:26.586362 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2d8c74-21d7-4bf4-a20a-38567ca9b393 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:09:26.586992 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d8c74-21d7-4bf4-a20a-38567ca9b393 service nova] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:26.587264 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d8c74-21d7-4bf4-a20a-38567ca9b393 service nova] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:26.587515 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d8c74-21d7-4bf4-a20a-38567ca9b393 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:26.589184 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-2a2d8c74-21d7-4bf4-a20a-38567ca9b393 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:26.596870 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:26.691389 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2d8c74-21d7-4bf4-a20a-38567ca9b393 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:09:26.693926 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2d8c74-21d7-4bf4-a20a-38567ca9b393 service nova] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:09:26.714850 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 729/1431] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:09:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:09:27.532810 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f0bce-a623-49d4-a5b1-dad714a5ccf5 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:27.533414 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f0bce-a623-49d4-a5b1-dad714a5ccf5 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:27.533414 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f0bce-a623-49d4-a5b1-dad714a5ccf5 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:27.534879 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 703/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 31 01:09:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:09:27.542319 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f5779-a08b-4819-95a9-767a3ee5c39d None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:27.542760 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f5779-a08b-4819-95a9-767a3ee5c39d None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:27.542856 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f5779-a08b-4819-95a9-767a3ee5c39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:27.628974 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-e47f5779-a08b-4819-95a9-767a3ee5c39d None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:09:27.630884 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-e47f5779-a08b-4819-95a9-767a3ee5c39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:27.710011 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:27.741387 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 730/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 31 01:09:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:09:27.900013 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f0bce-a623-49d4-a5b1-dad714a5ccf5 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:09:27.901591 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-5c3f0bce-a623-49d4-a5b1-dad714a5ccf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:27.919995 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:28.199557 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f0bce-a623-49d4-a5b1-dad714a5ccf5 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:09:28.288754 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:28.315480 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df679c-d112-4237-bbb8-f3115af36b82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:09:28.316128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df679c-d112-4237-bbb8-f3115af36b82 service nova] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:28.316389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df679c-d112-4237-bbb8-f3115af36b82 service nova] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:28.316677 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df679c-d112-4237-bbb8-f3115af36b82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:28.318315 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-87df679c-d112-4237-bbb8-f3115af36b82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:28.408503 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df679c-d112-4237-bbb8-f3115af36b82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:09:28.410109 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df679c-d112-4237-bbb8-f3115af36b82 service nova] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:09:28.428754 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 704/1434] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:09:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:09:29.228587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84be91-b944-4a98-949e-4fe55e87601a None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:29.229282 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84be91-b944-4a98-949e-4fe55e87601a None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:29.229282 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84be91-b944-4a98-949e-4fe55e87601a None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:29.230533 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 731/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 31 01:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:09:29.235825 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d81bc-892a-4756-a350-535e1beecc2d None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:29.236255 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d81bc-892a-4756-a350-535e1beecc2d None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:29.236348 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d81bc-892a-4756-a350-535e1beecc2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:29.331517 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-481d81bc-892a-4756-a350-535e1beecc2d None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:09:29.333101 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-481d81bc-892a-4756-a350-535e1beecc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:29.379729 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:29.438566 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 705/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 31 01:09:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:09:29.591880 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84be91-b944-4a98-949e-4fe55e87601a None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:09:29.594181 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-5a84be91-b944-4a98-949e-4fe55e87601a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:29.880420 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84be91-b944-4a98-949e-4fe55e87601a None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:09:29.936208 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:29.994505 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f1688-bbe0-4dc4-bfc7-66ba6e4eae0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:09:29.995211 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f1688-bbe0-4dc4-bfc7-66ba6e4eae0d service nova] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:29.995479 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f1688-bbe0-4dc4-bfc7-66ba6e4eae0d service nova] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:29.995769 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f1688-bbe0-4dc4-bfc7-66ba6e4eae0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:29.997391 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-673f1688-bbe0-4dc4-bfc7-66ba6e4eae0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:30.094951 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f1688-bbe0-4dc4-bfc7-66ba6e4eae0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:09:30.096633 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f1688-bbe0-4dc4-bfc7-66ba6e4eae0d service nova] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:09:30.115406 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 732/1437] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:09:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:09:30.924389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f9b6a-301d-492e-960c-117452122090 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:30.925013 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f9b6a-301d-492e-960c-117452122090 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:30.925013 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f9b6a-301d-492e-960c-117452122090 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:30.926300 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 706/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 31 01:09:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:09:30.932534 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25456be3-da5c-4491-a1ec-9bec922bc6d0 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:30.933002 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25456be3-da5c-4491-a1ec-9bec922bc6d0 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:30.933098 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25456be3-da5c-4491-a1ec-9bec922bc6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:31.017994 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-25456be3-da5c-4491-a1ec-9bec922bc6d0 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:09:31.019137 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-25456be3-da5c-4491-a1ec-9bec922bc6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:31.021190 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:31.117598 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 733/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 31 01:09:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:09:31.276295 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f9b6a-301d-492e-960c-117452122090 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:09:31.277735 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-607f9b6a-301d-492e-960c-117452122090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:31.428042 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f9b6a-301d-492e-960c-117452122090 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:09:31.455590 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:31.544588 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190390b9-b715-48c3-9376-779729a3edd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:09:31.545120 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190390b9-b715-48c3-9376-779729a3edd1 service nova] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:31.545395 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190390b9-b715-48c3-9376-779729a3edd1 service nova] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:31.545662 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190390b9-b715-48c3-9376-779729a3edd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:31.547280 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-190390b9-b715-48c3-9376-779729a3edd1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:31.644913 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190390b9-b715-48c3-9376-779729a3edd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:09:31.646492 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190390b9-b715-48c3-9376-779729a3edd1 service nova] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:09:31.664785 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 707/1440] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:09:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:09:33.545353 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9c5b5-2f29-4605-ba50-5b07e2b4e42a None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:33.545920 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9c5b5-2f29-4605-ba50-5b07e2b4e42a None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:33.545920 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9c5b5-2f29-4605-ba50-5b07e2b4e42a None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:33.547258 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 734/1441] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 01:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:09:33.556659 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6896f7-17b6-4341-8eef-b7132228c485 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:33.557390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6896f7-17b6-4341-8eef-b7132228c485 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:33.557545 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6896f7-17b6-4341-8eef-b7132228c485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:33.605719 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:33.631584 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-1b6896f7-17b6-4341-8eef-b7132228c485 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:09:33.632791 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-1b6896f7-17b6-4341-8eef-b7132228c485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:33.752826 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 708/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 01:09:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:09:33.791877 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9c5b5-2f29-4605-ba50-5b07e2b4e42a None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:09:33.794316 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-cab9c5b5-2f29-4605-ba50-5b07e2b4e42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:33.918657 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9c5b5-2f29-4605-ba50-5b07e2b4e42a None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:09:33.950546 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:33.993819 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a66d4-032d-48ea-aa84-5240cb405b50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:09:33.994437 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a66d4-032d-48ea-aa84-5240cb405b50 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:33.994787 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a66d4-032d-48ea-aa84-5240cb405b50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:33.995053 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a66d4-032d-48ea-aa84-5240cb405b50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:33.996690 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-753a66d4-032d-48ea-aa84-5240cb405b50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:34.117601 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a66d4-032d-48ea-aa84-5240cb405b50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:09:34.119050 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a66d4-032d-48ea-aa84-5240cb405b50 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:09:34.138039 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 735/1443] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:09:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:09:36.298956 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0372df-eed8-49c4-abcd-c99fe1eadc1d None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:36.299623 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0372df-eed8-49c4-abcd-c99fe1eadc1d None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:36.299623 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0372df-eed8-49c4-abcd-c99fe1eadc1d None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:36.300932 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 709/1444] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 01:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:09:36.307571 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2ecfa-ab5c-4cff-8492-a821ef984964 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:36.308317 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2ecfa-ab5c-4cff-8492-a821ef984964 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:36.308471 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2ecfa-ab5c-4cff-8492-a821ef984964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:36.383404 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-0fc2ecfa-ab5c-4cff-8492-a821ef984964 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:09:36.384693 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-0fc2ecfa-ab5c-4cff-8492-a821ef984964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:36.397899 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:36.488221 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 736/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 01:09:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:09:36.534790 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0372df-eed8-49c4-abcd-c99fe1eadc1d None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:09:36.536362 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-cd0372df-eed8-49c4-abcd-c99fe1eadc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:36.644121 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0372df-eed8-49c4-abcd-c99fe1eadc1d None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:09:36.657183 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:36.719459 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1db53d-5eb6-47eb-82ad-6c166e32fe5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:09:36.720101 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1db53d-5eb6-47eb-82ad-6c166e32fe5c service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:36.720373 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1db53d-5eb6-47eb-82ad-6c166e32fe5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:36.720643 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1db53d-5eb6-47eb-82ad-6c166e32fe5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:36.722246 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-da1db53d-5eb6-47eb-82ad-6c166e32fe5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:36.836122 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1db53d-5eb6-47eb-82ad-6c166e32fe5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:09:36.837568 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1db53d-5eb6-47eb-82ad-6c166e32fe5c service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:09:36.856198 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 710/1446] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:09:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:09:39.181342 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ce4ab-c231-4c90-873c-a304300fa081 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:39.182365 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ce4ab-c231-4c90-873c-a304300fa081 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:39.182365 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ce4ab-c231-4c90-873c-a304300fa081 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:39.183691 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 737/1447] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 01:09:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:09:39.191707 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715f893-85fc-4cc3-bd6b-d5784fbc23a4 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:39.192157 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715f893-85fc-4cc3-bd6b-d5784fbc23a4 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:39.192286 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715f893-85fc-4cc3-bd6b-d5784fbc23a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:39.247780 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:39.266605 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-c715f893-85fc-4cc3-bd6b-d5784fbc23a4 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:09:39.267824 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-c715f893-85fc-4cc3-bd6b-d5784fbc23a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:39.367066 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 711/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 01:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:09:39.406202 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ce4ab-c231-4c90-873c-a304300fa081 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:09:39.407802 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-657ce4ab-c231-4c90-873c-a304300fa081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:39.516432 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ce4ab-c231-4c90-873c-a304300fa081 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:09:39.559450 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:39.594451 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0545fd-6900-4808-bc0a-abc270f23ac7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:09:39.595073 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0545fd-6900-4808-bc0a-abc270f23ac7 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:39.595401 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0545fd-6900-4808-bc0a-abc270f23ac7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:39.595920 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0545fd-6900-4808-bc0a-abc270f23ac7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:39.597936 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-cf0545fd-6900-4808-bc0a-abc270f23ac7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:39.713973 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0545fd-6900-4808-bc0a-abc270f23ac7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:09:39.715404 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0545fd-6900-4808-bc0a-abc270f23ac7 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:09:39.734489 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 738/1449] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:09:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:09:41.858325 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29bc37-e005-41be-b82a-f6232fdaf48c None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:41.859291 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29bc37-e005-41be-b82a-f6232fdaf48c None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:41.859291 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29bc37-e005-41be-b82a-f6232fdaf48c None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:41.861423 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 712/1450] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 01:09:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:09:41.870185 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef4331-51ae-4f0f-a6da-8a13e514266b None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:41.870634 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef4331-51ae-4f0f-a6da-8a13e514266b None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:41.870740 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef4331-51ae-4f0f-a6da-8a13e514266b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:41.948595 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-b6ef4331-51ae-4f0f-a6da-8a13e514266b None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:09:41.949826 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-b6ef4331-51ae-4f0f-a6da-8a13e514266b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:41.972043 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:42.058549 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 739/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 01:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:09:42.101321 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29bc37-e005-41be-b82a-f6232fdaf48c None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:09:42.102871 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-1f29bc37-e005-41be-b82a-f6232fdaf48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:42.227145 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29bc37-e005-41be-b82a-f6232fdaf48c None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:09:42.249563 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:42.305885 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ce8ae-c9bd-4caa-9d56-1b8ee5f66113 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:09:42.306521 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ce8ae-c9bd-4caa-9d56-1b8ee5f66113 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:42.306841 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ce8ae-c9bd-4caa-9d56-1b8ee5f66113 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:42.307103 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ce8ae-c9bd-4caa-9d56-1b8ee5f66113 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:42.308784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-916ce8ae-c9bd-4caa-9d56-1b8ee5f66113 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:42.438085 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ce8ae-c9bd-4caa-9d56-1b8ee5f66113 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:09:42.439536 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ce8ae-c9bd-4caa-9d56-1b8ee5f66113 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:09:42.458557 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 713/1452] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:09:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:09:44.549529 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45005077-f58d-44be-8c31-8516b82247a4 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:44.550388 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45005077-f58d-44be-8c31-8516b82247a4 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:44.550388 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45005077-f58d-44be-8c31-8516b82247a4 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:44.552750 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 740/1453] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 01:09:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:09:44.559283 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ecbf6-2844-43de-8b19-849a450f2281 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:44.560031 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ecbf6-2844-43de-8b19-849a450f2281 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:44.560213 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ecbf6-2844-43de-8b19-849a450f2281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:44.631354 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:44.634684 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-079ecbf6-2844-43de-8b19-849a450f2281 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:09:44.636589 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-079ecbf6-2844-43de-8b19-849a450f2281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:44.748053 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 714/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 01:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:09:44.786197 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45005077-f58d-44be-8c31-8516b82247a4 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:09:44.787794 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-45005077-f58d-44be-8c31-8516b82247a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:44.903756 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45005077-f58d-44be-8c31-8516b82247a4 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:09:44.953425 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:44.978465 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23bf72e-4ff6-46c1-88fe-fbe98af2031a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:09:44.979726 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23bf72e-4ff6-46c1-88fe-fbe98af2031a service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:44.979726 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23bf72e-4ff6-46c1-88fe-fbe98af2031a service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:44.979726 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23bf72e-4ff6-46c1-88fe-fbe98af2031a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:44.981243 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-f23bf72e-4ff6-46c1-88fe-fbe98af2031a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:45.098121 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23bf72e-4ff6-46c1-88fe-fbe98af2031a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:09:45.099585 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23bf72e-4ff6-46c1-88fe-fbe98af2031a service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:09:45.118004 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 741/1455] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:09:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:09:47.235076 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965275e-8253-4df5-a617-cedf78b2c853 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:47.235723 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965275e-8253-4df5-a617-cedf78b2c853 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:47.235723 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965275e-8253-4df5-a617-cedf78b2c853 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:47.237015 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 715/1456] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 01:09:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:09:47.243526 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a92d1c-af79-479c-bc2a-33bd3dc50f9d None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:47.244210 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a92d1c-af79-479c-bc2a-33bd3dc50f9d None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:47.244376 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a92d1c-af79-479c-bc2a-33bd3dc50f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:47.312716 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-a5a92d1c-af79-479c-bc2a-33bd3dc50f9d None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:09:47.313917 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-a5a92d1c-af79-479c-bc2a-33bd3dc50f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:47.343148 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:47.415347 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 742/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 01:09:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:09:47.453082 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965275e-8253-4df5-a617-cedf78b2c853 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:09:47.454634 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-0965275e-8253-4df5-a617-cedf78b2c853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:47.564758 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965275e-8253-4df5-a617-cedf78b2c853 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:09:47.594719 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:47.642615 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac30ef-b12b-41fb-bef1-f3614c4556e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:09:47.643233 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac30ef-b12b-41fb-bef1-f3614c4556e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:47.643535 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac30ef-b12b-41fb-bef1-f3614c4556e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:47.643818 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac30ef-b12b-41fb-bef1-f3614c4556e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:47.645421 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-beac30ef-b12b-41fb-bef1-f3614c4556e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:47.762555 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beac30ef-b12b-41fb-bef1-f3614c4556e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:09:47.764027 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beac30ef-b12b-41fb-bef1-f3614c4556e5 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:09:47.781995 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 716/1458] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:09:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:09:49.838508 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef2767-80bf-4ebe-b6ca-295db4848305 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:49.839377 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef2767-80bf-4ebe-b6ca-295db4848305 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:49.839377 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef2767-80bf-4ebe-b6ca-295db4848305 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:49.841668 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 743/1459] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 01:09:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:09:49.848091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e14d6-3951-45bb-a693-ef29539579b9 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:49.848825 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e14d6-3951-45bb-a693-ef29539579b9 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:49.849116 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e14d6-3951-45bb-a693-ef29539579b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:49.921918 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-324e14d6-3951-45bb-a693-ef29539579b9 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:09:49.923145 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-324e14d6-3951-45bb-a693-ef29539579b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:49.936113 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:50.034780 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 717/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 01:09:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:09:50.074351 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef2767-80bf-4ebe-b6ca-295db4848305 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:09:50.076087 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-e3ef2767-80bf-4ebe-b6ca-295db4848305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:50.200050 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef2767-80bf-4ebe-b6ca-295db4848305 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:09:50.260558 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:50.282056 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950742e-f1dd-4f7d-b029-91cf9db17168 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:09:50.282666 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950742e-f1dd-4f7d-b029-91cf9db17168 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:50.282969 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950742e-f1dd-4f7d-b029-91cf9db17168 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:50.283235 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950742e-f1dd-4f7d-b029-91cf9db17168 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:50.284908 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-9950742e-f1dd-4f7d-b029-91cf9db17168 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:50.400115 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9950742e-f1dd-4f7d-b029-91cf9db17168 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:09:50.401688 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9950742e-f1dd-4f7d-b029-91cf9db17168 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:09:50.419874 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 744/1461] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:09:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:09:52.442924 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f2370-3a4a-4c26-bf2b-9d0ad294b7b9 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:52.443555 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f2370-3a4a-4c26-bf2b-9d0ad294b7b9 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:52.443555 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f2370-3a4a-4c26-bf2b-9d0ad294b7b9 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:52.444984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 718/1462] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 01:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:09:52.451754 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fadbe-b738-4301-a824-3fd18b9dfc88 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:52.452480 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fadbe-b738-4301-a824-3fd18b9dfc88 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:52.452682 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fadbe-b738-4301-a824-3fd18b9dfc88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:52.528940 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-146fadbe-b738-4301-a824-3fd18b9dfc88 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:09:52.530153 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-146fadbe-b738-4301-a824-3fd18b9dfc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:52.567976 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:52.628248 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 745/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 01:09:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:09:52.669233 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f2370-3a4a-4c26-bf2b-9d0ad294b7b9 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:09:52.671681 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-a61f2370-3a4a-4c26-bf2b-9d0ad294b7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:52.797617 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f2370-3a4a-4c26-bf2b-9d0ad294b7b9 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:09:52.837105 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:52.875214 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf9cce-189c-483c-ab6b-a0d186d17613 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:09:52.875865 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf9cce-189c-483c-ab6b-a0d186d17613 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:52.876147 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf9cce-189c-483c-ab6b-a0d186d17613 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:52.876414 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf9cce-189c-483c-ab6b-a0d186d17613 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:52.878045 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-6ecf9cce-189c-483c-ab6b-a0d186d17613 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:52.992214 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecf9cce-189c-483c-ab6b-a0d186d17613 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:09:52.993575 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecf9cce-189c-483c-ab6b-a0d186d17613 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:09:53.012080 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 719/1464] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:09:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:09:55.007478 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df5e63-226c-4677-9cbf-222b115f386e None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:55.008096 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df5e63-226c-4677-9cbf-222b115f386e None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:55.008096 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df5e63-226c-4677-9cbf-222b115f386e None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:55.009429 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 746/1465] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 01:09:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:09:55.015014 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d78e4-e65f-4e68-9079-1121ddcd50bc None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:55.015602 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d78e4-e65f-4e68-9079-1121ddcd50bc None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:55.015602 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d78e4-e65f-4e68-9079-1121ddcd50bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:55.082315 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-310d78e4-e65f-4e68-9079-1121ddcd50bc None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:09:55.083559 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-310d78e4-e65f-4e68-9079-1121ddcd50bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:55.101401 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:55.182787 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 720/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 01:09:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:09:55.222401 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df5e63-226c-4677-9cbf-222b115f386e None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:09:55.224028 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-08df5e63-226c-4677-9cbf-222b115f386e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:55.332693 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df5e63-226c-4677-9cbf-222b115f386e None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:09:55.400908 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:55.408439 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46886ce0-71e9-47c4-878a-3c91ece5dc5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:09:55.409067 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46886ce0-71e9-47c4-878a-3c91ece5dc5d service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:55.409335 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46886ce0-71e9-47c4-878a-3c91ece5dc5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:55.409599 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46886ce0-71e9-47c4-878a-3c91ece5dc5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:55.411228 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-46886ce0-71e9-47c4-878a-3c91ece5dc5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:55.522411 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46886ce0-71e9-47c4-878a-3c91ece5dc5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:09:55.523881 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46886ce0-71e9-47c4-878a-3c91ece5dc5d service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:09:55.542036 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 747/1467] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:09:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:09:57.585859 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2beb9-8d89-44c2-842d-c46ded01ad96 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:57.586448 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2beb9-8d89-44c2-842d-c46ded01ad96 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:57.586448 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2beb9-8d89-44c2-842d-c46ded01ad96 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:57.587746 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 721/1468] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 01:09:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:09:57.594177 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea33b44-d4ab-4ffc-8c53-1db2a1cce5bf None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:57.594617 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea33b44-d4ab-4ffc-8c53-1db2a1cce5bf None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:57.594733 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea33b44-d4ab-4ffc-8c53-1db2a1cce5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:57.670946 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-fea33b44-d4ab-4ffc-8c53-1db2a1cce5bf None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:09:57.672175 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-fea33b44-d4ab-4ffc-8c53-1db2a1cce5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:57.720819 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:57.775901 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 748/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 01:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:09:57.815039 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2beb9-8d89-44c2-842d-c46ded01ad96 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:09:57.816643 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-bfe2beb9-8d89-44c2-842d-c46ded01ad96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:57.923852 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2beb9-8d89-44c2-842d-c46ded01ad96 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:09:57.974661 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:58.002655 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e704af25-9f5c-4998-882a-b604e417f9a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:09:58.003282 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704af25-9f5c-4998-882a-b604e417f9a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:58.003556 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704af25-9f5c-4998-882a-b604e417f9a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:58.003847 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704af25-9f5c-4998-882a-b604e417f9a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:58.005453 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-e704af25-9f5c-4998-882a-b604e417f9a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:58.118133 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e704af25-9f5c-4998-882a-b604e417f9a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:09:58.119596 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e704af25-9f5c-4998-882a-b604e417f9a0 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:09:58.138303 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 722/1470] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:09:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:10:07.773742 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=22 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:08.135706 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=66 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:17.604851 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaede1b-2e85-4932-9461-23a1eee9ba8b None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:17.605448 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaede1b-2e85-4932-9461-23a1eee9ba8b None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:17.605448 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaede1b-2e85-4932-9461-23a1eee9ba8b None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:17.606806 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 749/1471] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:10:17.613431 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d88172-4e26-4ea8-baee-896fe9eaca36 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:17.613902 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d88172-4e26-4ea8-baee-896fe9eaca36 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:17.614000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d88172-4e26-4ea8-baee-896fe9eaca36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:17.698844 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-e4d88172-4e26-4ea8-baee-896fe9eaca36 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:10:17.700082 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-e4d88172-4e26-4ea8-baee-896fe9eaca36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:17.803585 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 723/1472] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:10:17.890333 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099874aa-48fc-4edd-b1aa-9a406ffb2905 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:17.890681 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099874aa-48fc-4edd-b1aa-9a406ffb2905 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:17.891010 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099874aa-48fc-4edd-b1aa-9a406ffb2905 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:17.892482 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 750/1473] 10.222.0.60 () {54 vars in 966 bytes} [Sun Jul 31 01:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:10:17.897929 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569cfa8-6d62-4432-a39b-624a4754c6a6 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:17.898214 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569cfa8-6d62-4432-a39b-624a4754c6a6 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:17.898486 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569cfa8-6d62-4432-a39b-624a4754c6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:17.978766 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-3569cfa8-6d62-4432-a39b-624a4754c6a6 None None] MFA Rules not processed for user `fdebcb0a2a7548a09b3e9d3cf085e40e`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:10:17.979964 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-3569cfa8-6d62-4432-a39b-624a4754c6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:18.002591 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:18.060224 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 724/1474] 10.222.0.60 () {58 vars in 1063 bytes} [Sun Jul 31 01:10:17 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:10:18.068198 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099874aa-48fc-4edd-b1aa-9a406ffb2905 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:10:18.069780 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-099874aa-48fc-4edd-b1aa-9a406ffb2905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:18.176414 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099874aa-48fc-4edd-b1aa-9a406ffb2905 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:10:18.251280 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20e1c1-3f4c-4be3-934f-4038ae4238fc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdebcb0a2a7548a09b3e9d3cf085e40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:10:18.251873 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20e1c1-3f4c-4be3-934f-4038ae4238fc service glance] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:18.252127 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20e1c1-3f4c-4be3-934f-4038ae4238fc service glance] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:18.252409 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20e1c1-3f4c-4be3-934f-4038ae4238fc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:18.253990 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-4e20e1c1-3f4c-4be3-934f-4038ae4238fc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:18.306154 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:18.369007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e20e1c1-3f4c-4be3-934f-4038ae4238fc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:10:18.370603 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e20e1c1-3f4c-4be3-934f-4038ae4238fc service glance] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:10:18.391677 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 751/1475] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:10:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:10:20.532810 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354defb8-80a6-40c9-a5ba-93266f01a85f None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:20.533653 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354defb8-80a6-40c9-a5ba-93266f01a85f None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:20.533653 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354defb8-80a6-40c9-a5ba-93266f01a85f None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:20.535843 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 725/1476] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:10:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:10:20.543667 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fa504-9f9c-4929-a253-6914b55d571e None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:20.544117 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fa504-9f9c-4929-a253-6914b55d571e None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:20.544222 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fa504-9f9c-4929-a253-6914b55d571e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:20.612878 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-f77fa504-9f9c-4929-a253-6914b55d571e None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:10:20.614109 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-f77fa504-9f9c-4929-a253-6914b55d571e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:20.714342 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 752/1477] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:10:20.737601 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354defb8-80a6-40c9-a5ba-93266f01a85f None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:10:20.739141 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-354defb8-80a6-40c9-a5ba-93266f01a85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:20.875984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354defb8-80a6-40c9-a5ba-93266f01a85f None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:10:20.927628 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:20.974687 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab114e-f62e-42fc-a652-bead7b3c7df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:10:20.975318 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab114e-f62e-42fc-a652-bead7b3c7df1 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:20.975627 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab114e-f62e-42fc-a652-bead7b3c7df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:20.975897 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab114e-f62e-42fc-a652-bead7b3c7df1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:20.976596 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ab114e-f62e-42fc-a652-bead7b3c7df1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:10:20.978329 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: WARNING py.warnings [None req-34ab114e-f62e-42fc-a652-bead7b3c7df1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:10:20.978329 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: warnings.warn(msg) Jul 31 01:10:20.978329 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: Jul 31 01:10:20.979479 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ab114e-f62e-42fc-a652-bead7b3c7df1 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:10:21.000086 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 726/1478] 10.222.0.60 () {56 vars in 1108 bytes} [Sun Jul 31 01:10:20 2022] GET /identity/v3/projects => generated 2553 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:10:23.013469 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75469a93-48a0-4093-9d97-f46c2fadeca0 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:23.014010 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75469a93-48a0-4093-9d97-f46c2fadeca0 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:23.014010 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75469a93-48a0-4093-9d97-f46c2fadeca0 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:23.015273 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 753/1479] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:10:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:10:23.021961 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664cec04-24ff-4df5-a37c-1dab1e202ad6 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:23.022695 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664cec04-24ff-4df5-a37c-1dab1e202ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:23.022852 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664cec04-24ff-4df5-a37c-1dab1e202ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:23.100157 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-664cec04-24ff-4df5-a37c-1dab1e202ad6 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:10:23.101391 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-664cec04-24ff-4df5-a37c-1dab1e202ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:23.208412 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 727/1480] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:10:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:10:23.251942 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75469a93-48a0-4093-9d97-f46c2fadeca0 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:10:23.253414 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-75469a93-48a0-4093-9d97-f46c2fadeca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:23.264983 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:23.402595 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75469a93-48a0-4093-9d97-f46c2fadeca0 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:10:23.483973 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:23.520718 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6390cb-8019-4628-96a1-cd64b1c39a38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:10:23.521261 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6390cb-8019-4628-96a1-cd64b1c39a38 service nova] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:23.521532 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6390cb-8019-4628-96a1-cd64b1c39a38 service nova] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:23.521801 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6390cb-8019-4628-96a1-cd64b1c39a38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:23.523455 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-8a6390cb-8019-4628-96a1-cd64b1c39a38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:23.622710 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6390cb-8019-4628-96a1-cd64b1c39a38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:10:23.624338 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6390cb-8019-4628-96a1-cd64b1c39a38 service nova] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:10:23.643094 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 754/1481] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:10:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:10:25.798594 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142db9de-ead4-43fb-9fea-86829c4f7dbd None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:25.799534 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142db9de-ead4-43fb-9fea-86829c4f7dbd None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:25.799534 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142db9de-ead4-43fb-9fea-86829c4f7dbd None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:25.801672 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 728/1482] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:10:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:10:25.810538 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9500c5-de8b-433a-9d51-66d3eff79a19 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:25.811306 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9500c5-de8b-433a-9d51-66d3eff79a19 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:25.811468 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9500c5-de8b-433a-9d51-66d3eff79a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:25.895506 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-7f9500c5-de8b-433a-9d51-66d3eff79a19 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:10:25.896745 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-7f9500c5-de8b-433a-9d51-66d3eff79a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:25.944526 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:26.005501 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 755/1483] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:10:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:10:26.042036 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142db9de-ead4-43fb-9fea-86829c4f7dbd None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:10:26.043623 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-142db9de-ead4-43fb-9fea-86829c4f7dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:26.070830 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:26.157119 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142db9de-ead4-43fb-9fea-86829c4f7dbd None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:10:26.240273 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e491db-6acf-4190-9ec0-7a2689f7f1c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:10:26.241117 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e491db-6acf-4190-9ec0-7a2689f7f1c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:26.241531 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e491db-6acf-4190-9ec0-7a2689f7f1c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:26.241805 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e491db-6acf-4190-9ec0-7a2689f7f1c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:26.244350 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-85e491db-6acf-4190-9ec0-7a2689f7f1c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:26.329789 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:26.368101 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e491db-6acf-4190-9ec0-7a2689f7f1c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:10:26.369723 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e491db-6acf-4190-9ec0-7a2689f7f1c6 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:10:26.388793 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 729/1484] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:10:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:10:28.418442 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28195081-583e-4dcb-ba0e-e5b4a0b076d0 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:28.419169 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28195081-583e-4dcb-ba0e-e5b4a0b076d0 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:28.419169 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28195081-583e-4dcb-ba0e-e5b4a0b076d0 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:28.420370 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 756/1485] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:10:28.426977 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aacf48e-a863-496c-b2dd-24d48c8f20e8 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:28.427608 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aacf48e-a863-496c-b2dd-24d48c8f20e8 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:28.427608 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aacf48e-a863-496c-b2dd-24d48c8f20e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:28.499170 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-1aacf48e-a863-496c-b2dd-24d48c8f20e8 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:10:28.500826 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-1aacf48e-a863-496c-b2dd-24d48c8f20e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:28.603240 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 730/1486] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:10:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:10:28.642417 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28195081-583e-4dcb-ba0e-e5b4a0b076d0 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:10:28.644118 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-28195081-583e-4dcb-ba0e-e5b4a0b076d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:28.752938 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28195081-583e-4dcb-ba0e-e5b4a0b076d0 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:10:28.838793 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:28.840848 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d6848-ac98-4e20-992a-24af133a90bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:10:28.841566 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d6848-ac98-4e20-992a-24af133a90bc service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:28.841856 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d6848-ac98-4e20-992a-24af133a90bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:28.842133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d6848-ac98-4e20-992a-24af133a90bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:28.844631 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-d71d6848-ac98-4e20-992a-24af133a90bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:28.957700 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d6848-ac98-4e20-992a-24af133a90bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:10:28.959084 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d6848-ac98-4e20-992a-24af133a90bc service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:10:28.977822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 757/1487] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:10:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:10:31.116518 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10726d-f287-4f61-b8c1-8ba7fb66586b None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:31.117464 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10726d-f287-4f61-b8c1-8ba7fb66586b None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:31.117464 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10726d-f287-4f61-b8c1-8ba7fb66586b None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:31.119641 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 731/1488] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:10:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:10:31.125471 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd016af-6416-4a93-9ba5-0bf8d389038d None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:31.125916 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd016af-6416-4a93-9ba5-0bf8d389038d None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:31.126018 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd016af-6416-4a93-9ba5-0bf8d389038d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:31.199416 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-3cd016af-6416-4a93-9ba5-0bf8d389038d None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:10:31.200663 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-3cd016af-6416-4a93-9ba5-0bf8d389038d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:31.254680 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:31.300158 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 758/1489] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:10:31.348338 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10726d-f287-4f61-b8c1-8ba7fb66586b None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:10:31.349880 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-bb10726d-f287-4f61-b8c1-8ba7fb66586b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:31.389377 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:31.460328 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10726d-f287-4f61-b8c1-8ba7fb66586b None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:10:31.542618 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4b2d6-9b49-4ff2-9435-1eaee6752be7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:10:31.543258 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4b2d6-9b49-4ff2-9435-1eaee6752be7 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:31.543514 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4b2d6-9b49-4ff2-9435-1eaee6752be7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:31.543824 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4b2d6-9b49-4ff2-9435-1eaee6752be7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:31.545451 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-bde4b2d6-9b49-4ff2-9435-1eaee6752be7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:31.630066 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:31.661482 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde4b2d6-9b49-4ff2-9435-1eaee6752be7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:10:31.662930 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde4b2d6-9b49-4ff2-9435-1eaee6752be7 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:10:31.681136 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 732/1490] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:10:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:10:33.936560 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414c1a9-0f7b-45f0-a39d-2169e94cd8ce None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:33.937507 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414c1a9-0f7b-45f0-a39d-2169e94cd8ce None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:33.937507 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414c1a9-0f7b-45f0-a39d-2169e94cd8ce None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:33.939512 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 759/1491] 10.222.0.60 () {54 vars in 926 bytes} [Sun Jul 31 01:10:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:10:33.947885 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3151f1-ce14-4f92-9ea0-25029b7b25c8 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:33.948344 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3151f1-ce14-4f92-9ea0-25029b7b25c8 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:33.948568 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3151f1-ce14-4f92-9ea0-25029b7b25c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:34.023002 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-1a3151f1-ce14-4f92-9ea0-25029b7b25c8 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:10:34.024257 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-1a3151f1-ce14-4f92-9ea0-25029b7b25c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:34.128740 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 733/1492] 10.222.0.60 () {58 vars in 1023 bytes} [Sun Jul 31 01:10:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:10:34.170258 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414c1a9-0f7b-45f0-a39d-2169e94cd8ce None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:10:34.172744 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-e414c1a9-0f7b-45f0-a39d-2169e94cd8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:34.290876 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414c1a9-0f7b-45f0-a39d-2169e94cd8ce None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:10:34.367572 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e19e0d-e923-40ae-b333-764ad957ae3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:10:34.368534 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e19e0d-e923-40ae-b333-764ad957ae3f service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:34.368924 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e19e0d-e923-40ae-b333-764ad957ae3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:34.369297 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e19e0d-e923-40ae-b333-764ad957ae3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:34.371832 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-22e19e0d-e923-40ae-b333-764ad957ae3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:34.381951 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:34.487450 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e19e0d-e923-40ae-b333-764ad957ae3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:10:34.488922 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e19e0d-e923-40ae-b333-764ad957ae3f service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:10:34.514384 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 760/1493] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:10:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:10:44.126994 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=82 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:44.510422 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=50 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:01.891694 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2653d-9c6e-42c9-933b-4a8d4f6cf669 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:01.892311 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2653d-9c6e-42c9-933b-4a8d4f6cf669 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:01.892311 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2653d-9c6e-42c9-933b-4a8d4f6cf669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:01.979664 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-29e2653d-9c6e-42c9-933b-4a8d4f6cf669 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:12:01.980938 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-29e2653d-9c6e-42c9-933b-4a8d4f6cf669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:02.095507 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 734/1494] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:12:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:12:02.104256 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35d1cd-5b02-4176-8459-697211aa3ea1 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:02.104772 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35d1cd-5b02-4176-8459-697211aa3ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:02.104870 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35d1cd-5b02-4176-8459-697211aa3ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:02.191802 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-8b35d1cd-5b02-4176-8459-697211aa3ea1 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:12:02.193034 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-8b35d1cd-5b02-4176-8459-697211aa3ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:02.299133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 761/1495] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:12:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:12:02.304118 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2653d-9c6e-42c9-933b-4a8d4f6cf669 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:02.305390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-29e2653d-9c6e-42c9-933b-4a8d4f6cf669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:02.317241 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2653d-9c6e-42c9-933b-4a8d4f6cf669 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:02.382275 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:02.421501 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584e7bf-91a9-4049-a83f-90136ae9e929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:02.422172 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584e7bf-91a9-4049-a83f-90136ae9e929 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:02.422449 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584e7bf-91a9-4049-a83f-90136ae9e929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:02.422716 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584e7bf-91a9-4049-a83f-90136ae9e929 admin admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:02.423426 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2584e7bf-91a9-4049-a83f-90136ae9e929 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:12:02.423764 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2584e7bf-91a9-4049-a83f-90136ae9e929 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:02.424850 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: WARNING py.warnings [None req-2584e7bf-91a9-4049-a83f-90136ae9e929 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:12:02.424850 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: warnings.warn(msg) Jul 31 01:12:02.424850 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: Jul 31 01:12:02.425725 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2584e7bf-91a9-4049-a83f-90136ae9e929 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:02.444231 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 735/1496] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:12:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:12:02.453002 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35d1cd-5b02-4176-8459-697211aa3ea1 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:02.462336 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35d1cd-5b02-4176-8459-697211aa3ea1 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:02.527864 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:02.562077 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d819ec9-44f9-4fe3-b144-5af7ac4d32a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:02.562696 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d819ec9-44f9-4fe3-b144-5af7ac4d32a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:02.562970 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d819ec9-44f9-4fe3-b144-5af7ac4d32a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:02.563259 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d819ec9-44f9-4fe3-b144-5af7ac4d32a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:02.563951 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d819ec9-44f9-4fe3-b144-5af7ac4d32a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:02.565695 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: WARNING py.warnings [None req-5d819ec9-44f9-4fe3-b144-5af7ac4d32a0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:12:02.565695 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: warnings.warn(msg) Jul 31 01:12:02.565695 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: Jul 31 01:12:02.566883 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d819ec9-44f9-4fe3-b144-5af7ac4d32a0 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:02.624732 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 762/1497] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:12:02 2022] POST /identity/v3/projects => generated 379 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:12:02.629449 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584e7bf-91a9-4049-a83f-90136ae9e929 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:02.630997 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-2584e7bf-91a9-4049-a83f-90136ae9e929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:02.664117 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584e7bf-91a9-4049-a83f-90136ae9e929 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:02.768575 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa7f09-d986-462a-b313-50cf29672247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:02.769203 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa7f09-d986-462a-b313-50cf29672247 admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:02.769482 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa7f09-d986-462a-b313-50cf29672247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:02.769730 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa7f09-d986-462a-b313-50cf29672247 admin admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:02.770400 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaa7f09-d986-462a-b313-50cf29672247 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:02.771419 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: WARNING py.warnings [None req-4aaa7f09-d986-462a-b313-50cf29672247 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:12:02.771419 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: warnings.warn(msg) Jul 31 01:12:02.771419 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: Jul 31 01:12:02.772651 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaa7f09-d986-462a-b313-50cf29672247 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:02.816889 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 736/1498] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:12:02 2022] POST /identity/v3/users => generated 290 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:12:02.821311 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d819ec9-44f9-4fe3-b144-5af7ac4d32a0 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:02.822870 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-5d819ec9-44f9-4fe3-b144-5af7ac4d32a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:02.884807 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d819ec9-44f9-4fe3-b144-5af7ac4d32a0 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:02.970930 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:02.983037 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df949ef-a1d0-4fd5-88c7-ebcde37ee3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:02.983695 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df949ef-a1d0-4fd5-88c7-ebcde37ee3be admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:02.983969 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df949ef-a1d0-4fd5-88c7-ebcde37ee3be admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:02.984220 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df949ef-a1d0-4fd5-88c7-ebcde37ee3be admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:02.984907 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df949ef-a1d0-4fd5-88c7-ebcde37ee3be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:02.985928 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: WARNING py.warnings [None req-5df949ef-a1d0-4fd5-88c7-ebcde37ee3be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:12:02.985928 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: warnings.warn(msg) Jul 31 01:12:02.985928 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: Jul 31 01:12:02.986810 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df949ef-a1d0-4fd5-88c7-ebcde37ee3be admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:03.002125 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 763/1499] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:12:03.006401 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa7f09-d986-462a-b313-50cf29672247 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:03.008005 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-4aaa7f09-d986-462a-b313-50cf29672247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:03.022146 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa7f09-d986-462a-b313-50cf29672247 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:03.049868 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:03.123863 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3107c-038d-4271-8ae1-4a114519ccff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:03.124493 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3107c-038d-4271-8ae1-4a114519ccff admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:03.124770 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3107c-038d-4271-8ae1-4a114519ccff admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:03.125041 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3107c-038d-4271-8ae1-4a114519ccff admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:03.126112 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3107c-038d-4271-8ae1-4a114519ccff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:03.127158 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: WARNING py.warnings [None req-6de3107c-038d-4271-8ae1-4a114519ccff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:12:03.127158 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: warnings.warn(msg) Jul 31 01:12:03.127158 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: Jul 31 01:12:03.128074 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3107c-038d-4271-8ae1-4a114519ccff admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:03.141112 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 737/1500] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:12:03.145585 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df949ef-a1d0-4fd5-88c7-ebcde37ee3be admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:03.147159 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-5df949ef-a1d0-4fd5-88c7-ebcde37ee3be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:03.182216 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df949ef-a1d0-4fd5-88c7-ebcde37ee3be admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:03.282044 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e6e5d2-61d3-4738-afd7-43934d511c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:03.282723 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e6e5d2-61d3-4738-afd7-43934d511c2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:03.282995 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e6e5d2-61d3-4738-afd7-43934d511c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:03.283267 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e6e5d2-61d3-4738-afd7-43934d511c2c admin admin] PATH_INFO: `/v3/projects/41e6548112244070be96b58b4f0bb54a/users/eaad26efa28642ad995317325f7472ea/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:03.305962 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e6e5d2-61d3-4738-afd7-43934d511c2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=41e6548112244070be96b58b4f0bb54a, user_id=eaad26efa28642ad995317325f7472ea, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:03.306995 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: WARNING py.warnings [None req-38e6e5d2-61d3-4738-afd7-43934d511c2c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:12:03.306995 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: warnings.warn(msg) Jul 31 01:12:03.306995 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: Jul 31 01:12:03.308969 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e6e5d2-61d3-4738-afd7-43934d511c2c admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:03.343280 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 764/1501] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:12:03 2022] PUT /identity/v3/projects/41e6548112244070be96b58b4f0bb54a/users/eaad26efa28642ad995317325f7472ea/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:12:03.356151 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96a32f-2800-4ca4-a794-cd1d77653cba None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:03.356427 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96a32f-2800-4ca4-a794-cd1d77653cba None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:03.356714 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96a32f-2800-4ca4-a794-cd1d77653cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:03.421240 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-9b96a32f-2800-4ca4-a794-cd1d77653cba None None] MFA Rules not processed for user `eaad26efa28642ad995317325f7472ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:12:03.422375 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-9b96a32f-2800-4ca4-a794-cd1d77653cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:03.501756 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 738/1502] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:12:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:12:03.516194 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca93dff-2c93-4b66-a00c-dfc74fc90f4c None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:03.516473 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca93dff-2c93-4b66-a00c-dfc74fc90f4c None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:03.516741 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca93dff-2c93-4b66-a00c-dfc74fc90f4c None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:03.518102 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 765/1503] 10.222.0.60 () {54 vars in 964 bytes} [Sun Jul 31 01:12:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:12:03.523250 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82016a8-b64a-4fe3-a64a-b26d4aef7506 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:03.523544 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82016a8-b64a-4fe3-a64a-b26d4aef7506 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:03.523855 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82016a8-b64a-4fe3-a64a-b26d4aef7506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:03.557851 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:03.604364 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-e82016a8-b64a-4fe3-a64a-b26d4aef7506 None None] MFA Rules not processed for user `a1943ab629b6411d81327a845b77c8c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:12:03.605613 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-e82016a8-b64a-4fe3-a64a-b26d4aef7506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:03.685671 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 739/1504] 10.222.0.60 () {58 vars in 1061 bytes} [Sun Jul 31 01:12:03 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:12:03.694245 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca93dff-2c93-4b66-a00c-dfc74fc90f4c None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:03.695881 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-eca93dff-2c93-4b66-a00c-dfc74fc90f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:03.753798 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:03.814592 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca93dff-2c93-4b66-a00c-dfc74fc90f4c None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:03.894361 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76c488-c824-4f32-9cd0-e3f16db26016 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1943ab629b6411d81327a845b77c8c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:03.894956 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76c488-c824-4f32-9cd0-e3f16db26016 service cinder] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:03.895252 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76c488-c824-4f32-9cd0-e3f16db26016 service cinder] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:03.895522 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76c488-c824-4f32-9cd0-e3f16db26016 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:03.897153 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-6d76c488-c824-4f32-9cd0-e3f16db26016 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:04.008040 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d76c488-c824-4f32-9cd0-e3f16db26016 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:04.009495 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d76c488-c824-4f32-9cd0-e3f16db26016 service cinder] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:04.013118 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:04.028626 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 766/1505] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:12:03 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:12:04.076781 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c0c27-e4af-4804-b63a-a613a69904fa None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:04.077215 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c0c27-e4af-4804-b63a-a613a69904fa None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:04.077322 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c0c27-e4af-4804-b63a-a613a69904fa None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:04.078599 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 740/1506] 10.222.0.60 () {52 vars in 830 bytes} [Sun Jul 31 01:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:12:04.082460 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76c488-c824-4f32-9cd0-e3f16db26016 service cinder] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:04.083716 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-6d76c488-c824-4f32-9cd0-e3f16db26016 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:04.194807 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76c488-c824-4f32-9cd0-e3f16db26016 service cinder] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:04.296741 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a326ba47-7d63-4fbe-a373-dccf7dcf53c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:04.297309 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326ba47-7d63-4fbe-a373-dccf7dcf53c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:04.297580 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326ba47-7d63-4fbe-a373-dccf7dcf53c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:04.297847 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326ba47-7d63-4fbe-a373-dccf7dcf53c9 admin admin] PATH_INFO: `/v3/users/eaad26efa28642ad995317325f7472ea` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:04.311157 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a326ba47-7d63-4fbe-a373-dccf7dcf53c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaad26efa28642ad995317325f7472ea)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:04.312240 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: WARNING py.warnings [None req-a326ba47-7d63-4fbe-a373-dccf7dcf53c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:12:04.312240 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: warnings.warn(msg) Jul 31 01:12:04.312240 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: Jul 31 01:12:04.313456 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a326ba47-7d63-4fbe-a373-dccf7dcf53c9 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:04.323646 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:04.390408 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-a326ba47-7d63-4fbe-a373-dccf7dcf53c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaad26efa28642ad995317325f7472ea'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:12:04.404505 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-a326ba47-7d63-4fbe-a373-dccf7dcf53c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaad26efa28642ad995317325f7472ea'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:12:04.405058 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-a326ba47-7d63-4fbe-a373-dccf7dcf53c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaad26efa28642ad995317325f7472ea'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:12:04.429119 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-a326ba47-7d63-4fbe-a373-dccf7dcf53c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaad26efa28642ad995317325f7472ea'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:12:04.429561 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-a326ba47-7d63-4fbe-a373-dccf7dcf53c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaad26efa28642ad995317325f7472ea'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:12:04.446597 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 767/1507] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:12:04 2022] DELETE /identity/v3/users/eaad26efa28642ad995317325f7472ea => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:12:04.451885 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca56f9-41cc-4cc5-b469-8c9a3ef7a210 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:04.452259 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca56f9-41cc-4cc5-b469-8c9a3ef7a210 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:04.452615 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca56f9-41cc-4cc5-b469-8c9a3ef7a210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:04.535076 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-05ca56f9-41cc-4cc5-b469-8c9a3ef7a210 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:12:04.536579 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-05ca56f9-41cc-4cc5-b469-8c9a3ef7a210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:04.619432 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:04.634318 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 741/1508] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:12:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:12:04.644550 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a326ba47-7d63-4fbe-a373-dccf7dcf53c9 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:04.645789 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-a326ba47-7d63-4fbe-a373-dccf7dcf53c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:04.760420 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a326ba47-7d63-4fbe-a373-dccf7dcf53c9 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:04.828362 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:04.852562 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb0acb3-f89d-48e7-ac96-58eb5eeec201 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:04.853206 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0acb3-f89d-48e7-ac96-58eb5eeec201 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:04.853480 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0acb3-f89d-48e7-ac96-58eb5eeec201 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:04.853749 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0acb3-f89d-48e7-ac96-58eb5eeec201 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:04.855552 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-6fb0acb3-f89d-48e7-ac96-58eb5eeec201 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:04.974966 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb0acb3-f89d-48e7-ac96-58eb5eeec201 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:04.976390 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb0acb3-f89d-48e7-ac96-58eb5eeec201 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:04.995279 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 768/1509] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:12:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:12:05.333239 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca56f9-41cc-4cc5-b469-8c9a3ef7a210 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:05.334474 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-05ca56f9-41cc-4cc5-b469-8c9a3ef7a210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:05.345941 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca56f9-41cc-4cc5-b469-8c9a3ef7a210 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:05.447650 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb369a16-fe16-471d-99f7-c53a2119a4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:05.448314 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb369a16-fe16-471d-99f7-c53a2119a4c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:05.448678 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb369a16-fe16-471d-99f7-c53a2119a4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:05.448947 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb369a16-fe16-471d-99f7-c53a2119a4c8 admin admin] PATH_INFO: `/v3/projects/41e6548112244070be96b58b4f0bb54a` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:05.459746 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb369a16-fe16-471d-99f7-c53a2119a4c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41e6548112244070be96b58b4f0bb54a)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:05.460784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: WARNING py.warnings [None req-fb369a16-fe16-471d-99f7-c53a2119a4c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:12:05.460784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: warnings.warn(msg) Jul 31 01:12:05.460784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: Jul 31 01:12:05.462016 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb369a16-fe16-471d-99f7-c53a2119a4c8 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:05.525008 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-fb369a16-fe16-471d-99f7-c53a2119a4c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41e6548112244070be96b58b4f0bb54a', 'request_id': 'req-fb369a16-fe16-471d-99f7-c53a2119a4c8'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:12:05.531654 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-fb369a16-fe16-471d-99f7-c53a2119a4c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41e6548112244070be96b58b4f0bb54a', 'request_id': 'req-fb369a16-fe16-471d-99f7-c53a2119a4c8'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:12:05.545385 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-fb369a16-fe16-471d-99f7-c53a2119a4c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41e6548112244070be96b58b4f0bb54a', 'request_id': 'req-fb369a16-fe16-471d-99f7-c53a2119a4c8'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:12:05.581463 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-fb369a16-fe16-471d-99f7-c53a2119a4c8 admin admin] The token cache is being invalidate because project 41e6548112244070be96b58b4f0bb54a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:12:05.581686 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-fb369a16-fe16-471d-99f7-c53a2119a4c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:12:05.582180 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-fb369a16-fe16-471d-99f7-c53a2119a4c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:12:05.583807 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 742/1510] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:12:05 2022] DELETE /identity/v3/projects/41e6548112244070be96b58b4f0bb54a => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:12:14.993152 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=62 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:15.579086 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:13:17.743260 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04139fc8-6289-424d-afd5-5357158275f3 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:13:17.743797 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04139fc8-6289-424d-afd5-5357158275f3 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:13:17.743797 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04139fc8-6289-424d-afd5-5357158275f3 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:13:17.745200 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 769/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 31 01:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:13:17.753920 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786259a-5240-4b74-9a16-7f0169fda7a5 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:13:17.754408 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786259a-5240-4b74-9a16-7f0169fda7a5 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:13:17.754521 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786259a-5240-4b74-9a16-7f0169fda7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:13:17.847367 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-d786259a-5240-4b74-9a16-7f0169fda7a5 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:13:17.848613 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-d786259a-5240-4b74-9a16-7f0169fda7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:13:17.961329 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 743/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 31 01:13:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:13:18.113250 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04139fc8-6289-424d-afd5-5357158275f3 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:13:18.115705 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-04139fc8-6289-424d-afd5-5357158275f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:13:18.235326 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04139fc8-6289-424d-afd5-5357158275f3 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:13:18.242006 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144da491-bcd3-48f0-a9a1-6a523f8d7e49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:13:18.242649 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144da491-bcd3-48f0-a9a1-6a523f8d7e49 service nova] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:13:18.242928 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144da491-bcd3-48f0-a9a1-6a523f8d7e49 service nova] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:13:18.243203 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144da491-bcd3-48f0-a9a1-6a523f8d7e49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:13:18.252839 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144da491-bcd3-48f0-a9a1-6a523f8d7e49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:13:18.254448 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144da491-bcd3-48f0-a9a1-6a523f8d7e49 service nova] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:13:18.264011 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 770/1513] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:13:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:13:19.095714 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f825bc-ad2b-4333-b619-d247dfe6ab35 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:13:19.096369 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f825bc-ad2b-4333-b619-d247dfe6ab35 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:13:19.096369 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f825bc-ad2b-4333-b619-d247dfe6ab35 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:13:19.097746 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 744/1514] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 31 01:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:13:19.102963 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67aadf7-5fe5-4b35-addf-7ba098b69375 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:13:19.103397 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67aadf7-5fe5-4b35-addf-7ba098b69375 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:13:19.103507 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67aadf7-5fe5-4b35-addf-7ba098b69375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:13:19.124558 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-c67aadf7-5fe5-4b35-addf-7ba098b69375 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:13:19.126142 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-c67aadf7-5fe5-4b35-addf-7ba098b69375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:13:19.135689 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 771/1515] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 31 01:13:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:13:19.288497 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f825bc-ad2b-4333-b619-d247dfe6ab35 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:13:19.305089 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f825bc-ad2b-4333-b619-d247dfe6ab35 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:13:19.312984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe16cb-e9cd-4fff-a283-6ab047bfc4b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:13:19.314023 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe16cb-e9cd-4fff-a283-6ab047bfc4b2 service nova] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:13:19.314384 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe16cb-e9cd-4fff-a283-6ab047bfc4b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:13:19.314769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe16cb-e9cd-4fff-a283-6ab047bfc4b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:13:19.325844 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe16cb-e9cd-4fff-a283-6ab047bfc4b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:13:19.327432 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe16cb-e9cd-4fff-a283-6ab047bfc4b2 service nova] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:13:19.337092 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 745/1516] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:13:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:13:24.080082 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af15b88-2fa2-456e-be63-542b41e6fd38 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:13:24.080585 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af15b88-2fa2-456e-be63-542b41e6fd38 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:13:24.080585 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af15b88-2fa2-456e-be63-542b41e6fd38 None None] PATH_INFO: `/v3` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:13:24.081946 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 772/1517] 10.222.0.70 () {54 vars in 925 bytes} [Sun Jul 31 01:13:24 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:13:24.089474 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad5a93-0a23-457d-9d70-d6ec88a5051e None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:13:24.089926 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad5a93-0a23-457d-9d70-d6ec88a5051e None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:13:24.090036 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad5a93-0a23-457d-9d70-d6ec88a5051e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:13:24.159256 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-04ad5a93-0a23-457d-9d70-d6ec88a5051e None None] MFA Rules not processed for user `657a3f73879e4b31b70a1c4f73e80f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:13:24.160510 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-04ad5a93-0a23-457d-9d70-d6ec88a5051e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:13:24.178925 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:13:24.236718 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 746/1518] 10.222.0.70 () {58 vars in 1015 bytes} [Sun Jul 31 01:13:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:13:29.119425 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=56 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:13:30.610119 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018928b1-b5d7-4fdc-bff7-a2ff5a823103 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:13:30.610807 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018928b1-b5d7-4fdc-bff7-a2ff5a823103 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:13:30.610807 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018928b1-b5d7-4fdc-bff7-a2ff5a823103 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:13:30.612032 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 773/1519] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 31 01:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:13:30.618071 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2461e7-9e0b-4409-835f-2eea0527c15e None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:13:30.618561 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2461e7-9e0b-4409-835f-2eea0527c15e None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:13:30.618561 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2461e7-9e0b-4409-835f-2eea0527c15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:13:30.641073 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-6b2461e7-9e0b-4409-835f-2eea0527c15e None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:13:30.642252 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-6b2461e7-9e0b-4409-835f-2eea0527c15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:13:30.652370 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 747/1520] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 31 01:13:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:13:30.811066 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018928b1-b5d7-4fdc-bff7-a2ff5a823103 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:13:30.826087 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018928b1-b5d7-4fdc-bff7-a2ff5a823103 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:13:30.831659 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0cd18-ba82-4c45-a287-c94d868592c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:13:30.832274 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0cd18-ba82-4c45-a287-c94d868592c1 service nova] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:13:30.832543 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0cd18-ba82-4c45-a287-c94d868592c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:13:30.832807 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0cd18-ba82-4c45-a287-c94d868592c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:13:30.841259 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a0cd18-ba82-4c45-a287-c94d868592c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:13:30.842830 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a0cd18-ba82-4c45-a287-c94d868592c1 service nova] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:13:30.852915 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 774/1521] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:13:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:13:31.668256 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56cf1b-f142-4462-963d-5f4e4d2ff08b None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:13:31.669123 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56cf1b-f142-4462-963d-5f4e4d2ff08b None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:13:31.669123 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56cf1b-f142-4462-963d-5f4e4d2ff08b None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:13:31.671332 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 748/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 31 01:13:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:13:31.676449 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bacfd-daf7-4612-99fb-6d234983d6a4 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:13:31.676897 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bacfd-daf7-4612-99fb-6d234983d6a4 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:13:31.677008 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bacfd-daf7-4612-99fb-6d234983d6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:13:31.698410 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-cb4bacfd-daf7-4612-99fb-6d234983d6a4 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:13:31.699656 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-cb4bacfd-daf7-4612-99fb-6d234983d6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:13:31.709175 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 775/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 31 01:13:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:13:31.861193 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56cf1b-f142-4462-963d-5f4e4d2ff08b None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:13:31.880400 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56cf1b-f142-4462-963d-5f4e4d2ff08b None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:13:31.886348 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb41ea-101e-4611-9774-80e1ab212713 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:13:31.886963 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb41ea-101e-4611-9774-80e1ab212713 service nova] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:13:31.887227 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb41ea-101e-4611-9774-80e1ab212713 service nova] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:13:31.887513 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb41ea-101e-4611-9774-80e1ab212713 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:13:31.896270 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb41ea-101e-4611-9774-80e1ab212713 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:13:31.897861 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb41ea-101e-4611-9774-80e1ab212713 service nova] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:13:31.907736 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 749/1524] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:13:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:13:32.736196 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f315fb-1a21-457e-9411-5ea7ca454bca None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:13:32.737121 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f315fb-1a21-457e-9411-5ea7ca454bca None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:13:32.737121 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f315fb-1a21-457e-9411-5ea7ca454bca None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:13:32.739183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 776/1525] 10.222.0.60 () {54 vars in 961 bytes} [Sun Jul 31 01:13:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:13:32.745955 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013350a7-9233-4fe8-9713-346d1f16f778 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:13:32.746379 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013350a7-9233-4fe8-9713-346d1f16f778 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:13:32.746488 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013350a7-9233-4fe8-9713-346d1f16f778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:13:32.767504 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-013350a7-9233-4fe8-9713-346d1f16f778 None None] MFA Rules not processed for user `657a3f73879e4b31b70a1c4f73e80f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:13:32.768810 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-013350a7-9233-4fe8-9713-346d1f16f778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:13:32.782220 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 750/1526] 10.222.0.60 () {58 vars in 1058 bytes} [Sun Jul 31 01:13:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:13:32.794085 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f315fb-1a21-457e-9411-5ea7ca454bca None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:13:32.815664 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f315fb-1a21-457e-9411-5ea7ca454bca None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:13:32.822325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c81c3e-34e1-494c-a50c-34d0f827b39b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:13:32.823013 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c81c3e-34e1-494c-a50c-34d0f827b39b service placement] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:13:32.823292 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c81c3e-34e1-494c-a50c-34d0f827b39b service placement] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:13:32.823622 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c81c3e-34e1-494c-a50c-34d0f827b39b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:13:32.832586 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c81c3e-34e1-494c-a50c-34d0f827b39b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:13:32.834168 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c81c3e-34e1-494c-a50c-34d0f827b39b service placement] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:13:32.844098 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 777/1527] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:13:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:13:35.780357 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ad48e-cf92-413e-a80c-3ffde435534f None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:13:35.780986 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ad48e-cf92-413e-a80c-3ffde435534f None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:13:35.780986 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ad48e-cf92-413e-a80c-3ffde435534f None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:13:35.782291 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 751/1528] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 01:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:13:35.788759 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43c752-83ca-4d49-8580-23b7bd71403a None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:13:35.789532 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43c752-83ca-4d49-8580-23b7bd71403a None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:13:35.789708 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43c752-83ca-4d49-8580-23b7bd71403a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:13:35.812712 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-ca43c752-83ca-4d49-8580-23b7bd71403a None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:13:35.813883 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-ca43c752-83ca-4d49-8580-23b7bd71403a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:13:35.822966 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 778/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 01:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:13:35.900339 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ad48e-cf92-413e-a80c-3ffde435534f None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:13:35.902888 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-ae4ad48e-cf92-413e-a80c-3ffde435534f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:13:35.989495 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ad48e-cf92-413e-a80c-3ffde435534f None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:13:35.993942 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa49c7-d93a-4a03-85c9-ab283a5b3650 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:13:35.994559 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa49c7-d93a-4a03-85c9-ab283a5b3650 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:13:35.994828 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa49c7-d93a-4a03-85c9-ab283a5b3650 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:13:35.995102 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa49c7-d93a-4a03-85c9-ab283a5b3650 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:13:36.005617 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfa49c7-d93a-4a03-85c9-ab283a5b3650 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:13:36.007050 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfa49c7-d93a-4a03-85c9-ab283a5b3650 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:13:36.016650 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 752/1530] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:13:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:13:37.987986 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba1b30-1db8-4f29-988b-502221d5f3ac None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:13:37.988627 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba1b30-1db8-4f29-988b-502221d5f3ac None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:13:37.988627 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba1b30-1db8-4f29-988b-502221d5f3ac None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:13:37.989891 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 779/1531] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 01:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:13:37.996415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281dbe5-0be5-40d9-93b3-206c813598b0 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:13:37.997151 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281dbe5-0be5-40d9-93b3-206c813598b0 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:13:37.997294 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281dbe5-0be5-40d9-93b3-206c813598b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:13:38.027322 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-6281dbe5-0be5-40d9-93b3-206c813598b0 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:13:38.028552 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-6281dbe5-0be5-40d9-93b3-206c813598b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:13:38.037320 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 753/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 01:13:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:13:38.073927 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba1b30-1db8-4f29-988b-502221d5f3ac None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:13:38.089000 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba1b30-1db8-4f29-988b-502221d5f3ac None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:13:38.093185 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf1503-abea-4b32-93ee-9df7d9d06ba6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:13:38.093804 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf1503-abea-4b32-93ee-9df7d9d06ba6 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:13:38.094083 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf1503-abea-4b32-93ee-9df7d9d06ba6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:13:38.094351 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf1503-abea-4b32-93ee-9df7d9d06ba6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:13:38.103850 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf1503-abea-4b32-93ee-9df7d9d06ba6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:13:38.105282 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf1503-abea-4b32-93ee-9df7d9d06ba6 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:13:38.115436 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 780/1533] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:13:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:13:48.021275 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=73 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:13:48.110650 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=24 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:14:55.968993 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803b58b-6f58-4cda-99dd-2704399eb221 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:55.969681 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803b58b-6f58-4cda-99dd-2704399eb221 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:55.969681 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803b58b-6f58-4cda-99dd-2704399eb221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:55.996682 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-b803b58b-6f58-4cda-99dd-2704399eb221 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:14:55.997894 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-b803b58b-6f58-4cda-99dd-2704399eb221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:14:56.011262 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 754/1534] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:14:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:14:56.021127 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb261b89-9257-475b-9401-d6a4f27b9e8f None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:56.021701 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb261b89-9257-475b-9401-d6a4f27b9e8f None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:56.021701 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb261b89-9257-475b-9401-d6a4f27b9e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:56.048554 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-eb261b89-9257-475b-9401-d6a4f27b9e8f None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:14:56.049771 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-eb261b89-9257-475b-9401-d6a4f27b9e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:14:56.058769 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 781/1535] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:14:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:14:56.063807 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803b58b-6f58-4cda-99dd-2704399eb221 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:56.079839 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803b58b-6f58-4cda-99dd-2704399eb221 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:56.085101 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423bda1-790e-46be-8e48-d3255123cca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:56.085757 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423bda1-790e-46be-8e48-d3255123cca0 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:56.086031 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423bda1-790e-46be-8e48-d3255123cca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:56.086302 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423bda1-790e-46be-8e48-d3255123cca0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:56.087007 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423bda1-790e-46be-8e48-d3255123cca0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:14:56.087305 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423bda1-790e-46be-8e48-d3255123cca0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:56.088944 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423bda1-790e-46be-8e48-d3255123cca0 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:56.109399 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 755/1536] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:14:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:14:56.123582 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb261b89-9257-475b-9401-d6a4f27b9e8f None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:56.134084 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb261b89-9257-475b-9401-d6a4f27b9e8f None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:56.142994 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bebd4b-f3b2-49c8-b7e8-8ad2865a547f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:56.143659 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bebd4b-f3b2-49c8-b7e8-8ad2865a547f admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:56.143936 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bebd4b-f3b2-49c8-b7e8-8ad2865a547f admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:56.144201 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bebd4b-f3b2-49c8-b7e8-8ad2865a547f admin admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:56.144878 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bebd4b-f3b2-49c8-b7e8-8ad2865a547f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:56.147038 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bebd4b-f3b2-49c8-b7e8-8ad2865a547f admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:56.163792 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ac4b2-34d4-449b-9121-34e3de21a20b None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:56.164144 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ac4b2-34d4-449b-9121-34e3de21a20b None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:56.164331 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ac4b2-34d4-449b-9121-34e3de21a20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:56.197429 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-270ac4b2-34d4-449b-9121-34e3de21a20b None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:14:56.201238 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-270ac4b2-34d4-449b-9121-34e3de21a20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:14:56.220972 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 756/1537] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:14:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:14:56.233709 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6a4d7-d5a9-40fa-895d-fe01017a0d6e None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:56.234003 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6a4d7-d5a9-40fa-895d-fe01017a0d6e None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:56.234231 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6a4d7-d5a9-40fa-895d-fe01017a0d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:56.240352 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 782/1538] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:14:56 2022] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:14:56.249053 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bebd4b-f3b2-49c8-b7e8-8ad2865a547f admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:56.292655 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-95b6a4d7-d5a9-40fa-895d-fe01017a0d6e None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:14:56.293878 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-95b6a4d7-d5a9-40fa-895d-fe01017a0d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:14:56.388995 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bebd4b-f3b2-49c8-b7e8-8ad2865a547f admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:56.405697 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f4e375-ba23-474e-9378-d3bb3ffe0035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:56.406351 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4e375-ba23-474e-9378-d3bb3ffe0035 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:56.406631 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4e375-ba23-474e-9378-d3bb3ffe0035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:56.406903 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4e375-ba23-474e-9378-d3bb3ffe0035 admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:56.407612 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f4e375-ba23-474e-9378-d3bb3ffe0035 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:56.408845 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: WARNING py.warnings [None req-79f4e375-ba23-474e-9378-d3bb3ffe0035 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:14:56.408845 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: warnings.warn(msg) Jul 31 01:14:56.408845 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: Jul 31 01:14:56.410423 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f4e375-ba23-474e-9378-d3bb3ffe0035 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:56.431849 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 757/1539] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:14:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:14:56.433283 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5bea0-1a24-4955-bf09-a6375818eacb None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:56.433615 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5bea0-1a24-4955-bf09-a6375818eacb None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:56.434225 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5bea0-1a24-4955-bf09-a6375818eacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:56.465068 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 783/1540] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:14:56 2022] POST /identity/v3/users => generated 288 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:14:56.466193 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-e5e5bea0-1a24-4955-bf09-a6375818eacb None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:14:56.466777 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f4e375-ba23-474e-9378-d3bb3ffe0035 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:56.467396 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-e5e5bea0-1a24-4955-bf09-a6375818eacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:14:56.482130 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 758/1541] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:14:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:14:56.482903 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5bea0-1a24-4955-bf09-a6375818eacb None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:56.485385 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f4e375-ba23-474e-9378-d3bb3ffe0035 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:56.497390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5bea0-1a24-4955-bf09-a6375818eacb None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:56.498700 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95d1c9-d92e-4ac6-bae6-c0e23315377a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:56.499626 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95d1c9-d92e-4ac6-bae6-c0e23315377a admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:56.500092 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95d1c9-d92e-4ac6-bae6-c0e23315377a admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:56.500897 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95d1c9-d92e-4ac6-bae6-c0e23315377a admin admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:56.502179 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad95d1c9-d92e-4ac6-bae6-c0e23315377a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:14:56.502664 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad95d1c9-d92e-4ac6-bae6-c0e23315377a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:56.508010 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: WARNING py.warnings [None req-ad95d1c9-d92e-4ac6-bae6-c0e23315377a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:14:56.508010 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: warnings.warn(msg) Jul 31 01:14:56.508010 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: Jul 31 01:14:56.509354 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad95d1c9-d92e-4ac6-bae6-c0e23315377a admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:56.513506 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ddc3ea-e024-4fd0-be1d-b7efa81fadcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:56.514160 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddc3ea-e024-4fd0-be1d-b7efa81fadcd admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:56.514435 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddc3ea-e024-4fd0-be1d-b7efa81fadcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:56.514769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddc3ea-e024-4fd0-be1d-b7efa81fadcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:56.515821 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ddc3ea-e024-4fd0-be1d-b7efa81fadcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:56.517441 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ddc3ea-e024-4fd0-be1d-b7efa81fadcd admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:56.531308 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 784/1542] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:14:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:14:56.533373 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78ea63-37c8-44ee-97bd-ec60df232139 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:56.533826 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78ea63-37c8-44ee-97bd-ec60df232139 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:56.534261 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78ea63-37c8-44ee-97bd-ec60df232139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:56.537003 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 759/1543] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:14:56.542343 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ddc3ea-e024-4fd0-be1d-b7efa81fadcd admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:56.565529 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-6d78ea63-37c8-44ee-97bd-ec60df232139 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:14:56.566186 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ddc3ea-e024-4fd0-be1d-b7efa81fadcd admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:56.566960 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-6d78ea63-37c8-44ee-97bd-ec60df232139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:14:56.580876 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 785/1544] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:14:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:14:56.581713 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78ea63-37c8-44ee-97bd-ec60df232139 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:56.584900 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ddeace-3456-43a0-96e5-002ee272b36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:56.585548 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddeace-3456-43a0-96e5-002ee272b36c admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:56.585928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddeace-3456-43a0-96e5-002ee272b36c admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:56.586349 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddeace-3456-43a0-96e5-002ee272b36c admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:56.587220 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ddeace-3456-43a0-96e5-002ee272b36c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:56.588972 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ddeace-3456-43a0-96e5-002ee272b36c admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:56.598062 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78ea63-37c8-44ee-97bd-ec60df232139 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:56.610970 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 760/1545] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:14:56.611394 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69303bd9-8335-46e0-8a3d-14c7b4b60898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:56.612176 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69303bd9-8335-46e0-8a3d-14c7b4b60898 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:56.612718 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f9556-3ba3-4629-bbab-ffd9781fc422 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:56.612938 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69303bd9-8335-46e0-8a3d-14c7b4b60898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:56.613034 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f9556-3ba3-4629-bbab-ffd9781fc422 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:56.613124 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69303bd9-8335-46e0-8a3d-14c7b4b60898 admin admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:56.613208 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f9556-3ba3-4629-bbab-ffd9781fc422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:56.613302 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69303bd9-8335-46e0-8a3d-14c7b4b60898 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:56.615226 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69303bd9-8335-46e0-8a3d-14c7b4b60898 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:56.669678 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-a71f9556-3ba3-4629-bbab-ffd9781fc422 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:14:56.670961 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-a71f9556-3ba3-4629-bbab-ffd9781fc422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:14:56.676814 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 786/1546] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:14:56 2022] POST /identity/v3/projects => generated 381 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:14:56.678036 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69303bd9-8335-46e0-8a3d-14c7b4b60898 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:56.751544 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 761/1547] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:14:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:14:56.752333 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f9556-3ba3-4629-bbab-ffd9781fc422 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:56.757815 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69303bd9-8335-46e0-8a3d-14c7b4b60898 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:56.762991 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1124ea-6c4d-4d9b-9cff-3693fb74de83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:56.763935 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1124ea-6c4d-4d9b-9cff-3693fb74de83 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:56.764219 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1124ea-6c4d-4d9b-9cff-3693fb74de83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:56.764546 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1124ea-6c4d-4d9b-9cff-3693fb74de83 admin admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:56.765385 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1124ea-6c4d-4d9b-9cff-3693fb74de83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:14:56.765746 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1124ea-6c4d-4d9b-9cff-3693fb74de83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:56.767367 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1124ea-6c4d-4d9b-9cff-3693fb74de83 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:56.778575 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f9556-3ba3-4629-bbab-ffd9781fc422 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:56.780919 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 787/1548] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:14:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:14:56.785074 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2328f-2e9f-4d24-aa34-731fffc188c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:56.785775 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2328f-2e9f-4d24-aa34-731fffc188c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:56.786058 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2328f-2e9f-4d24-aa34-731fffc188c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:56.786339 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2328f-2e9f-4d24-aa34-731fffc188c0 admin admin] PATH_INFO: `/v3/projects/595e24c0b8924723b8074676ebfad2e2/users/75e6d2aeb13145bc8057b7b314d26dcb/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:56.788505 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871aa6d0-2dd4-415f-bb92-aa26ef6b774e None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:56.788803 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871aa6d0-2dd4-415f-bb92-aa26ef6b774e None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:56.789080 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871aa6d0-2dd4-415f-bb92-aa26ef6b774e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:56.799361 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:14:56.806614 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b2328f-2e9f-4d24-aa34-731fffc188c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=595e24c0b8924723b8074676ebfad2e2, user_id=75e6d2aeb13145bc8057b7b314d26dcb, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:56.808093 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: WARNING py.warnings [None req-f2b2328f-2e9f-4d24-aa34-731fffc188c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:14:56.808093 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: warnings.warn(msg) Jul 31 01:14:56.808093 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: Jul 31 01:14:56.810335 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b2328f-2e9f-4d24-aa34-731fffc188c0 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:56.811932 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-871aa6d0-2dd4-415f-bb92-aa26ef6b774e None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:14:56.813528 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-871aa6d0-2dd4-415f-bb92-aa26ef6b774e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:14:56.823458 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 788/1549] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:14:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:14:56.824128 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871aa6d0-2dd4-415f-bb92-aa26ef6b774e None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:56.830885 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 762/1550] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:14:56 2022] PUT /identity/v3/projects/595e24c0b8924723b8074676ebfad2e2/users/75e6d2aeb13145bc8057b7b314d26dcb/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:14:56.830885 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddda9e8-0f5c-422e-b33b-ba528a7bf685 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:56.830885 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddda9e8-0f5c-422e-b33b-ba528a7bf685 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:56.830885 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddda9e8-0f5c-422e-b33b-ba528a7bf685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:56.834292 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871aa6d0-2dd4-415f-bb92-aa26ef6b774e None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:56.856320 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-9ddda9e8-0f5c-422e-b33b-ba528a7bf685 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:14:56.865369 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-9ddda9e8-0f5c-422e-b33b-ba528a7bf685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:14:56.880841 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:14:56.891125 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b2b9a-4955-4c2a-9c7a-341f1e0f4dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:56.891794 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b2b9a-4955-4c2a-9c7a-341f1e0f4dfa admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:56.892074 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b2b9a-4955-4c2a-9c7a-341f1e0f4dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:56.892344 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b2b9a-4955-4c2a-9c7a-341f1e0f4dfa admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:56.893010 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b2b9a-4955-4c2a-9c7a-341f1e0f4dfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:56.894936 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b2b9a-4955-4c2a-9c7a-341f1e0f4dfa admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:56.919229 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 789/1551] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:14:56 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:14:56.920541 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebbe69e-de35-403b-a4f9-a5191e913a4a None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:56.920824 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebbe69e-de35-403b-a4f9-a5191e913a4a None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:56.921122 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebbe69e-de35-403b-a4f9-a5191e913a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:56.926919 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 763/1552] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:14:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:14:56.928423 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133ed49-f1ea-4b4e-a5cd-9914ae3f1689 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:56.928713 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133ed49-f1ea-4b4e-a5cd-9914ae3f1689 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:56.928987 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133ed49-f1ea-4b4e-a5cd-9914ae3f1689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:56.947857 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-eebbe69e-de35-403b-a4f9-a5191e913a4a None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:14:56.948756 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-b133ed49-f1ea-4b4e-a5cd-9914ae3f1689 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:14:56.949043 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-eebbe69e-de35-403b-a4f9-a5191e913a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:14:56.949933 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-b133ed49-f1ea-4b4e-a5cd-9914ae3f1689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:14:56.960655 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 790/1553] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:14:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:14:56.960655 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebbe69e-de35-403b-a4f9-a5191e913a4a None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:56.960924 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 764/1554] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:14:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:14:56.960924 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407c7e2-2d10-4bca-b845-20a45787d14d None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:56.960924 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407c7e2-2d10-4bca-b845-20a45787d14d None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:56.960924 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407c7e2-2d10-4bca-b845-20a45787d14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:56.967603 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebbe69e-de35-403b-a4f9-a5191e913a4a None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:56.972801 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f3f7b-8873-4d6c-a8b0-b6819870d5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:56.973430 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f3f7b-8873-4d6c-a8b0-b6819870d5ec admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:56.973704 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f3f7b-8873-4d6c-a8b0-b6819870d5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:56.973970 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f3f7b-8873-4d6c-a8b0-b6819870d5ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:56.974623 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f3f7b-8873-4d6c-a8b0-b6819870d5ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:56.976579 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f3f7b-8873-4d6c-a8b0-b6819870d5ec admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:57.008865 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-d407c7e2-2d10-4bca-b845-20a45787d14d None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:14:57.008865 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-d407c7e2-2d10-4bca-b845-20a45787d14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:14:57.008865 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 765/1555] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:14:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:14:57.008865 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239dc65-76ac-44cf-8966-8761de2bfc4c None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:57.008865 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239dc65-76ac-44cf-8966-8761de2bfc4c None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:57.008865 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239dc65-76ac-44cf-8966-8761de2bfc4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:57.015561 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 791/1556] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:14:56 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:14:57.016748 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a663e2a-d843-4a91-bca2-321e323c17e5 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:57.017026 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a663e2a-d843-4a91-bca2-321e323c17e5 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:57.017293 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a663e2a-d843-4a91-bca2-321e323c17e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:57.018075 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-c239dc65-76ac-44cf-8966-8761de2bfc4c None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:14:57.019387 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-c239dc65-76ac-44cf-8966-8761de2bfc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:14:57.036960 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-1a663e2a-d843-4a91-bca2-321e323c17e5 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:14:57.038150 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-1a663e2a-d843-4a91-bca2-321e323c17e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:14:57.080835 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 766/1557] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:14:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:14:57.085344 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c239dc65-76ac-44cf-8966-8761de2bfc4c None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:57.094685 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c239dc65-76ac-44cf-8966-8761de2bfc4c None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:57.099284 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68a5e2-4b5a-4104-9fe2-b088f21edb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:57.100019 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68a5e2-4b5a-4104-9fe2-b088f21edb89 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:57.100369 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68a5e2-4b5a-4104-9fe2-b088f21edb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:57.100715 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68a5e2-4b5a-4104-9fe2-b088f21edb89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:57.101154 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 792/1558] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:14:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:14:57.101557 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68a5e2-4b5a-4104-9fe2-b088f21edb89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:57.102587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2acb71-7a21-44a4-99a3-965db5955d69 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:57.102875 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2acb71-7a21-44a4-99a3-965db5955d69 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:57.103170 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2acb71-7a21-44a4-99a3-965db5955d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:57.103435 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68a5e2-4b5a-4104-9fe2-b088f21edb89 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:57.115343 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 767/1559] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:14:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:14:57.116076 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68a5e2-4b5a-4104-9fe2-b088f21edb89 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:57.124630 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-aa2acb71-7a21-44a4-99a3-965db5955d69 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:14:57.125985 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68a5e2-4b5a-4104-9fe2-b088f21edb89 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:57.126207 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-aa2acb71-7a21-44a4-99a3-965db5955d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:14:57.136096 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de472b71-5523-4156-b496-9a1b47366e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:57.136713 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de472b71-5523-4156-b496-9a1b47366e97 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:57.136992 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de472b71-5523-4156-b496-9a1b47366e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:57.137267 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de472b71-5523-4156-b496-9a1b47366e97 admin admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:57.137976 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de472b71-5523-4156-b496-9a1b47366e97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:14:57.138282 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de472b71-5523-4156-b496-9a1b47366e97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:57.139823 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 793/1560] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:14:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:14:57.140174 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de472b71-5523-4156-b496-9a1b47366e97 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:57.144513 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6229d5-0e4a-4594-8cd7-e3dce7465d58 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:57.144513 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6229d5-0e4a-4594-8cd7-e3dce7465d58 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:57.144513 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6229d5-0e4a-4594-8cd7-e3dce7465d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:57.154288 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 768/1561] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:14:57.155180 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de472b71-5523-4156-b496-9a1b47366e97 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:57.163958 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-1e6229d5-0e4a-4594-8cd7-e3dce7465d58 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:14:57.165153 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-1e6229d5-0e4a-4594-8cd7-e3dce7465d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:14:57.173354 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 794/1562] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:14:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:14:57.174109 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6229d5-0e4a-4594-8cd7-e3dce7465d58 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:57.183425 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6229d5-0e4a-4594-8cd7-e3dce7465d58 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:57.189692 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e6fb3-41f1-4062-b70e-4f2750e8266b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:57.190321 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e6fb3-41f1-4062-b70e-4f2750e8266b admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:57.190570 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e6fb3-41f1-4062-b70e-4f2750e8266b admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:57.190833 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e6fb3-41f1-4062-b70e-4f2750e8266b admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:57.191528 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e6fb3-41f1-4062-b70e-4f2750e8266b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:57.193460 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e6fb3-41f1-4062-b70e-4f2750e8266b admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:57.215888 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 795/1563] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:14:57 2022] POST /identity/v3/users => generated 290 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:14:57.216887 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e6fb3-41f1-4062-b70e-4f2750e8266b admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:57.222791 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de472b71-5523-4156-b496-9a1b47366e97 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:57.226788 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7731fae2-e078-4f8c-bcd5-88ea2dc088c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:57.227101 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e6fb3-41f1-4062-b70e-4f2750e8266b admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:57.227358 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731fae2-e078-4f8c-bcd5-88ea2dc088c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:57.227672 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731fae2-e078-4f8c-bcd5-88ea2dc088c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:57.227949 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731fae2-e078-4f8c-bcd5-88ea2dc088c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:57.231725 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744dbe98-60f5-415b-9388-f90a9096d0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:57.232319 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744dbe98-60f5-415b-9388-f90a9096d0d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:57.232603 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744dbe98-60f5-415b-9388-f90a9096d0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:57.232875 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744dbe98-60f5-415b-9388-f90a9096d0d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:57.233769 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744dbe98-60f5-415b-9388-f90a9096d0d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:14:57.234075 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744dbe98-60f5-415b-9388-f90a9096d0d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:57.235696 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744dbe98-60f5-415b-9388-f90a9096d0d4 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:57.237183 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7731fae2-e078-4f8c-bcd5-88ea2dc088c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:57.238628 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7731fae2-e078-4f8c-bcd5-88ea2dc088c3 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:57.248104 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 769/1564] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:14:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:14:57.248213 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 796/1565] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:14:57.252450 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744dbe98-60f5-415b-9388-f90a9096d0d4 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:57.252878 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7f897-c0d6-46ae-80ee-695b1adf2c8e None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:57.253163 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7f897-c0d6-46ae-80ee-695b1adf2c8e None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:57.253435 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7f897-c0d6-46ae-80ee-695b1adf2c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:57.266617 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744dbe98-60f5-415b-9388-f90a9096d0d4 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:57.273567 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61602b8f-7a5d-427b-92ed-a28260a17020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:57.274058 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61602b8f-7a5d-427b-92ed-a28260a17020 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:57.274431 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61602b8f-7a5d-427b-92ed-a28260a17020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:57.274999 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61602b8f-7a5d-427b-92ed-a28260a17020 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:57.275704 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61602b8f-7a5d-427b-92ed-a28260a17020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:57.277878 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61602b8f-7a5d-427b-92ed-a28260a17020 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:57.278009 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-69c7f897-c0d6-46ae-80ee-695b1adf2c8e None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:14:57.279925 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-69c7f897-c0d6-46ae-80ee-695b1adf2c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:14:57.290889 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 770/1566] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:14:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:14:57.296183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 797/1567] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:14:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:14:57.296183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61602b8f-7a5d-427b-92ed-a28260a17020 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:57.296372 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7f897-c0d6-46ae-80ee-695b1adf2c8e None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:57.303281 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:14:57.306851 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7f897-c0d6-46ae-80ee-695b1adf2c8e None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:57.308176 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61602b8f-7a5d-427b-92ed-a28260a17020 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:57.311862 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ffc3b-9afd-4c94-a0e6-cc3dd8604eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:57.312483 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ffc3b-9afd-4c94-a0e6-cc3dd8604eaf admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:57.312822 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ffc3b-9afd-4c94-a0e6-cc3dd8604eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:57.313165 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ffc3b-9afd-4c94-a0e6-cc3dd8604eaf admin admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:57.313938 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ffc3b-9afd-4c94-a0e6-cc3dd8604eaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:14:57.314242 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ffc3b-9afd-4c94-a0e6-cc3dd8604eaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:57.315891 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ffc3b-9afd-4c94-a0e6-cc3dd8604eaf admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:57.316710 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463aa2c4-c9d0-4d56-9b4a-0d13e0ed2bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:57.317903 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463aa2c4-c9d0-4d56-9b4a-0d13e0ed2bad admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:57.318407 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463aa2c4-c9d0-4d56-9b4a-0d13e0ed2bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:57.318889 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463aa2c4-c9d0-4d56-9b4a-0d13e0ed2bad admin admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:57.320319 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463aa2c4-c9d0-4d56-9b4a-0d13e0ed2bad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:57.322907 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463aa2c4-c9d0-4d56-9b4a-0d13e0ed2bad admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:57.329102 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 771/1568] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:14:57.337062 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ffc3b-9afd-4c94-a0e6-cc3dd8604eaf admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:57.348423 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ffc3b-9afd-4c94-a0e6-cc3dd8604eaf admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:57.353519 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fcab0-e9ee-44cc-a430-bddf7f19f861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:57.354082 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fcab0-e9ee-44cc-a430-bddf7f19f861 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:57.354403 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fcab0-e9ee-44cc-a430-bddf7f19f861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:57.354678 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fcab0-e9ee-44cc-a430-bddf7f19f861 admin admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:57.355474 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278fcab0-e9ee-44cc-a430-bddf7f19f861 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:14:57.355837 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278fcab0-e9ee-44cc-a430-bddf7f19f861 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:57.357552 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278fcab0-e9ee-44cc-a430-bddf7f19f861 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:57.360819 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:14:57.362801 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 798/1569] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:14:57 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:14:57.365964 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463aa2c4-c9d0-4d56-9b4a-0d13e0ed2bad admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:57.373374 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 772/1570] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:14:57.374385 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fcab0-e9ee-44cc-a430-bddf7f19f861 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:57.392817 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fcab0-e9ee-44cc-a430-bddf7f19f861 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:57.444417 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463aa2c4-c9d0-4d56-9b4a-0d13e0ed2bad admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:57.449392 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ee1fd-61f2-4c37-a980-f32b8955bdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:57.450156 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ee1fd-61f2-4c37-a980-f32b8955bdd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:57.450510 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ee1fd-61f2-4c37-a980-f32b8955bdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:57.450947 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ee1fd-61f2-4c37-a980-f32b8955bdd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:57.451914 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ee1fd-61f2-4c37-a980-f32b8955bdd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:57.453892 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ee1fd-61f2-4c37-a980-f32b8955bdd4 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:57.466138 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 799/1571] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:14:57 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:14:57.466913 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ee1fd-61f2-4c37-a980-f32b8955bdd4 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:57.477547 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ee1fd-61f2-4c37-a980-f32b8955bdd4 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:57.482347 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d2979-f21f-465c-a305-2f1bec2dcb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:57.482963 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d2979-f21f-465c-a305-2f1bec2dcb5e admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:57.483245 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d2979-f21f-465c-a305-2f1bec2dcb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:57.483583 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d2979-f21f-465c-a305-2f1bec2dcb5e admin admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:57.483844 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054df03-4db0-40ce-bfe8-71b4ede3375d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:57.484276 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d2979-f21f-465c-a305-2f1bec2dcb5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:14:57.484576 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d2979-f21f-465c-a305-2f1bec2dcb5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:57.484997 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054df03-4db0-40ce-bfe8-71b4ede3375d admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:57.485408 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054df03-4db0-40ce-bfe8-71b4ede3375d admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:57.485835 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054df03-4db0-40ce-bfe8-71b4ede3375d admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:57.486182 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d2979-f21f-465c-a305-2f1bec2dcb5e admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:57.486808 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2054df03-4db0-40ce-bfe8-71b4ede3375d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:57.488373 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: WARNING py.warnings [None req-2054df03-4db0-40ce-bfe8-71b4ede3375d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:14:57.488373 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: warnings.warn(msg) Jul 31 01:14:57.488373 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: Jul 31 01:14:57.490405 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2054df03-4db0-40ce-bfe8-71b4ede3375d admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:57.499261 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 800/1572] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:14:57.500137 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d2979-f21f-465c-a305-2f1bec2dcb5e admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:57.517120 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d2979-f21f-465c-a305-2f1bec2dcb5e admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:57.521992 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6c06d-c11e-4393-a4d7-a59a74efd756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:57.522672 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6c06d-c11e-4393-a4d7-a59a74efd756 admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:57.522949 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6c06d-c11e-4393-a4d7-a59a74efd756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:57.523215 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6c06d-c11e-4393-a4d7-a59a74efd756 admin admin] PATH_INFO: `/v3/projects/d69bf2ca51c1472e903b9f4a3996258e/users/6a278b4769e24f6c8b42aec507190c56/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:57.527675 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 773/1573] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:14:57 2022] POST /identity/v3/projects => generated 367 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:14:57.528756 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054df03-4db0-40ce-bfe8-71b4ede3375d admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:57.540427 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6c06d-c11e-4393-a4d7-a59a74efd756 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d69bf2ca51c1472e903b9f4a3996258e, user_id=6a278b4769e24f6c8b42aec507190c56, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:57.543719 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6c06d-c11e-4393-a4d7-a59a74efd756 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:57.559670 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 801/1574] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:14:57 2022] PUT /identity/v3/projects/d69bf2ca51c1472e903b9f4a3996258e/users/6a278b4769e24f6c8b42aec507190c56/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:14:57.562546 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6c06d-c11e-4393-a4d7-a59a74efd756 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:57.615369 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054df03-4db0-40ce-bfe8-71b4ede3375d admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:57.650039 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6c06d-c11e-4393-a4d7-a59a74efd756 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:57.655143 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658d639-291b-4b5b-8489-d8d56d173f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:57.656092 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658d639-291b-4b5b-8489-d8d56d173f39 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:57.656477 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658d639-291b-4b5b-8489-d8d56d173f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:57.656848 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658d639-291b-4b5b-8489-d8d56d173f39 admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:57.657614 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b658d639-291b-4b5b-8489-d8d56d173f39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:57.659749 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b658d639-291b-4b5b-8489-d8d56d173f39 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:57.694078 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 802/1575] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:14:57 2022] POST /identity/v3/users => generated 293 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:14:57.695368 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658d639-291b-4b5b-8489-d8d56d173f39 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:57.696908 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea7088-26ec-4afc-9cda-70f7664a19ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:57.697618 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea7088-26ec-4afc-9cda-70f7664a19ba admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:57.697902 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea7088-26ec-4afc-9cda-70f7664a19ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:57.698174 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea7088-26ec-4afc-9cda-70f7664a19ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:57.698949 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea7088-26ec-4afc-9cda-70f7664a19ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:57.701527 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea7088-26ec-4afc-9cda-70f7664a19ba admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:57.707876 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658d639-291b-4b5b-8489-d8d56d173f39 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:57.712818 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2320d-408d-4e19-bdca-329bbd86d322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:57.713431 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2320d-408d-4e19-bdca-329bbd86d322 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:57.713804 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2320d-408d-4e19-bdca-329bbd86d322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:57.714183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2320d-408d-4e19-bdca-329bbd86d322 admin admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:57.714921 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da2320d-408d-4e19-bdca-329bbd86d322 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:57.717004 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da2320d-408d-4e19-bdca-329bbd86d322 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:57.734601 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 774/1576] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:14:57 2022] POST /identity/v3/projects => generated 391 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:14:57.735842 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea7088-26ec-4afc-9cda-70f7664a19ba admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:57.751193 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:14:57.752345 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 803/1577] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:14:57 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:14:57.753330 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2320d-408d-4e19-bdca-329bbd86d322 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:57.765778 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:14:57.811926 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea7088-26ec-4afc-9cda-70f7664a19ba admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:57.828857 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2320d-408d-4e19-bdca-329bbd86d322 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:57.834360 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa58fd-7e05-4504-bfbb-5f82af21db8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:57.835277 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa58fd-7e05-4504-bfbb-5f82af21db8e admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:57.835725 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa58fd-7e05-4504-bfbb-5f82af21db8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:57.836168 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa58fd-7e05-4504-bfbb-5f82af21db8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:57.836962 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fa58fd-7e05-4504-bfbb-5f82af21db8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:57.839153 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fa58fd-7e05-4504-bfbb-5f82af21db8e admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:57.870119 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 804/1578] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:14:57 2022] POST /identity/v3/projects => generated 397 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:14:57.870943 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa58fd-7e05-4504-bfbb-5f82af21db8e admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:57.881563 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9841e396-ac01-4de0-a679-df7a86a28e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:57.882028 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841e396-ac01-4de0-a679-df7a86a28e81 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:57.882311 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841e396-ac01-4de0-a679-df7a86a28e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:57.882588 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841e396-ac01-4de0-a679-df7a86a28e81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:57.883317 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9841e396-ac01-4de0-a679-df7a86a28e81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:57.885079 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9841e396-ac01-4de0-a679-df7a86a28e81 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:57.896214 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 775/1579] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:14:57 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:14:57.900636 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8d8a5-8a78-407d-87e1-a382ba6671a8 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:57.900925 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8d8a5-8a78-407d-87e1-a382ba6671a8 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:57.901202 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8d8a5-8a78-407d-87e1-a382ba6671a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:57.944507 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-3bf8d8a5-8a78-407d-87e1-a382ba6671a8 None None] MFA Rules not processed for user `6a278b4769e24f6c8b42aec507190c56`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:14:57.945839 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-3bf8d8a5-8a78-407d-87e1-a382ba6671a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:14:57.951933 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa58fd-7e05-4504-bfbb-5f82af21db8e admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:57.958419 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba3396-ca34-4485-aa79-7f2a6b0f1682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:57.959183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba3396-ca34-4485-aa79-7f2a6b0f1682 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:57.959911 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba3396-ca34-4485-aa79-7f2a6b0f1682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:57.960247 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba3396-ca34-4485-aa79-7f2a6b0f1682 admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:57.961245 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba3396-ca34-4485-aa79-7f2a6b0f1682 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:57.963746 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba3396-ca34-4485-aa79-7f2a6b0f1682 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:57.994061 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 805/1580] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:14:57 2022] POST /identity/v3/users => generated 284 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:14:57.995187 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba3396-ca34-4485-aa79-7f2a6b0f1682 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:58.006963 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba3396-ca34-4485-aa79-7f2a6b0f1682 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:58.011658 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f51e5-ce65-47d5-ac50-28d7bc459826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:58.012282 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f51e5-ce65-47d5-ac50-28d7bc459826 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:58.012557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f51e5-ce65-47d5-ac50-28d7bc459826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:58.012827 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f51e5-ce65-47d5-ac50-28d7bc459826 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:58.013518 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f51e5-ce65-47d5-ac50-28d7bc459826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:58.015213 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f51e5-ce65-47d5-ac50-28d7bc459826 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:58.030939 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 806/1581] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:14:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:14:58.030939 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f51e5-ce65-47d5-ac50-28d7bc459826 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:58.039353 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f51e5-ce65-47d5-ac50-28d7bc459826 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:58.043342 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 776/1582] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:14:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:14:58.048330 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8d8a5-8a78-407d-87e1-a382ba6671a8 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:58.050964 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ea6a2-94bd-4c79-ab76-61cdfd15e74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:58.052443 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ea6a2-94bd-4c79-ab76-61cdfd15e74b admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:58.052815 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ea6a2-94bd-4c79-ab76-61cdfd15e74b admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:58.053599 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ea6a2-94bd-4c79-ab76-61cdfd15e74b admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:58.054419 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ea6a2-94bd-4c79-ab76-61cdfd15e74b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:58.057087 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ea6a2-94bd-4c79-ab76-61cdfd15e74b admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:58.063561 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8d8a5-8a78-407d-87e1-a382ba6671a8 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:58.068788 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c3dcf-9c89-4fa6-a523-7be599bd75cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:58.069543 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c3dcf-9c89-4fa6-a523-7be599bd75cc admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:58.069825 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c3dcf-9c89-4fa6-a523-7be599bd75cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:58.070098 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c3dcf-9c89-4fa6-a523-7be599bd75cc admin admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:58.071402 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c3dcf-9c89-4fa6-a523-7be599bd75cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:58.073989 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c3dcf-9c89-4fa6-a523-7be599bd75cc admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:58.089069 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 807/1583] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:14:58 2022] POST /identity/v3/users => generated 296 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:14:58.092796 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ea6a2-94bd-4c79-ab76-61cdfd15e74b admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:58.101714 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ea6a2-94bd-4c79-ab76-61cdfd15e74b admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:58.103340 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 777/1584] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:14:58 2022] POST /identity/v3/users => generated 287 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:14:58.104396 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c3dcf-9c89-4fa6-a523-7be599bd75cc admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:58.116376 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c3dcf-9c89-4fa6-a523-7be599bd75cc admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:58.118825 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7917dc2-ec57-46bb-89ac-6b2e0694f94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:58.120122 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7917dc2-ec57-46bb-89ac-6b2e0694f94b admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:58.120758 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7917dc2-ec57-46bb-89ac-6b2e0694f94b admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:58.121027 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7917dc2-ec57-46bb-89ac-6b2e0694f94b admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:58.122077 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7917dc2-ec57-46bb-89ac-6b2e0694f94b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:58.122570 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b43ae-2c65-4c93-923d-6d1825ac11e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:58.123026 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b43ae-2c65-4c93-923d-6d1825ac11e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:58.123370 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b43ae-2c65-4c93-923d-6d1825ac11e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:58.123738 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b43ae-2c65-4c93-923d-6d1825ac11e6 admin admin] PATH_INFO: `/v3/projects/56a82235bdca4e98a5aeafc6deceed8a/users/5f4a326874b94ea899f450ba5d41b27c/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:58.125111 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7917dc2-ec57-46bb-89ac-6b2e0694f94b admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:58.141367 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b43ae-2c65-4c93-923d-6d1825ac11e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56a82235bdca4e98a5aeafc6deceed8a, user_id=5f4a326874b94ea899f450ba5d41b27c, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:58.144599 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b43ae-2c65-4c93-923d-6d1825ac11e6 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:58.160319 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 808/1585] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:14:58 2022] POST /identity/v3/users => generated 299 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:14:58.161652 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7917dc2-ec57-46bb-89ac-6b2e0694f94b admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:58.168626 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 778/1586] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:14:58 2022] PUT /identity/v3/projects/56a82235bdca4e98a5aeafc6deceed8a/users/5f4a326874b94ea899f450ba5d41b27c/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:14:58.170010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b43ae-2c65-4c93-923d-6d1825ac11e6 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:58.174325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7917dc2-ec57-46bb-89ac-6b2e0694f94b admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:58.176991 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:14:58.212689 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:14:58.239996 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afdc91f-461b-4778-a419-92d5abfb2082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:58.240767 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdc91f-461b-4778-a419-92d5abfb2082 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:58.241051 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdc91f-461b-4778-a419-92d5abfb2082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:58.241326 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdc91f-461b-4778-a419-92d5abfb2082 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:58.242027 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afdc91f-461b-4778-a419-92d5abfb2082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:58.243767 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afdc91f-461b-4778-a419-92d5abfb2082 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:58.255546 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 809/1587] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:14:58.256577 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afdc91f-461b-4778-a419-92d5abfb2082 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:58.262055 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b43ae-2c65-4c93-923d-6d1825ac11e6 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:58.267513 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdcf6f0-be61-4d53-8137-01514b86c789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:58.268356 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afdc91f-461b-4778-a419-92d5abfb2082 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:58.268462 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcf6f0-be61-4d53-8137-01514b86c789 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:58.269244 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcf6f0-be61-4d53-8137-01514b86c789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:58.269614 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcf6f0-be61-4d53-8137-01514b86c789 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:58.270471 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdcf6f0-be61-4d53-8137-01514b86c789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:58.272379 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdcf6f0-be61-4d53-8137-01514b86c789 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:58.273346 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7340098-3727-4b1f-98b1-80f4ea70b370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:58.273980 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7340098-3727-4b1f-98b1-80f4ea70b370 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:58.274258 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7340098-3727-4b1f-98b1-80f4ea70b370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:58.274534 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7340098-3727-4b1f-98b1-80f4ea70b370 admin admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:58.275289 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7340098-3727-4b1f-98b1-80f4ea70b370 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:58.277267 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7340098-3727-4b1f-98b1-80f4ea70b370 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:58.286951 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 779/1588] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:14:58.288132 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdcf6f0-be61-4d53-8137-01514b86c789 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:58.301424 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdcf6f0-be61-4d53-8137-01514b86c789 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:58.308001 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8add8d8-d442-4efc-bd43-9a6f7ffc65c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:58.308803 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8add8d8-d442-4efc-bd43-9a6f7ffc65c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:58.309510 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8add8d8-d442-4efc-bd43-9a6f7ffc65c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:58.309673 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8add8d8-d442-4efc-bd43-9a6f7ffc65c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:58.310778 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8add8d8-d442-4efc-bd43-9a6f7ffc65c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:58.312762 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8add8d8-d442-4efc-bd43-9a6f7ffc65c1 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:58.323049 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 810/1589] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:14:58 2022] POST /identity/v3/projects => generated 383 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:14:58.324469 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7340098-3727-4b1f-98b1-80f4ea70b370 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:58.327818 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 780/1590] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:14:58.328832 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8add8d8-d442-4efc-bd43-9a6f7ffc65c1 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:58.339301 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8add8d8-d442-4efc-bd43-9a6f7ffc65c1 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:58.412669 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7340098-3727-4b1f-98b1-80f4ea70b370 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:58.414406 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa0428e-daac-44e4-bb9d-4076307e1e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:58.415151 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0428e-daac-44e4-bb9d-4076307e1e83 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:58.416006 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0428e-daac-44e4-bb9d-4076307e1e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:58.416384 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0428e-daac-44e4-bb9d-4076307e1e83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:58.417190 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa0428e-daac-44e4-bb9d-4076307e1e83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:58.418020 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34885f0-7c51-4e85-91e1-051cf23f7524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:58.418724 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34885f0-7c51-4e85-91e1-051cf23f7524 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:58.419257 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34885f0-7c51-4e85-91e1-051cf23f7524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:58.419364 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa0428e-daac-44e4-bb9d-4076307e1e83 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:58.419445 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34885f0-7c51-4e85-91e1-051cf23f7524 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:58.420038 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34885f0-7c51-4e85-91e1-051cf23f7524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:58.421764 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34885f0-7c51-4e85-91e1-051cf23f7524 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:58.430855 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 781/1591] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:14:58.435423 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 811/1592] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:14:58.435735 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8adf58-9ccb-4efd-af8f-c61fbb353c81 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:58.436558 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34885f0-7c51-4e85-91e1-051cf23f7524 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:58.436774 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8adf58-9ccb-4efd-af8f-c61fbb353c81 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:58.437149 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8adf58-9ccb-4efd-af8f-c61fbb353c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:58.451082 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34885f0-7c51-4e85-91e1-051cf23f7524 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:58.457208 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea5261-ca29-45cf-877e-5f7f605b4047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:58.457855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea5261-ca29-45cf-877e-5f7f605b4047 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:58.458134 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea5261-ca29-45cf-877e-5f7f605b4047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:58.458410 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea5261-ca29-45cf-877e-5f7f605b4047 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:58.459171 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea5261-ca29-45cf-877e-5f7f605b4047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:58.460965 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-ff8adf58-9ccb-4efd-af8f-c61fbb353c81 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:14:58.461082 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea5261-ca29-45cf-877e-5f7f605b4047 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:58.462413 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-ff8adf58-9ccb-4efd-af8f-c61fbb353c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:14:58.473943 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 812/1593] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:14:58.474828 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea5261-ca29-45cf-877e-5f7f605b4047 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:58.480596 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 782/1594] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:14:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:14:58.481675 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8adf58-9ccb-4efd-af8f-c61fbb353c81 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:58.488567 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea5261-ca29-45cf-877e-5f7f605b4047 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:58.492294 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8adf58-9ccb-4efd-af8f-c61fbb353c81 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:58.494316 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f26793-490b-4922-a401-3186aa007cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:58.495039 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f26793-490b-4922-a401-3186aa007cc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:58.495375 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f26793-490b-4922-a401-3186aa007cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:58.495695 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f26793-490b-4922-a401-3186aa007cc1 admin admin] PATH_INFO: `/v3/projects/db7a845ba95b4f15a1236d206950f98d/users/b6f87ffe270340ccb98e06f86615d700/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:58.503186 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e5027d-5822-42e0-8c7e-c2a0e8aafcb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:58.504950 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5027d-5822-42e0-8c7e-c2a0e8aafcb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:58.505334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5027d-5822-42e0-8c7e-c2a0e8aafcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:58.505714 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5027d-5822-42e0-8c7e-c2a0e8aafcb8 admin admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:58.506637 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e5027d-5822-42e0-8c7e-c2a0e8aafcb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:58.509776 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e5027d-5822-42e0-8c7e-c2a0e8aafcb8 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:58.516990 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f26793-490b-4922-a401-3186aa007cc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db7a845ba95b4f15a1236d206950f98d, user_id=b6f87ffe270340ccb98e06f86615d700, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:58.520544 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f26793-490b-4922-a401-3186aa007cc1 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:58.548146 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 813/1595] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:14:58 2022] PUT /identity/v3/projects/db7a845ba95b4f15a1236d206950f98d/users/b6f87ffe270340ccb98e06f86615d700/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:14:58.550089 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f26793-490b-4922-a401-3186aa007cc1 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:58.550932 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 783/1596] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:14:58 2022] POST /identity/v3/users => generated 292 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:14:58.552164 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e5027d-5822-42e0-8c7e-c2a0e8aafcb8 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:58.564124 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e5027d-5822-42e0-8c7e-c2a0e8aafcb8 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:58.664275 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77c413-3d10-47fa-a73e-d7f79b98a01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:58.665290 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77c413-3d10-47fa-a73e-d7f79b98a01b admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:58.665767 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77c413-3d10-47fa-a73e-d7f79b98a01b admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:58.666065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f26793-490b-4922-a401-3186aa007cc1 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:58.666387 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77c413-3d10-47fa-a73e-d7f79b98a01b admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:58.667272 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77c413-3d10-47fa-a73e-d7f79b98a01b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:58.669125 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77c413-3d10-47fa-a73e-d7f79b98a01b admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:58.671093 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1075d49-76fe-4053-9754-e5fbba0bdc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:58.671810 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1075d49-76fe-4053-9754-e5fbba0bdc10 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:58.672105 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1075d49-76fe-4053-9754-e5fbba0bdc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:58.672371 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1075d49-76fe-4053-9754-e5fbba0bdc10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:58.673104 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1075d49-76fe-4053-9754-e5fbba0bdc10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:58.674163 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:14:58.675314 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1075d49-76fe-4053-9754-e5fbba0bdc10 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:58.691991 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 814/1597] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:14:58.693742 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1075d49-76fe-4053-9754-e5fbba0bdc10 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:58.699462 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 784/1598] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:14:58.703037 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77c413-3d10-47fa-a73e-d7f79b98a01b admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:58.709707 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1075d49-76fe-4053-9754-e5fbba0bdc10 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:58.715319 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6a47a-cac0-473c-8f58-f5a0277fc746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:58.716263 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6a47a-cac0-473c-8f58-f5a0277fc746 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:58.716545 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6a47a-cac0-473c-8f58-f5a0277fc746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:58.716823 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6a47a-cac0-473c-8f58-f5a0277fc746 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:58.717522 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a6a47a-cac0-473c-8f58-f5a0277fc746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:58.718639 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77c413-3d10-47fa-a73e-d7f79b98a01b admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:58.719165 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a6a47a-cac0-473c-8f58-f5a0277fc746 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:58.723262 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:14:58.724028 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86418a0c-5d75-4dd7-8760-99444d994441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:58.724745 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86418a0c-5d75-4dd7-8760-99444d994441 admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:58.724998 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86418a0c-5d75-4dd7-8760-99444d994441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:58.725278 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86418a0c-5d75-4dd7-8760-99444d994441 admin admin] PATH_INFO: `/v3/projects/86bf27c8c9de48d992e713119637ec52/users/24ff1700ea7a4456868990c1abc6dea9/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:58.736088 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 815/1599] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:14:58.737372 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6a47a-cac0-473c-8f58-f5a0277fc746 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:58.741204 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-69a6a47a-cac0-473c-8f58-f5a0277fc746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:14:58.758529 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86418a0c-5d75-4dd7-8760-99444d994441 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86bf27c8c9de48d992e713119637ec52, user_id=24ff1700ea7a4456868990c1abc6dea9, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:58.762990 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86418a0c-5d75-4dd7-8760-99444d994441 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:58.788643 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 785/1600] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:14:58 2022] PUT /identity/v3/projects/86bf27c8c9de48d992e713119637ec52/users/24ff1700ea7a4456868990c1abc6dea9/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:14:58.789675 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86418a0c-5d75-4dd7-8760-99444d994441 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:58.848299 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6a47a-cac0-473c-8f58-f5a0277fc746 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:58.895858 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86418a0c-5d75-4dd7-8760-99444d994441 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:58.903193 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b7dce9-80a2-4a0a-97a0-3a188e5f7812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:58.904549 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7dce9-80a2-4a0a-97a0-3a188e5f7812 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:58.905121 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7dce9-80a2-4a0a-97a0-3a188e5f7812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:58.905553 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7dce9-80a2-4a0a-97a0-3a188e5f7812 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:58.906618 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b7dce9-80a2-4a0a-97a0-3a188e5f7812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:58.909060 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b7dce9-80a2-4a0a-97a0-3a188e5f7812 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:58.916278 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05eac1a-88d1-4246-b037-8dac9c7181be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:58.916458 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05eac1a-88d1-4246-b037-8dac9c7181be service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:58.916750 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05eac1a-88d1-4246-b037-8dac9c7181be service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:58.917022 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05eac1a-88d1-4246-b037-8dac9c7181be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:58.921992 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 786/1601] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:14:58.923557 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8caa06-9e62-43d5-a1f7-01b24caf5dad None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:58.923904 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8caa06-9e62-43d5-a1f7-01b24caf5dad None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:58.924117 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8caa06-9e62-43d5-a1f7-01b24caf5dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:58.931986 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05eac1a-88d1-4246-b037-8dac9c7181be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:58.934010 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05eac1a-88d1-4246-b037-8dac9c7181be service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:58.945446 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 816/1602] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:14:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:14:58.946482 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05eac1a-88d1-4246-b037-8dac9c7181be service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:58.956173 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-1f8caa06-9e62-43d5-a1f7-01b24caf5dad None None] MFA Rules not processed for user `b6f87ffe270340ccb98e06f86615d700`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:14:58.957458 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-1f8caa06-9e62-43d5-a1f7-01b24caf5dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:14:58.957949 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05eac1a-88d1-4246-b037-8dac9c7181be service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:58.964072 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0b1ce-4b19-44b7-92ca-4e5d87473b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:58.964779 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0b1ce-4b19-44b7-92ca-4e5d87473b63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:58.965349 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0b1ce-4b19-44b7-92ca-4e5d87473b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:58.965627 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0b1ce-4b19-44b7-92ca-4e5d87473b63 admin admin] PATH_INFO: `/v3/projects/c42c4ac63b43473a9a4f4648ebd2394c/users/d4a740cae0994b70b8bd0ae43853f284/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:58.982461 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a0b1ce-4b19-44b7-92ca-4e5d87473b63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c42c4ac63b43473a9a4f4648ebd2394c, user_id=d4a740cae0994b70b8bd0ae43853f284, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:58.985877 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a0b1ce-4b19-44b7-92ca-4e5d87473b63 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:59.024153 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 817/1603] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:14:58 2022] PUT /identity/v3/projects/c42c4ac63b43473a9a4f4648ebd2394c/users/d4a740cae0994b70b8bd0ae43853f284/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:14:59.025304 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0b1ce-4b19-44b7-92ca-4e5d87473b63 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:59.109334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 787/1604] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:14:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:14:59.110602 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8caa06-9e62-43d5-a1f7-01b24caf5dad None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:59.116086 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0b1ce-4b19-44b7-92ca-4e5d87473b63 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:59.124251 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166550ab-2fec-4d32-8db7-4ea426f6f825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:59.125074 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166550ab-2fec-4d32-8db7-4ea426f6f825 admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:59.125775 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166550ab-2fec-4d32-8db7-4ea426f6f825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:59.126080 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166550ab-2fec-4d32-8db7-4ea426f6f825 admin admin] PATH_INFO: `/v3/projects/a6a9449a682849ff8fbef0b5b228a6e1/users/7f0dc64091fc4480a9b0f3aed10ecebe/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:59.127072 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8caa06-9e62-43d5-a1f7-01b24caf5dad None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:59.141085 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4188f4b-da83-4b03-89ff-fbde53c553b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:59.141834 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4188f4b-da83-4b03-89ff-fbde53c553b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:59.142117 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4188f4b-da83-4b03-89ff-fbde53c553b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:59.142510 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4188f4b-da83-4b03-89ff-fbde53c553b8 admin admin] PATH_INFO: `/v3/projects/e30165d124e94be0ac259814bed8f66c/users/f57e4007372a447db59f6d64b5e03794/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:59.146151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166550ab-2fec-4d32-8db7-4ea426f6f825 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6a9449a682849ff8fbef0b5b228a6e1, user_id=7f0dc64091fc4480a9b0f3aed10ecebe, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:59.149763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166550ab-2fec-4d32-8db7-4ea426f6f825 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:59.172937 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4188f4b-da83-4b03-89ff-fbde53c553b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e30165d124e94be0ac259814bed8f66c, user_id=f57e4007372a447db59f6d64b5e03794, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:59.176437 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4188f4b-da83-4b03-89ff-fbde53c553b8 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:59.179860 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 818/1605] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:14:59 2022] PUT /identity/v3/projects/a6a9449a682849ff8fbef0b5b228a6e1/users/7f0dc64091fc4480a9b0f3aed10ecebe/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:14:59.187587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed805b4-7861-4316-86e7-ba86cd3f080e None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:59.187587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed805b4-7861-4316-86e7-ba86cd3f080e None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:59.187587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed805b4-7861-4316-86e7-ba86cd3f080e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:59.212594 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 788/1606] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:14:59 2022] PUT /identity/v3/projects/e30165d124e94be0ac259814bed8f66c/users/f57e4007372a447db59f6d64b5e03794/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:14:59.213775 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4188f4b-da83-4b03-89ff-fbde53c553b8 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:59.217067 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-2ed805b4-7861-4316-86e7-ba86cd3f080e None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:14:59.219316 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-2ed805b4-7861-4316-86e7-ba86cd3f080e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:14:59.238413 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:14:59.313580 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:14:59.331933 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 819/1607] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:14:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:14:59.335315 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ffc885-2160-4c10-a2ad-58fbbb54494b None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:59.335315 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ffc885-2160-4c10-a2ad-58fbbb54494b None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:59.335315 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ffc885-2160-4c10-a2ad-58fbbb54494b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:59.356928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4188f4b-da83-4b03-89ff-fbde53c553b8 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:59.373762 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71df68-b33f-4d0a-8aea-59c44a08ebff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:59.376214 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71df68-b33f-4d0a-8aea-59c44a08ebff admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:59.377487 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71df68-b33f-4d0a-8aea-59c44a08ebff admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:59.377758 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71df68-b33f-4d0a-8aea-59c44a08ebff admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:59.380336 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef71df68-b33f-4d0a-8aea-59c44a08ebff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:59.386213 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef71df68-b33f-4d0a-8aea-59c44a08ebff admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:59.390119 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-e2ffc885-2160-4c10-a2ad-58fbbb54494b None None] MFA Rules not processed for user `d4a740cae0994b70b8bd0ae43853f284`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:14:59.391409 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-e2ffc885-2160-4c10-a2ad-58fbbb54494b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:14:59.403345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 789/1608] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:14:59.408173 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71df68-b33f-4d0a-8aea-59c44a08ebff admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:59.437900 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71df68-b33f-4d0a-8aea-59c44a08ebff admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:59.447811 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c651eb-c563-4cce-a6a4-aec2c586428f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:59.448827 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c651eb-c563-4cce-a6a4-aec2c586428f admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:59.449293 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c651eb-c563-4cce-a6a4-aec2c586428f admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:59.449806 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c651eb-c563-4cce-a6a4-aec2c586428f admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:59.450645 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c651eb-c563-4cce-a6a4-aec2c586428f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:59.455905 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c651eb-c563-4cce-a6a4-aec2c586428f admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:59.484208 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 820/1609] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:14:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:14:59.484208 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e201ab8-0e38-4387-b7df-51b8839d0e9d None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:59.484208 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e201ab8-0e38-4387-b7df-51b8839d0e9d None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:59.484208 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e201ab8-0e38-4387-b7df-51b8839d0e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:59.508247 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 790/1610] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:14:59 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:14:59.509462 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265161f-b32f-41b1-99a9-86c96548a022 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:59.510377 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265161f-b32f-41b1-99a9-86c96548a022 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:59.510377 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265161f-b32f-41b1-99a9-86c96548a022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:59.535446 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-5e201ab8-0e38-4387-b7df-51b8839d0e9d None None] MFA Rules not processed for user `7f0dc64091fc4480a9b0f3aed10ecebe`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:14:59.536742 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-5e201ab8-0e38-4387-b7df-51b8839d0e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:14:59.543896 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-8265161f-b32f-41b1-99a9-86c96548a022 None None] MFA Rules not processed for user `f57e4007372a447db59f6d64b5e03794`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:14:59.545278 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-8265161f-b32f-41b1-99a9-86c96548a022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:14:59.621777 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 791/1611] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:14:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:14:59.623151 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265161f-b32f-41b1-99a9-86c96548a022 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:59.651860 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 821/1612] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:14:59 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:14:59.653138 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e201ab8-0e38-4387-b7df-51b8839d0e9d None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:59.705569 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265161f-b32f-41b1-99a9-86c96548a022 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:59.706632 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:14:59.712635 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d0cf7c-d235-4d57-a22e-f9fe66ddc623 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:59.713284 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0cf7c-d235-4d57-a22e-f9fe66ddc623 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:59.713566 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0cf7c-d235-4d57-a22e-f9fe66ddc623 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:59.713976 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0cf7c-d235-4d57-a22e-f9fe66ddc623 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:59.736748 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e201ab8-0e38-4387-b7df-51b8839d0e9d None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:59.748734 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4b6dc-05cc-4f19-9d48-2c65946147b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:59.750105 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4b6dc-05cc-4f19-9d48-2c65946147b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:59.750869 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4b6dc-05cc-4f19-9d48-2c65946147b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:59.751242 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4b6dc-05cc-4f19-9d48-2c65946147b3 admin admin] PATH_INFO: `/v3/projects/2dff0191b8f64480a5a0e4db14b36195/users/79771dfb39134ed8b7a4961a079bca02/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:59.771317 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d4b6dc-05cc-4f19-9d48-2c65946147b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dff0191b8f64480a5a0e4db14b36195, user_id=79771dfb39134ed8b7a4961a079bca02, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:59.774949 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d4b6dc-05cc-4f19-9d48-2c65946147b3 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:59.782855 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:14:59.794278 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 822/1613] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:14:59 2022] PUT /identity/v3/projects/2dff0191b8f64480a5a0e4db14b36195/users/79771dfb39134ed8b7a4961a079bca02/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:14:59.800809 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4b6dc-05cc-4f19-9d48-2c65946147b3 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:59.804437 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d0cf7c-d235-4d57-a22e-f9fe66ddc623 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:59.806110 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d0cf7c-d235-4d57-a22e-f9fe66ddc623 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:59.819236 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 792/1614] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:14:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:14:59.820582 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d0cf7c-d235-4d57-a22e-f9fe66ddc623 service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:59.832410 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d0cf7c-d235-4d57-a22e-f9fe66ddc623 service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:59.875752 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4b6dc-05cc-4f19-9d48-2c65946147b3 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:59.880561 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d3711-9d1c-4a29-9d6d-bba3b7962150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:59.881202 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d3711-9d1c-4a29-9d6d-bba3b7962150 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:59.881477 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d3711-9d1c-4a29-9d6d-bba3b7962150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:59.881744 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d3711-9d1c-4a29-9d6d-bba3b7962150 admin admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:59.882504 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d3711-9d1c-4a29-9d6d-bba3b7962150 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:59.884990 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d3711-9d1c-4a29-9d6d-bba3b7962150 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:59.906611 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455b691-2c6b-4942-999e-b802554b3d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:59.907064 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455b691-2c6b-4942-999e-b802554b3d34 admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:59.907340 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455b691-2c6b-4942-999e-b802554b3d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:59.907731 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455b691-2c6b-4942-999e-b802554b3d34 admin admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:59.908558 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455b691-2c6b-4942-999e-b802554b3d34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:59.910557 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455b691-2c6b-4942-999e-b802554b3d34 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:59.924734 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 823/1615] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:14:59 2022] POST /identity/v3/projects => generated 391 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:14:59.929447 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d3711-9d1c-4a29-9d6d-bba3b7962150 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:59.967368 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 793/1616] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:14:59 2022] POST /identity/v3/users => generated 298 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:14:59.973781 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455b691-2c6b-4942-999e-b802554b3d34 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:59.999142 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455b691-2c6b-4942-999e-b802554b3d34 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:00.033656 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d3711-9d1c-4a29-9d6d-bba3b7962150 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:00.042233 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2adf42c-10f1-4e00-9932-3cb30d56273e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:00.043192 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2adf42c-10f1-4e00-9932-3cb30d56273e admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:00.043898 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2adf42c-10f1-4e00-9932-3cb30d56273e admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:00.044382 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2adf42c-10f1-4e00-9932-3cb30d56273e admin admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:00.045322 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2adf42c-10f1-4e00-9932-3cb30d56273e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:00.048330 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2adf42c-10f1-4e00-9932-3cb30d56273e admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:00.094354 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 824/1617] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:14:59 2022] POST /identity/v3/projects => generated 373 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:15:00.096199 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc202ddc-6b3b-4033-9f5b-91ffc9ab9fac None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:00.096647 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc202ddc-6b3b-4033-9f5b-91ffc9ab9fac None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:00.097152 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc202ddc-6b3b-4033-9f5b-91ffc9ab9fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:00.135512 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-bc202ddc-6b3b-4033-9f5b-91ffc9ab9fac None None] MFA Rules not processed for user `79771dfb39134ed8b7a4961a079bca02`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:00.136880 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-bc202ddc-6b3b-4033-9f5b-91ffc9ab9fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:00.157850 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c7e74-b024-4d85-b33d-529404008618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:00.158577 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c7e74-b024-4d85-b33d-529404008618 admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:00.158954 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c7e74-b024-4d85-b33d-529404008618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:00.159224 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c7e74-b024-4d85-b33d-529404008618 admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:00.160252 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c7e74-b024-4d85-b33d-529404008618 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:00.162394 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c7e74-b024-4d85-b33d-529404008618 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:00.169620 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:00.227150 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 794/1618] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:14:59 2022] POST /identity/v3/projects => generated 397 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:15:00.228421 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c7e74-b024-4d85-b33d-529404008618 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:00.288636 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 825/1619] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:15:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:15:00.297152 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc202ddc-6b3b-4033-9f5b-91ffc9ab9fac None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:00.339909 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c7e74-b024-4d85-b33d-529404008618 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:00.348046 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd7f90-50d0-40b7-aaac-db5909fc2b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:00.348947 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd7f90-50d0-40b7-aaac-db5909fc2b4d admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:00.349356 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd7f90-50d0-40b7-aaac-db5909fc2b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:00.350433 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd7f90-50d0-40b7-aaac-db5909fc2b4d admin admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:00.350555 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cd7f90-50d0-40b7-aaac-db5909fc2b4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:00.357497 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cd7f90-50d0-40b7-aaac-db5909fc2b4d admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:00.383925 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:00.431475 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 795/1620] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:15:00 2022] POST /identity/v3/users => generated 302 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:15:00.433507 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd7f90-50d0-40b7-aaac-db5909fc2b4d admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:00.458454 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd7f90-50d0-40b7-aaac-db5909fc2b4d admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:00.467338 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc202ddc-6b3b-4033-9f5b-91ffc9ab9fac None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:00.473025 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b1ffe-daa4-4eab-94c4-ce4271f52897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:00.473692 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b1ffe-daa4-4eab-94c4-ce4271f52897 admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:00.473980 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b1ffe-daa4-4eab-94c4-ce4271f52897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:00.474903 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b1ffe-daa4-4eab-94c4-ce4271f52897 admin admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:00.475623 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b1ffe-daa4-4eab-94c4-ce4271f52897 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:00.479222 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b1ffe-daa4-4eab-94c4-ce4271f52897 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:00.485471 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d4bb3-3fac-447d-974d-c6693bef4a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:00.486292 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d4bb3-3fac-447d-974d-c6693bef4a6e admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:00.486454 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d4bb3-3fac-447d-974d-c6693bef4a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:00.486785 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d4bb3-3fac-447d-974d-c6693bef4a6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:00.487764 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d4bb3-3fac-447d-974d-c6693bef4a6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:00.490010 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d4bb3-3fac-447d-974d-c6693bef4a6e admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:00.513161 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 826/1621] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:15:00.514313 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d4bb3-3fac-447d-974d-c6693bef4a6e admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:00.530285 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 796/1622] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:15:00 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:15:00.531630 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b1ffe-daa4-4eab-94c4-ce4271f52897 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:00.541093 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d4bb3-3fac-447d-974d-c6693bef4a6e admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:00.548246 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b1ffe-daa4-4eab-94c4-ce4271f52897 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:00.551576 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12bf5f0-23f3-436e-b2f7-ffe924c7068e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:00.552412 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bf5f0-23f3-436e-b2f7-ffe924c7068e admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:00.552844 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bf5f0-23f3-436e-b2f7-ffe924c7068e admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:00.553288 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bf5f0-23f3-436e-b2f7-ffe924c7068e admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:00.554058 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced4f206-6075-4aed-8181-3263123e72b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:00.554256 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12bf5f0-23f3-436e-b2f7-ffe924c7068e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:00.554913 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4f206-6075-4aed-8181-3263123e72b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:00.555278 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4f206-6075-4aed-8181-3263123e72b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:00.555697 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4f206-6075-4aed-8181-3263123e72b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:00.556485 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced4f206-6075-4aed-8181-3263123e72b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:00.557543 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12bf5f0-23f3-436e-b2f7-ffe924c7068e admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:00.558634 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced4f206-6075-4aed-8181-3263123e72b5 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:00.594394 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 827/1623] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:15:00 2022] POST /identity/v3/users => generated 305 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:15:00.596159 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12bf5f0-23f3-436e-b2f7-ffe924c7068e admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:00.601560 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 797/1624] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:15:00 2022] POST /identity/v3/projects => generated 381 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:15:00.602695 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced4f206-6075-4aed-8181-3263123e72b5 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:00.615370 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12bf5f0-23f3-436e-b2f7-ffe924c7068e admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:00.708602 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c9eb0-9058-4370-8e3c-eb0cf3658d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:00.709961 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c9eb0-9058-4370-8e3c-eb0cf3658d34 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:00.710560 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c9eb0-9058-4370-8e3c-eb0cf3658d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:00.711680 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c9eb0-9058-4370-8e3c-eb0cf3658d34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:00.712559 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c9eb0-9058-4370-8e3c-eb0cf3658d34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:00.714857 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c9eb0-9058-4370-8e3c-eb0cf3658d34 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:00.734440 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 828/1625] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:15:00.735848 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c9eb0-9058-4370-8e3c-eb0cf3658d34 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:00.758069 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c9eb0-9058-4370-8e3c-eb0cf3658d34 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:00.764184 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00402aa-1616-4523-b2e3-54bf6d58dabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:00.765372 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00402aa-1616-4523-b2e3-54bf6d58dabf admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:00.765372 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00402aa-1616-4523-b2e3-54bf6d58dabf admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:00.765797 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced4f206-6075-4aed-8181-3263123e72b5 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:00.766098 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00402aa-1616-4523-b2e3-54bf6d58dabf admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:00.768518 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00402aa-1616-4523-b2e3-54bf6d58dabf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:00.769979 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00402aa-1616-4523-b2e3-54bf6d58dabf admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:00.776421 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55df7a-812c-4eac-8bd1-396db79ea245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:00.777136 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55df7a-812c-4eac-8bd1-396db79ea245 admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:00.777907 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55df7a-812c-4eac-8bd1-396db79ea245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:00.778187 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55df7a-812c-4eac-8bd1-396db79ea245 admin admin] PATH_INFO: `/v3/projects/0c361568389348339f879f51faeda1eb/users/da3472e8fd2e4f71939d3076cf46b97e/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:00.792298 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 829/1626] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:15:00.792298 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00402aa-1616-4523-b2e3-54bf6d58dabf admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:00.803353 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00402aa-1616-4523-b2e3-54bf6d58dabf admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:00.808911 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f789ff-b70f-41ee-b63e-1a75cce4c9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:00.809709 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f789ff-b70f-41ee-b63e-1a75cce4c9c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:00.810077 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f789ff-b70f-41ee-b63e-1a75cce4c9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:00.810470 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f789ff-b70f-41ee-b63e-1a75cce4c9c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:00.811682 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f789ff-b70f-41ee-b63e-1a75cce4c9c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:00.819033 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f789ff-b70f-41ee-b63e-1a75cce4c9c9 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:00.829159 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d55df7a-812c-4eac-8bd1-396db79ea245 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c361568389348339f879f51faeda1eb, user_id=da3472e8fd2e4f71939d3076cf46b97e, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:00.836463 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d55df7a-812c-4eac-8bd1-396db79ea245 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:00.846454 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 830/1627] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:15:00.849417 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f789ff-b70f-41ee-b63e-1a75cce4c9c9 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:00.872189 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 798/1628] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:15:00 2022] PUT /identity/v3/projects/0c361568389348339f879f51faeda1eb/users/da3472e8fd2e4f71939d3076cf46b97e/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:15:00.873235 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55df7a-812c-4eac-8bd1-396db79ea245 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:00.882407 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f789ff-b70f-41ee-b63e-1a75cce4c9c9 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:00.915609 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:00.968007 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55df7a-812c-4eac-8bd1-396db79ea245 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:00.975229 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db30167-af4c-4adc-aae5-124d3dc9284a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:00.976349 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db30167-af4c-4adc-aae5-124d3dc9284a admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:00.976843 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db30167-af4c-4adc-aae5-124d3dc9284a admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:00.977327 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db30167-af4c-4adc-aae5-124d3dc9284a admin admin] PATH_INFO: `/v3/projects/d700ea394d78489787977e8c404e505e/users/d6ad93e38fae42f5aff54a6dc13b0132/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:00.997730 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db30167-af4c-4adc-aae5-124d3dc9284a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d700ea394d78489787977e8c404e505e, user_id=d6ad93e38fae42f5aff54a6dc13b0132, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:01.002335 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db30167-af4c-4adc-aae5-124d3dc9284a admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:01.034891 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 799/1629] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:15:00 2022] PUT /identity/v3/projects/d700ea394d78489787977e8c404e505e/users/d6ad93e38fae42f5aff54a6dc13b0132/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:15:01.035896 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db30167-af4c-4adc-aae5-124d3dc9284a admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:01.043238 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8706881-9c97-48b0-840f-c7e886857b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:01.044611 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8706881-9c97-48b0-840f-c7e886857b2b admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:01.044992 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8706881-9c97-48b0-840f-c7e886857b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:01.046821 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8706881-9c97-48b0-840f-c7e886857b2b admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:01.048336 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8706881-9c97-48b0-840f-c7e886857b2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:01.063019 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8706881-9c97-48b0-840f-c7e886857b2b admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:01.086521 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:01.134478 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 831/1630] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:15:00 2022] POST /identity/v3/users => generated 297 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:15:01.134478 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8706881-9c97-48b0-840f-c7e886857b2b admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:01.160738 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8706881-9c97-48b0-840f-c7e886857b2b admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:01.184931 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db30167-af4c-4adc-aae5-124d3dc9284a admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:01.190728 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452915cd-c8a0-4b69-8963-c67937be7e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:01.191639 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452915cd-c8a0-4b69-8963-c67937be7e6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:01.192325 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452915cd-c8a0-4b69-8963-c67937be7e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:01.192750 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452915cd-c8a0-4b69-8963-c67937be7e6c admin admin] PATH_INFO: `/v3/projects/c0ad346ca8de41eb81f09cf6136a8796/users/739acfb5475b47b9a7ba051cf0b17ae5/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:01.213807 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452915cd-c8a0-4b69-8963-c67937be7e6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0ad346ca8de41eb81f09cf6136a8796, user_id=739acfb5475b47b9a7ba051cf0b17ae5, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:01.217192 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452915cd-c8a0-4b69-8963-c67937be7e6c admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:01.249287 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 800/1631] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:15:01 2022] PUT /identity/v3/projects/c0ad346ca8de41eb81f09cf6136a8796/users/739acfb5475b47b9a7ba051cf0b17ae5/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:15:01.251862 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452915cd-c8a0-4b69-8963-c67937be7e6c admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:01.290171 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a13ad9a-5484-41cb-9bb8-003ef3b4bd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:01.294683 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13ad9a-5484-41cb-9bb8-003ef3b4bd3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:01.295314 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13ad9a-5484-41cb-9bb8-003ef3b4bd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:01.297002 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13ad9a-5484-41cb-9bb8-003ef3b4bd3b admin admin] PATH_INFO: `/v3/projects/c112ee823bed4d08a0b3bb879d926659/users/a9ccb8500c5440d5ad6a74e99d0a1aa6/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:01.334878 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a13ad9a-5484-41cb-9bb8-003ef3b4bd3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c112ee823bed4d08a0b3bb879d926659, user_id=a9ccb8500c5440d5ad6a74e99d0a1aa6, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:01.339133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a13ad9a-5484-41cb-9bb8-003ef3b4bd3b admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:01.375057 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 832/1632] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:15:01 2022] PUT /identity/v3/projects/c112ee823bed4d08a0b3bb879d926659/users/a9ccb8500c5440d5ad6a74e99d0a1aa6/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:15:01.376783 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a13ad9a-5484-41cb-9bb8-003ef3b4bd3b admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:01.426133 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452915cd-c8a0-4b69-8963-c67937be7e6c admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:01.542440 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a13ad9a-5484-41cb-9bb8-003ef3b4bd3b admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:01.555686 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18468b46-eafc-4edc-a84f-e8aec8349c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:01.556816 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18468b46-eafc-4edc-a84f-e8aec8349c0c admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:01.557387 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18468b46-eafc-4edc-a84f-e8aec8349c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:01.557871 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18468b46-eafc-4edc-a84f-e8aec8349c0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:01.559555 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18468b46-eafc-4edc-a84f-e8aec8349c0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:01.562401 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18468b46-eafc-4edc-a84f-e8aec8349c0c admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:01.574188 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98b60f-58ef-458c-9582-5b9c50ee91f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:01.575233 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98b60f-58ef-458c-9582-5b9c50ee91f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:01.575738 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98b60f-58ef-458c-9582-5b9c50ee91f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:01.576196 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98b60f-58ef-458c-9582-5b9c50ee91f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:01.577383 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f98b60f-58ef-458c-9582-5b9c50ee91f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:01.580356 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f98b60f-58ef-458c-9582-5b9c50ee91f6 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:01.587746 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 833/1633] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:15:01.590447 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18468b46-eafc-4edc-a84f-e8aec8349c0c admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:01.604852 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 801/1634] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:15:01.607695 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98b60f-58ef-458c-9582-5b9c50ee91f6 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:01.610235 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18468b46-eafc-4edc-a84f-e8aec8349c0c admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:01.625710 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6524ae1-7dbe-4f65-8a81-a1ea2d188761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:01.626736 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6524ae1-7dbe-4f65-8a81-a1ea2d188761 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:01.627196 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6524ae1-7dbe-4f65-8a81-a1ea2d188761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:01.627831 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6524ae1-7dbe-4f65-8a81-a1ea2d188761 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:01.628731 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6524ae1-7dbe-4f65-8a81-a1ea2d188761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:01.631211 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98b60f-58ef-458c-9582-5b9c50ee91f6 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:01.632698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6524ae1-7dbe-4f65-8a81-a1ea2d188761 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:01.644654 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6220ede5-b07e-403a-adec-c6d55d29b6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:01.645672 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220ede5-b07e-403a-adec-c6d55d29b6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:01.646138 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220ede5-b07e-403a-adec-c6d55d29b6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:01.646618 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220ede5-b07e-403a-adec-c6d55d29b6b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:01.647609 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6220ede5-b07e-403a-adec-c6d55d29b6b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:01.649915 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6220ede5-b07e-403a-adec-c6d55d29b6b1 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:01.665148 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 834/1635] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:15:01.666918 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6524ae1-7dbe-4f65-8a81-a1ea2d188761 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:01.679798 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 802/1636] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:15:01.681070 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6220ede5-b07e-403a-adec-c6d55d29b6b1 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:01.683435 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6524ae1-7dbe-4f65-8a81-a1ea2d188761 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:01.696013 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f003a82-2d62-4bf3-b29d-519dc82ef281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:01.697575 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f003a82-2d62-4bf3-b29d-519dc82ef281 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:01.697951 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f003a82-2d62-4bf3-b29d-519dc82ef281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:01.699031 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f003a82-2d62-4bf3-b29d-519dc82ef281 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:01.700115 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f003a82-2d62-4bf3-b29d-519dc82ef281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:01.704183 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6220ede5-b07e-403a-adec-c6d55d29b6b1 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:01.705374 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f003a82-2d62-4bf3-b29d-519dc82ef281 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:01.710501 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:01.716483 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867544b-cfd8-4c56-a2e0-87231e247860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:01.719777 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867544b-cfd8-4c56-a2e0-87231e247860 admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:01.722463 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867544b-cfd8-4c56-a2e0-87231e247860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:01.722463 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867544b-cfd8-4c56-a2e0-87231e247860 admin admin] PATH_INFO: `/v3/projects/d700ea394d78489787977e8c404e505e/users/d6ad93e38fae42f5aff54a6dc13b0132/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:01.725491 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f867544b-cfd8-4c56-a2e0-87231e247860 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d700ea394d78489787977e8c404e505e, user_id=d6ad93e38fae42f5aff54a6dc13b0132, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:01.737999 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f867544b-cfd8-4c56-a2e0-87231e247860 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:01.741780 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 835/1637] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:15:01.744428 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f003a82-2d62-4bf3-b29d-519dc82ef281 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:01.794706 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 803/1638] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:15:01 2022] PUT /identity/v3/projects/d700ea394d78489787977e8c404e505e/users/d6ad93e38fae42f5aff54a6dc13b0132/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:15:01.795444 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f003a82-2d62-4bf3-b29d-519dc82ef281 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:01.797709 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867544b-cfd8-4c56-a2e0-87231e247860 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:01.880173 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:01.961487 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c78ad-22a9-4fb8-a633-13c695d023bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:01.963304 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c78ad-22a9-4fb8-a633-13c695d023bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:01.963967 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c78ad-22a9-4fb8-a633-13c695d023bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:01.964430 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c78ad-22a9-4fb8-a633-13c695d023bc admin admin] PATH_INFO: `/v3/projects/0c361568389348339f879f51faeda1eb/users/da3472e8fd2e4f71939d3076cf46b97e/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:01.966582 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867544b-cfd8-4c56-a2e0-87231e247860 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:01.967126 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c78ad-22a9-4fb8-a633-13c695d023bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c361568389348339f879f51faeda1eb, user_id=da3472e8fd2e4f71939d3076cf46b97e, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:01.971103 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c78ad-22a9-4fb8-a633-13c695d023bc admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:01.979780 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71888445-908d-4505-a977-beddb85c89b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:01.981038 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71888445-908d-4505-a977-beddb85c89b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:01.981282 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71888445-908d-4505-a977-beddb85c89b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:01.981562 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71888445-908d-4505-a977-beddb85c89b0 admin admin] PATH_INFO: `/v3/projects/fdf2b48f565548a397667afd95428412/users/ec1e9a637ac5454ab598a47fc60d593b/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:01.997282 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 836/1639] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:15:01 2022] PUT /identity/v3/projects/0c361568389348339f879f51faeda1eb/users/da3472e8fd2e4f71939d3076cf46b97e/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:15:01.998565 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c78ad-22a9-4fb8-a633-13c695d023bc admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:02.030067 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71888445-908d-4505-a977-beddb85c89b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdf2b48f565548a397667afd95428412, user_id=ec1e9a637ac5454ab598a47fc60d593b, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:02.035897 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71888445-908d-4505-a977-beddb85c89b0 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:02.064254 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 804/1640] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:15:01 2022] PUT /identity/v3/projects/fdf2b48f565548a397667afd95428412/users/ec1e9a637ac5454ab598a47fc60d593b/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:15:02.065979 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71888445-908d-4505-a977-beddb85c89b0 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:02.117793 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c78ad-22a9-4fb8-a633-13c695d023bc admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:02.200521 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd705a-7647-4f6f-bf1a-7cde2c70dc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:02.202852 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd705a-7647-4f6f-bf1a-7cde2c70dc17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:02.203264 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd705a-7647-4f6f-bf1a-7cde2c70dc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:02.204115 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd705a-7647-4f6f-bf1a-7cde2c70dc17 admin admin] PATH_INFO: `/v3/projects/c0ad346ca8de41eb81f09cf6136a8796/users/739acfb5475b47b9a7ba051cf0b17ae5/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:02.206484 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd705a-7647-4f6f-bf1a-7cde2c70dc17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0ad346ca8de41eb81f09cf6136a8796, user_id=739acfb5475b47b9a7ba051cf0b17ae5, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:02.209477 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd705a-7647-4f6f-bf1a-7cde2c70dc17 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:02.226826 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71888445-908d-4505-a977-beddb85c89b0 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:02.244345 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 837/1641] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:15:01 2022] PUT /identity/v3/projects/c0ad346ca8de41eb81f09cf6136a8796/users/739acfb5475b47b9a7ba051cf0b17ae5/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:15:02.248416 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c6912-997b-4810-ba26-74a5448fceae None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:02.250845 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c6912-997b-4810-ba26-74a5448fceae None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:02.251301 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c6912-997b-4810-ba26-74a5448fceae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:02.344836 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-011c6912-997b-4810-ba26-74a5448fceae None None] MFA Rules not processed for user `d6ad93e38fae42f5aff54a6dc13b0132`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:02.347433 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-011c6912-997b-4810-ba26-74a5448fceae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:02.356356 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f0cb9-c1e6-4e94-9b47-42cb3b44a79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:02.357510 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f0cb9-c1e6-4e94-9b47-42cb3b44a79e admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:02.357927 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f0cb9-c1e6-4e94-9b47-42cb3b44a79e admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:02.358562 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f0cb9-c1e6-4e94-9b47-42cb3b44a79e admin admin] PATH_INFO: `/v3/projects/c112ee823bed4d08a0b3bb879d926659/users/a9ccb8500c5440d5ad6a74e99d0a1aa6/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:02.368104 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8f0cb9-c1e6-4e94-9b47-42cb3b44a79e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c112ee823bed4d08a0b3bb879d926659, user_id=a9ccb8500c5440d5ad6a74e99d0a1aa6, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:02.371074 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8f0cb9-c1e6-4e94-9b47-42cb3b44a79e admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:02.395629 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 805/1642] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:15:02 2022] PUT /identity/v3/projects/c112ee823bed4d08a0b3bb879d926659/users/a9ccb8500c5440d5ad6a74e99d0a1aa6/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:15:02.399286 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24fbf2a-855e-4b0e-a9be-d0d6221345bb None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:02.399852 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24fbf2a-855e-4b0e-a9be-d0d6221345bb None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:02.400262 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24fbf2a-855e-4b0e-a9be-d0d6221345bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:02.400365 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:02.464175 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-f24fbf2a-855e-4b0e-a9be-d0d6221345bb None None] MFA Rules not processed for user `da3472e8fd2e4f71939d3076cf46b97e`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:02.471880 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-f24fbf2a-855e-4b0e-a9be-d0d6221345bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:02.520097 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 838/1643] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:15:02 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:15:02.521070 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c6912-997b-4810-ba26-74a5448fceae None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:02.544132 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c6912-997b-4810-ba26-74a5448fceae None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:02.550478 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:02.630069 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 806/1644] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:15:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:15:02.634789 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5fd7a-8dd0-4901-bc35-9aec0b0c0a60 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:02.635193 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5fd7a-8dd0-4901-bc35-9aec0b0c0a60 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:02.635472 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5fd7a-8dd0-4901-bc35-9aec0b0c0a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:02.678003 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b35b5-01d3-4db4-856b-c331fe66eaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:02.678663 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b35b5-01d3-4db4-856b-c331fe66eaa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:02.678940 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b35b5-01d3-4db4-856b-c331fe66eaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:02.679217 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b35b5-01d3-4db4-856b-c331fe66eaa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:02.683928 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7b35b5-01d3-4db4-856b-c331fe66eaa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:02.685213 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7b35b5-01d3-4db4-856b-c331fe66eaa9 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:02.703391 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-cdb5fd7a-8dd0-4901-bc35-9aec0b0c0a60 None None] MFA Rules not processed for user `739acfb5475b47b9a7ba051cf0b17ae5`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:02.704641 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-cdb5fd7a-8dd0-4901-bc35-9aec0b0c0a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:02.713297 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 839/1645] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:15:02 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:15:02.715353 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfe7fa-650b-4f03-a2a5-404719a4cb3a None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:02.715353 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfe7fa-650b-4f03-a2a5-404719a4cb3a None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:02.715563 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfe7fa-650b-4f03-a2a5-404719a4cb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:02.798101 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-abdfe7fa-650b-4f03-a2a5-404719a4cb3a None None] MFA Rules not processed for user `a9ccb8500c5440d5ad6a74e99d0a1aa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:02.802760 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-abdfe7fa-650b-4f03-a2a5-404719a4cb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:02.908533 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 807/1646] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:15:02 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:15:02.908533 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5fd7a-8dd0-4901-bc35-9aec0b0c0a60 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:03.003940 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 840/1647] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:15:02 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:15:03.008656 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfe7fa-650b-4f03-a2a5-404719a4cb3a None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:03.098253 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5fd7a-8dd0-4901-bc35-9aec0b0c0a60 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:03.113274 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70481e1-e963-484c-8f45-4d7401ea1396 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:03.117891 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70481e1-e963-484c-8f45-4d7401ea1396 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:03.117891 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70481e1-e963-484c-8f45-4d7401ea1396 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:03.117891 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70481e1-e963-484c-8f45-4d7401ea1396 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:03.126633 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:03.159738 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfe7fa-650b-4f03-a2a5-404719a4cb3a None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:03.167628 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe60f0c-be3d-4a9c-ad3b-dd16fe5d4781 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:03.168285 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe60f0c-be3d-4a9c-ad3b-dd16fe5d4781 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:03.168560 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe60f0c-be3d-4a9c-ad3b-dd16fe5d4781 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:03.168828 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe60f0c-be3d-4a9c-ad3b-dd16fe5d4781 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:03.279000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70481e1-e963-484c-8f45-4d7401ea1396 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:03.280424 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70481e1-e963-484c-8f45-4d7401ea1396 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:03.315639 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 808/1648] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:15:02 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:15:03.316651 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70481e1-e963-484c-8f45-4d7401ea1396 service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:03.340493 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe60f0c-be3d-4a9c-ad3b-dd16fe5d4781 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:03.342475 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe60f0c-be3d-4a9c-ad3b-dd16fe5d4781 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:03.343291 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70481e1-e963-484c-8f45-4d7401ea1396 service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:03.354419 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565024d-9520-4dca-ae78-92718fb2e7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:03.355667 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565024d-9520-4dca-ae78-92718fb2e7b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:03.355667 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565024d-9520-4dca-ae78-92718fb2e7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:03.355952 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565024d-9520-4dca-ae78-92718fb2e7b8 admin admin] PATH_INFO: `/v3/projects/fdf2b48f565548a397667afd95428412/users/ec1e9a637ac5454ab598a47fc60d593b/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:03.362596 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4565024d-9520-4dca-ae78-92718fb2e7b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdf2b48f565548a397667afd95428412, user_id=ec1e9a637ac5454ab598a47fc60d593b, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:03.369042 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4565024d-9520-4dca-ae78-92718fb2e7b8 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:03.373575 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 841/1649] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:15:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:15:03.374491 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe60f0c-be3d-4a9c-ad3b-dd16fe5d4781 service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:03.384881 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:03.393490 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe60f0c-be3d-4a9c-ad3b-dd16fe5d4781 service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:03.406067 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 809/1650] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:15:03 2022] PUT /identity/v3/projects/fdf2b48f565548a397667afd95428412/users/ec1e9a637ac5454ab598a47fc60d593b/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:15:03.408894 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565024d-9520-4dca-ae78-92718fb2e7b8 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:03.545578 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada311a8-11a5-4223-b2d7-e58f99f2251f tempest-QuotasNegativeTest-1335818326 tempest-QuotasNegativeTest-1335818326-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '739acfb5475b47b9a7ba051cf0b17ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad346ca8de41eb81f09cf6136a8796', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:03.546607 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada311a8-11a5-4223-b2d7-e58f99f2251f tempest-QuotasNegativeTest-1335818326 tempest-QuotasNegativeTest-1335818326-project-admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:03.548995 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada311a8-11a5-4223-b2d7-e58f99f2251f tempest-QuotasNegativeTest-1335818326 tempest-QuotasNegativeTest-1335818326-project-admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:03.549381 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada311a8-11a5-4223-b2d7-e58f99f2251f tempest-QuotasNegativeTest-1335818326 tempest-QuotasNegativeTest-1335818326-project-admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:03.553583 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada311a8-11a5-4223-b2d7-e58f99f2251f tempest-QuotasNegativeTest-1335818326 tempest-QuotasNegativeTest-1335818326-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:15:03.555383 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada311a8-11a5-4223-b2d7-e58f99f2251f tempest-QuotasNegativeTest-1335818326 tempest-QuotasNegativeTest-1335818326-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:03.557149 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada311a8-11a5-4223-b2d7-e58f99f2251f tempest-QuotasNegativeTest-1335818326 tempest-QuotasNegativeTest-1335818326-project-admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:03.592964 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 842/1651] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:15:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:15:03.592964 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c61547-d9e4-401b-a938-48192e1f918e None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:03.592964 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c61547-d9e4-401b-a938-48192e1f918e None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:03.592964 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c61547-d9e4-401b-a938-48192e1f918e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:03.597249 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565024d-9520-4dca-ae78-92718fb2e7b8 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:03.607730 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6acf22-ce99-46de-a632-cd3aef9ca32c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:03.608448 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6acf22-ce99-46de-a632-cd3aef9ca32c service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:03.608723 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6acf22-ce99-46de-a632-cd3aef9ca32c service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:03.609047 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6acf22-ce99-46de-a632-cd3aef9ca32c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:03.688957 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-a1c61547-d9e4-401b-a938-48192e1f918e None None] MFA Rules not processed for user `ec1e9a637ac5454ab598a47fc60d593b`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:03.690403 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-a1c61547-d9e4-401b-a938-48192e1f918e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:03.719471 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6acf22-ce99-46de-a632-cd3aef9ca32c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:03.722226 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6acf22-ce99-46de-a632-cd3aef9ca32c service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:03.745832 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 810/1652] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:15:03 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:15:03.746568 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6acf22-ce99-46de-a632-cd3aef9ca32c service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:03.770843 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6acf22-ce99-46de-a632-cd3aef9ca32c service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:03.784598 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab3b458-e925-4417-8f69-16a60627dccb tempest-QuotasNegativeTest-1335818326 tempest-QuotasNegativeTest-1335818326-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '739acfb5475b47b9a7ba051cf0b17ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad346ca8de41eb81f09cf6136a8796', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:03.785354 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab3b458-e925-4417-8f69-16a60627dccb tempest-QuotasNegativeTest-1335818326 tempest-QuotasNegativeTest-1335818326-project-admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:03.785744 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab3b458-e925-4417-8f69-16a60627dccb tempest-QuotasNegativeTest-1335818326 tempest-QuotasNegativeTest-1335818326-project-admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:03.786113 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab3b458-e925-4417-8f69-16a60627dccb tempest-QuotasNegativeTest-1335818326 tempest-QuotasNegativeTest-1335818326-project-admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:03.786909 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab3b458-e925-4417-8f69-16a60627dccb tempest-QuotasNegativeTest-1335818326 tempest-QuotasNegativeTest-1335818326-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:03.791040 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab3b458-e925-4417-8f69-16a60627dccb tempest-QuotasNegativeTest-1335818326 tempest-QuotasNegativeTest-1335818326-project-admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:03.847534 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 811/1653] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:15:03 2022] POST /identity/v3/projects => generated 349 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:15:03.853426 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab3b458-e925-4417-8f69-16a60627dccb tempest-QuotasNegativeTest-1335818326 tempest-QuotasNegativeTest-1335818326-project-admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:03.858946 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 843/1654] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:15:03 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:15:03.893107 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c61547-d9e4-401b-a938-48192e1f918e None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:03.909962 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c61547-d9e4-401b-a938-48192e1f918e None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:03.940105 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:04.014493 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab3b458-e925-4417-8f69-16a60627dccb tempest-QuotasNegativeTest-1335818326 tempest-QuotasNegativeTest-1335818326-project-admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:04.034506 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564fbbd-148e-40f5-a502-87130c21f1e9 tempest-QuotasNegativeTest-1335818326 tempest-QuotasNegativeTest-1335818326-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '739acfb5475b47b9a7ba051cf0b17ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad346ca8de41eb81f09cf6136a8796', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:04.035170 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564fbbd-148e-40f5-a502-87130c21f1e9 tempest-QuotasNegativeTest-1335818326 tempest-QuotasNegativeTest-1335818326-project-admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:04.035450 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564fbbd-148e-40f5-a502-87130c21f1e9 tempest-QuotasNegativeTest-1335818326 tempest-QuotasNegativeTest-1335818326-project-admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:04.035770 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564fbbd-148e-40f5-a502-87130c21f1e9 tempest-QuotasNegativeTest-1335818326 tempest-QuotasNegativeTest-1335818326-project-admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:04.036527 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0564fbbd-148e-40f5-a502-87130c21f1e9 tempest-QuotasNegativeTest-1335818326 tempest-QuotasNegativeTest-1335818326-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:15:04.036835 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0564fbbd-148e-40f5-a502-87130c21f1e9 tempest-QuotasNegativeTest-1335818326 tempest-QuotasNegativeTest-1335818326-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:04.040179 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0564fbbd-148e-40f5-a502-87130c21f1e9 tempest-QuotasNegativeTest-1335818326 tempest-QuotasNegativeTest-1335818326-project-admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:04.057888 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc1c4f-b903-45e6-b21d-05bb8dda20e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:04.058605 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc1c4f-b903-45e6-b21d-05bb8dda20e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:04.058883 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc1c4f-b903-45e6-b21d-05bb8dda20e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:04.060635 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc1c4f-b903-45e6-b21d-05bb8dda20e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:04.091978 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 812/1655] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:15:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:15:04.137139 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564fbbd-148e-40f5-a502-87130c21f1e9 tempest-QuotasNegativeTest-1335818326 tempest-QuotasNegativeTest-1335818326-project-admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:04.153804 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564fbbd-148e-40f5-a502-87130c21f1e9 tempest-QuotasNegativeTest-1335818326 tempest-QuotasNegativeTest-1335818326-project-admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:04.177884 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a4fbd-baff-4964-a89a-ed0035f4e517 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:04.179221 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a4fbd-baff-4964-a89a-ed0035f4e517 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:04.180717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a4fbd-baff-4964-a89a-ed0035f4e517 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:04.181261 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a4fbd-baff-4964-a89a-ed0035f4e517 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:04.227519 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a4fbd-baff-4964-a89a-ed0035f4e517 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:04.232479 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a4fbd-baff-4964-a89a-ed0035f4e517 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:04.233808 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc1c4f-b903-45e6-b21d-05bb8dda20e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:04.235257 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc1c4f-b903-45e6-b21d-05bb8dda20e6 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:04.255230 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 844/1656] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:15:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:15:04.275739 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 813/1657] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:15:04 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:15:05.304922 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc1c4f-b903-45e6-b21d-05bb8dda20e6 service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:05.314671 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc1c4f-b903-45e6-b21d-05bb8dda20e6 service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:05.328852 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d7641-f107-49f8-a5b2-a4864cd94b54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:05.329600 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d7641-f107-49f8-a5b2-a4864cd94b54 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:05.330198 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d7641-f107-49f8-a5b2-a4864cd94b54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:05.330526 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d7641-f107-49f8-a5b2-a4864cd94b54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:05.393108 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3503fb-bde7-4e95-849a-42dc1e514de3 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:05.393686 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3503fb-bde7-4e95-849a-42dc1e514de3 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:05.394031 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3503fb-bde7-4e95-849a-42dc1e514de3 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:05.397022 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 814/1658] 10.222.0.60 () {54 vars in 962 bytes} [Sun Jul 31 01:15:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:15:05.422898 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2f050-2687-4824-b4d0-371759f2539c None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:05.423367 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2f050-2687-4824-b4d0-371759f2539c None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:05.423779 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2f050-2687-4824-b4d0-371759f2539c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:05.486764 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d7641-f107-49f8-a5b2-a4864cd94b54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:05.489419 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d7641-f107-49f8-a5b2-a4864cd94b54 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:05.491963 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:05.523088 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 845/1659] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:15:05 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:15:05.546240 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-b1a2f050-2687-4824-b4d0-371759f2539c None None] MFA Rules not processed for user `04591cd035ef4961b8b7a93e294eb881`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:05.547742 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-b1a2f050-2687-4824-b4d0-371759f2539c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:05.758524 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 815/1660] 10.222.0.60 () {58 vars in 1059 bytes} [Sun Jul 31 01:15:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:15:05.766684 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d7641-f107-49f8-a5b2-a4864cd94b54 service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:05.789717 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d7641-f107-49f8-a5b2-a4864cd94b54 service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:05.809772 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8afad21-e3ca-4053-9508-122c18b72235 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:05.810427 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afad21-e3ca-4053-9508-122c18b72235 service nova] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:05.810705 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afad21-e3ca-4053-9508-122c18b72235 service nova] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:05.810985 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afad21-e3ca-4053-9508-122c18b72235 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:05.934175 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:05.937737 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8afad21-e3ca-4053-9508-122c18b72235 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:05.940928 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8afad21-e3ca-4053-9508-122c18b72235 service nova] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:05.956689 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 846/1661] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:15:05 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:15:08.001605 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edc972-fa09-4113-8a6f-1c8cf5d0e4df None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:08.002692 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edc972-fa09-4113-8a6f-1c8cf5d0e4df None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:08.003101 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edc972-fa09-4113-8a6f-1c8cf5d0e4df None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:08.005200 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 816/1662] 10.222.0.60 () {54 vars in 921 bytes} [Sun Jul 31 01:15:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:15:08.058998 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b2949-e025-47cc-a669-b640686db06a None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:08.059905 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b2949-e025-47cc-a669-b640686db06a None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:08.060334 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b2949-e025-47cc-a669-b640686db06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:08.100660 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-ff5b2949-e025-47cc-a669-b640686db06a None None] MFA Rules not processed for user `657a3f73879e4b31b70a1c4f73e80f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:08.105538 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-ff5b2949-e025-47cc-a669-b640686db06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:08.227952 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 847/1663] 10.222.0.60 () {58 vars in 1018 bytes} [Sun Jul 31 01:15:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:15:08.305789 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6edc972-fa09-4113-8a6f-1c8cf5d0e4df None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:08.325165 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6edc972-fa09-4113-8a6f-1c8cf5d0e4df None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:08.334480 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad08f7e-bf50-47c0-bafd-5235f1956ceb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:08.336115 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad08f7e-bf50-47c0-bafd-5235f1956ceb service placement] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:08.336644 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad08f7e-bf50-47c0-bafd-5235f1956ceb service placement] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:08.337338 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad08f7e-bf50-47c0-bafd-5235f1956ceb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:08.350619 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad08f7e-bf50-47c0-bafd-5235f1956ceb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:08.352676 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad08f7e-bf50-47c0-bafd-5235f1956ceb service placement] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:08.387844 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 817/1664] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:15:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:15:08.829826 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a170c4-0e89-4561-97c2-9b412d0dc65a None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:08.830118 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a170c4-0e89-4561-97c2-9b412d0dc65a None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:08.830401 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a170c4-0e89-4561-97c2-9b412d0dc65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:08.887635 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-f1a170c4-0e89-4561-97c2-9b412d0dc65a None None] MFA Rules not processed for user `75e6d2aeb13145bc8057b7b314d26dcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:08.890328 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-f1a170c4-0e89-4561-97c2-9b412d0dc65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:09.041013 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 848/1665] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:15:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:15:09.064558 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19887fe-d6c0-4967-9fd2-097efd43cc7e None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:09.065203 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19887fe-d6c0-4967-9fd2-097efd43cc7e None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:09.065203 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19887fe-d6c0-4967-9fd2-097efd43cc7e None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:09.066776 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 818/1666] 10.222.0.60 () {54 vars in 962 bytes} [Sun Jul 31 01:15:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:15:09.085868 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6e280-51b3-44d3-a12d-de2bafcf2cfb None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:09.086401 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6e280-51b3-44d3-a12d-de2bafcf2cfb None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:09.086735 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6e280-51b3-44d3-a12d-de2bafcf2cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:09.128923 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-cbc6e280-51b3-44d3-a12d-de2bafcf2cfb None None] MFA Rules not processed for user `04591cd035ef4961b8b7a93e294eb881`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:09.130601 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-cbc6e280-51b3-44d3-a12d-de2bafcf2cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:09.145638 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 849/1667] 10.222.0.60 () {58 vars in 1059 bytes} [Sun Jul 31 01:15:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:15:09.153528 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19887fe-d6c0-4967-9fd2-097efd43cc7e None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:09.178465 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19887fe-d6c0-4967-9fd2-097efd43cc7e None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:09.208124 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa98d9-2db6-475e-bd83-28d942a8c119 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:09.211267 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa98d9-2db6-475e-bd83-28d942a8c119 service nova] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:09.214925 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa98d9-2db6-475e-bd83-28d942a8c119 service nova] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:09.217148 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa98d9-2db6-475e-bd83-28d942a8c119 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:09.249198 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa98d9-2db6-475e-bd83-28d942a8c119 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:09.258139 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa98d9-2db6-475e-bd83-28d942a8c119 service nova] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:09.287086 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 819/1668] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:15:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:15:10.816898 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d0653-6f69-41d3-8856-3d95e0972b70 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:10.817358 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d0653-6f69-41d3-8856-3d95e0972b70 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:10.817497 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d0653-6f69-41d3-8856-3d95e0972b70 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:10.819286 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 850/1669] 10.222.0.60 () {54 vars in 921 bytes} [Sun Jul 31 01:15:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:15:10.893018 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48400d-e133-416e-a506-3025d83ff4c1 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:10.893546 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48400d-e133-416e-a506-3025d83ff4c1 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:10.894036 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48400d-e133-416e-a506-3025d83ff4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:10.940172 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-3d48400d-e133-416e-a506-3025d83ff4c1 None None] MFA Rules not processed for user `657a3f73879e4b31b70a1c4f73e80f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:10.943899 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-3d48400d-e133-416e-a506-3025d83ff4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:10.969644 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 820/1670] 10.222.0.60 () {58 vars in 1018 bytes} [Sun Jul 31 01:15:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:15:11.005940 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d0653-6f69-41d3-8856-3d95e0972b70 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:11.031554 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d0653-6f69-41d3-8856-3d95e0972b70 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:11.049518 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d812ee-aed1-4648-bc74-8be8484da36f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:11.060405 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d812ee-aed1-4648-bc74-8be8484da36f service placement] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:11.061279 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d812ee-aed1-4648-bc74-8be8484da36f service placement] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:11.062100 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d812ee-aed1-4648-bc74-8be8484da36f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:11.101848 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d812ee-aed1-4648-bc74-8be8484da36f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:11.103670 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d812ee-aed1-4648-bc74-8be8484da36f service placement] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:11.133511 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 851/1671] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:15:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:15:11.815324 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7b090-0c2d-4af9-b2fb-99d899698da5 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:11.815675 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7b090-0c2d-4af9-b2fb-99d899698da5 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:11.815965 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7b090-0c2d-4af9-b2fb-99d899698da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:11.900128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-80d7b090-0c2d-4af9-b2fb-99d899698da5 None None] MFA Rules not processed for user `5f4a326874b94ea899f450ba5d41b27c`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:11.901425 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-80d7b090-0c2d-4af9-b2fb-99d899698da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:12.039044 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 821/1672] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:15:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:15:12.040133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d812ee-aed1-4648-bc74-8be8484da36f service placement] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:12.071906 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d812ee-aed1-4648-bc74-8be8484da36f service placement] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:12.089424 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b4cfd-26dd-499e-82d7-4889016a0bfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:12.090945 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b4cfd-26dd-499e-82d7-4889016a0bfe service nova] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:12.091446 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b4cfd-26dd-499e-82d7-4889016a0bfe service nova] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:12.091945 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b4cfd-26dd-499e-82d7-4889016a0bfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:12.111271 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b4cfd-26dd-499e-82d7-4889016a0bfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:12.114541 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b4cfd-26dd-499e-82d7-4889016a0bfe service nova] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:12.153539 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 852/1673] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:15:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:15:12.480139 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d7b090-0c2d-4af9-b2fb-99d899698da5 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:12.499136 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d7b090-0c2d-4af9-b2fb-99d899698da5 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:12.520310 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23707a1-95e1-4986-9912-dc535142d128 tempest-QuotasNegativeTest-1335818326 tempest-QuotasNegativeTest-1335818326-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '739acfb5475b47b9a7ba051cf0b17ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ad346ca8de41eb81f09cf6136a8796', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:12.521485 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23707a1-95e1-4986-9912-dc535142d128 tempest-QuotasNegativeTest-1335818326 tempest-QuotasNegativeTest-1335818326-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:12.521974 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23707a1-95e1-4986-9912-dc535142d128 tempest-QuotasNegativeTest-1335818326 tempest-QuotasNegativeTest-1335818326-project-admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:12.522526 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23707a1-95e1-4986-9912-dc535142d128 tempest-QuotasNegativeTest-1335818326 tempest-QuotasNegativeTest-1335818326-project-admin] PATH_INFO: `/v3/projects/4367f25adcd3433b91000c8bfd95cd27` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:12.526423 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23707a1-95e1-4986-9912-dc535142d128 tempest-QuotasNegativeTest-1335818326 tempest-QuotasNegativeTest-1335818326-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4367f25adcd3433b91000c8bfd95cd27)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:12.528619 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23707a1-95e1-4986-9912-dc535142d128 tempest-QuotasNegativeTest-1335818326 tempest-QuotasNegativeTest-1335818326-project-admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:12.707774 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:12.725646 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-c23707a1-95e1-4986-9912-dc535142d128 tempest-QuotasNegativeTest-1335818326 tempest-QuotasNegativeTest-1335818326-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4367f25adcd3433b91000c8bfd95cd27', 'request_id': 'req-c23707a1-95e1-4986-9912-dc535142d128'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:12.753067 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-c23707a1-95e1-4986-9912-dc535142d128 tempest-QuotasNegativeTest-1335818326 tempest-QuotasNegativeTest-1335818326-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4367f25adcd3433b91000c8bfd95cd27', 'request_id': 'req-c23707a1-95e1-4986-9912-dc535142d128'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:12.776017 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-c23707a1-95e1-4986-9912-dc535142d128 tempest-QuotasNegativeTest-1335818326 tempest-QuotasNegativeTest-1335818326-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4367f25adcd3433b91000c8bfd95cd27', 'request_id': 'req-c23707a1-95e1-4986-9912-dc535142d128'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:12.805639 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-c23707a1-95e1-4986-9912-dc535142d128 tempest-QuotasNegativeTest-1335818326 tempest-QuotasNegativeTest-1335818326-project-admin] The token cache is being invalidate because project 4367f25adcd3433b91000c8bfd95cd27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:15:12.805979 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-c23707a1-95e1-4986-9912-dc535142d128 tempest-QuotasNegativeTest-1335818326 tempest-QuotasNegativeTest-1335818326-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:12.806726 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-c23707a1-95e1-4986-9912-dc535142d128 tempest-QuotasNegativeTest-1335818326 tempest-QuotasNegativeTest-1335818326-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:12.819232 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b4cfd-26dd-499e-82d7-4889016a0bfe service nova] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:12.827133 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 822/1674] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:15:12 2022] DELETE /identity/v3/projects/4367f25adcd3433b91000c8bfd95cd27 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:15:12.896444 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:12.930199 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b4cfd-26dd-499e-82d7-4889016a0bfe service nova] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:13.098100 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca680194-2e45-420b-a429-4fc6e3337c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:13.099653 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca680194-2e45-420b-a429-4fc6e3337c71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:13.100206 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca680194-2e45-420b-a429-4fc6e3337c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:13.100851 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca680194-2e45-420b-a429-4fc6e3337c71 admin admin] PATH_INFO: `/v3/users/f57e4007372a447db59f6d64b5e03794` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:13.103963 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca680194-2e45-420b-a429-4fc6e3337c71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f57e4007372a447db59f6d64b5e03794)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:13.108084 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca680194-2e45-420b-a429-4fc6e3337c71 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:13.247229 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-ca680194-2e45-420b-a429-4fc6e3337c71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f57e4007372a447db59f6d64b5e03794'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:13.276846 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-ca680194-2e45-420b-a429-4fc6e3337c71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f57e4007372a447db59f6d64b5e03794'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:13.279129 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-ca680194-2e45-420b-a429-4fc6e3337c71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f57e4007372a447db59f6d64b5e03794'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:13.310111 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-ca680194-2e45-420b-a429-4fc6e3337c71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f57e4007372a447db59f6d64b5e03794'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:13.312147 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-ca680194-2e45-420b-a429-4fc6e3337c71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f57e4007372a447db59f6d64b5e03794'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:13.345907 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 853/1675] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:15:12 2022] DELETE /identity/v3/users/f57e4007372a447db59f6d64b5e03794 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:15:13.350293 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0506fc-fee7-4087-8004-718be4b6b4c7 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:13.350785 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0506fc-fee7-4087-8004-718be4b6b4c7 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:13.350878 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0506fc-fee7-4087-8004-718be4b6b4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:13.397067 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-dd0506fc-fee7-4087-8004-718be4b6b4c7 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:13.401062 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-dd0506fc-fee7-4087-8004-718be4b6b4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:13.524824 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 823/1676] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:15:13.546215 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca680194-2e45-420b-a429-4fc6e3337c71 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:13.548089 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-ca680194-2e45-420b-a429-4fc6e3337c71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:13.677143 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca680194-2e45-420b-a429-4fc6e3337c71 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:13.688241 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825ebbb-9aa8-49d1-8d8e-cb6859470256 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:13.692508 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825ebbb-9aa8-49d1-8d8e-cb6859470256 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:13.692798 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825ebbb-9aa8-49d1-8d8e-cb6859470256 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:13.693213 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825ebbb-9aa8-49d1-8d8e-cb6859470256 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:13.710267 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0825ebbb-9aa8-49d1-8d8e-cb6859470256 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:13.711894 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0825ebbb-9aa8-49d1-8d8e-cb6859470256 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:13.727234 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 854/1677] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:15:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:15:16.066670 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219194d0-7976-4901-93cf-bdc0ec5bcb0e None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:16.067548 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219194d0-7976-4901-93cf-bdc0ec5bcb0e None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:16.067980 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219194d0-7976-4901-93cf-bdc0ec5bcb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:16.129818 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-219194d0-7976-4901-93cf-bdc0ec5bcb0e None None] MFA Rules not processed for user `24ff1700ea7a4456868990c1abc6dea9`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:16.131374 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-219194d0-7976-4901-93cf-bdc0ec5bcb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:16.254003 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 824/1678] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:15:16 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:15:16.261148 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825ebbb-9aa8-49d1-8d8e-cb6859470256 service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:16.262990 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-0825ebbb-9aa8-49d1-8d8e-cb6859470256 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:16.294431 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:16.411864 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825ebbb-9aa8-49d1-8d8e-cb6859470256 service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:16.417618 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219194d0-7976-4901-93cf-bdc0ec5bcb0e None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:16.419381 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-219194d0-7976-4901-93cf-bdc0ec5bcb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:16.440423 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78b11e-ed36-456f-ad15-39f278da3c3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:16.451113 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78b11e-ed36-456f-ad15-39f278da3c3f service nova] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:16.453216 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78b11e-ed36-456f-ad15-39f278da3c3f service nova] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:16.454698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78b11e-ed36-456f-ad15-39f278da3c3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:16.471383 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219194d0-7976-4901-93cf-bdc0ec5bcb0e None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:16.503016 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c2706-fa71-4485-af1f-9328d1186460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:16.503382 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab78b11e-ed36-456f-ad15-39f278da3c3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:16.505260 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c2706-fa71-4485-af1f-9328d1186460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:16.505377 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab78b11e-ed36-456f-ad15-39f278da3c3f service nova] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:16.505552 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c2706-fa71-4485-af1f-9328d1186460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:16.507800 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c2706-fa71-4485-af1f-9328d1186460 admin admin] PATH_INFO: `/v3/projects/e30165d124e94be0ac259814bed8f66c` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:16.509686 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c2706-fa71-4485-af1f-9328d1186460 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e30165d124e94be0ac259814bed8f66c)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:16.512731 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c2706-fa71-4485-af1f-9328d1186460 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:16.541402 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 855/1679] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:15:16 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:15:16.542418 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78b11e-ed36-456f-ad15-39f278da3c3f service nova] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:16.577220 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78b11e-ed36-456f-ad15-39f278da3c3f service nova] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:16.594904 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee6596-7b69-4ef4-b315-ca0dcf2b8b84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:16.595589 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee6596-7b69-4ef4-b315-ca0dcf2b8b84 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:16.595862 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee6596-7b69-4ef4-b315-ca0dcf2b8b84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:16.596134 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee6596-7b69-4ef4-b315-ca0dcf2b8b84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:16.608424 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-66ee6596-7b69-4ef4-b315-ca0dcf2b8b84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:16.641208 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-122c2706-fa71-4485-af1f-9328d1186460 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e30165d124e94be0ac259814bed8f66c', 'request_id': 'req-122c2706-fa71-4485-af1f-9328d1186460'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:16.648030 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:16.650563 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-122c2706-fa71-4485-af1f-9328d1186460 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e30165d124e94be0ac259814bed8f66c', 'request_id': 'req-122c2706-fa71-4485-af1f-9328d1186460'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:16.658449 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-122c2706-fa71-4485-af1f-9328d1186460 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e30165d124e94be0ac259814bed8f66c', 'request_id': 'req-122c2706-fa71-4485-af1f-9328d1186460'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:16.689411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-122c2706-fa71-4485-af1f-9328d1186460 admin admin] The token cache is being invalidate because project e30165d124e94be0ac259814bed8f66c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:15:16.689708 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-122c2706-fa71-4485-af1f-9328d1186460 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:16.699771 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-122c2706-fa71-4485-af1f-9328d1186460 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:16.701907 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 825/1680] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:15:16 2022] DELETE /identity/v3/projects/e30165d124e94be0ac259814bed8f66c => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:15:16.705868 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c2706-fa71-4485-af1f-9328d1186460 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:16.707343 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-122c2706-fa71-4485-af1f-9328d1186460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:16.788092 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee6596-7b69-4ef4-b315-ca0dcf2b8b84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:16.789584 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee6596-7b69-4ef4-b315-ca0dcf2b8b84 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:16.806737 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c2706-fa71-4485-af1f-9328d1186460 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:16.813411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f22d2-e014-4fc4-bfd3-fdb72ee36b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:16.815468 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 856/1681] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:15:16 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:15:16.816923 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f22d2-e014-4fc4-bfd3-fdb72ee36b34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:16.817211 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f22d2-e014-4fc4-bfd3-fdb72ee36b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:16.821143 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f22d2-e014-4fc4-bfd3-fdb72ee36b34 admin admin] PATH_INFO: `/v3/users/739acfb5475b47b9a7ba051cf0b17ae5` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:16.824935 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7f22d2-e014-4fc4-bfd3-fdb72ee36b34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=739acfb5475b47b9a7ba051cf0b17ae5)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:16.829266 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: WARNING py.warnings [None req-0e7f22d2-e014-4fc4-bfd3-fdb72ee36b34 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:15:16.829266 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: warnings.warn(msg) Jul 31 01:15:16.829266 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: Jul 31 01:15:16.830571 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7f22d2-e014-4fc4-bfd3-fdb72ee36b34 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:16.948967 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-0e7f22d2-e014-4fc4-bfd3-fdb72ee36b34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '739acfb5475b47b9a7ba051cf0b17ae5'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:16.949978 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-0e7f22d2-e014-4fc4-bfd3-fdb72ee36b34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '739acfb5475b47b9a7ba051cf0b17ae5'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:16.983334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-0e7f22d2-e014-4fc4-bfd3-fdb72ee36b34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '739acfb5475b47b9a7ba051cf0b17ae5'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:16.995048 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-0e7f22d2-e014-4fc4-bfd3-fdb72ee36b34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '739acfb5475b47b9a7ba051cf0b17ae5'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:16.996652 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-0e7f22d2-e014-4fc4-bfd3-fdb72ee36b34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '739acfb5475b47b9a7ba051cf0b17ae5'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:17.036995 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 826/1682] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:15:16 2022] DELETE /identity/v3/users/739acfb5475b47b9a7ba051cf0b17ae5 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:15:17.612140 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c6913-f09f-4915-921f-884f389f2f24 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:17.613129 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c6913-f09f-4915-921f-884f389f2f24 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:17.613449 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c6913-f09f-4915-921f-884f389f2f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:17.655025 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-9a9c6913-f09f-4915-921f-884f389f2f24 None None] MFA Rules not processed for user `75e6d2aeb13145bc8057b7b314d26dcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:17.656720 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-9a9c6913-f09f-4915-921f-884f389f2f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:17.744643 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 857/1683] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:15:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:15:17.847776 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157cc98-7dd8-44d6-8bbe-8ba64324170b None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:17.848296 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157cc98-7dd8-44d6-8bbe-8ba64324170b None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:17.848652 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157cc98-7dd8-44d6-8bbe-8ba64324170b None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:17.850351 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 827/1684] 10.222.0.60 () {54 vars in 912 bytes} [Sun Jul 31 01:15:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:15:17.856321 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4761b0c4-3890-4161-b80b-0588446f1064 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:17.856599 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4761b0c4-3890-4161-b80b-0588446f1064 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:17.856942 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4761b0c4-3890-4161-b80b-0588446f1064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:17.877979 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-4761b0c4-3890-4161-b80b-0588446f1064 None None] MFA Rules not processed for user `04591cd035ef4961b8b7a93e294eb881`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:17.879286 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-4761b0c4-3890-4161-b80b-0588446f1064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:17.965578 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:18.028825 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 858/1685] 10.222.0.60 () {58 vars in 1009 bytes} [Sun Jul 31 01:15:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:15:18.043055 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157cc98-7dd8-44d6-8bbe-8ba64324170b None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:18.047315 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-f157cc98-7dd8-44d6-8bbe-8ba64324170b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:18.192948 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:18.205295 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157cc98-7dd8-44d6-8bbe-8ba64324170b None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:18.212396 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d8593-9ebb-480e-921a-4302e416d001 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdebcb0a2a7548a09b3e9d3cf085e40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:18.213479 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d8593-9ebb-480e-921a-4302e416d001 service glance] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:18.215948 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d8593-9ebb-480e-921a-4302e416d001 service glance] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:18.216489 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d8593-9ebb-480e-921a-4302e416d001 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:18.242421 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4761b0c4-3890-4161-b80b-0588446f1064 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:18.244301 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-4761b0c4-3890-4161-b80b-0588446f1064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:18.254688 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2d8593-9ebb-480e-921a-4302e416d001 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:18.258142 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2d8593-9ebb-480e-921a-4302e416d001 service glance] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:18.286234 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 828/1686] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:15:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:15:18.409891 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4761b0c4-3890-4161-b80b-0588446f1064 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:18.426390 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad34c4e7-01ec-4a4e-b8db-9edf6cea038e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:18.427097 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34c4e7-01ec-4a4e-b8db-9edf6cea038e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:18.427512 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34c4e7-01ec-4a4e-b8db-9edf6cea038e admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:18.427799 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34c4e7-01ec-4a4e-b8db-9edf6cea038e admin admin] PATH_INFO: `/v3/projects/c0ad346ca8de41eb81f09cf6136a8796` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:18.429728 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad34c4e7-01ec-4a4e-b8db-9edf6cea038e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0ad346ca8de41eb81f09cf6136a8796)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:18.430759 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: WARNING py.warnings [None req-ad34c4e7-01ec-4a4e-b8db-9edf6cea038e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:15:18.430759 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: warnings.warn(msg) Jul 31 01:15:18.430759 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: Jul 31 01:15:18.434093 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad34c4e7-01ec-4a4e-b8db-9edf6cea038e admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:18.595666 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-ad34c4e7-01ec-4a4e-b8db-9edf6cea038e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0ad346ca8de41eb81f09cf6136a8796', 'request_id': 'req-ad34c4e7-01ec-4a4e-b8db-9edf6cea038e'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:18.618399 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-ad34c4e7-01ec-4a4e-b8db-9edf6cea038e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0ad346ca8de41eb81f09cf6136a8796', 'request_id': 'req-ad34c4e7-01ec-4a4e-b8db-9edf6cea038e'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:18.660778 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-ad34c4e7-01ec-4a4e-b8db-9edf6cea038e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0ad346ca8de41eb81f09cf6136a8796', 'request_id': 'req-ad34c4e7-01ec-4a4e-b8db-9edf6cea038e'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:18.694754 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-ad34c4e7-01ec-4a4e-b8db-9edf6cea038e admin admin] The token cache is being invalidate because project c0ad346ca8de41eb81f09cf6136a8796 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:15:18.695078 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-ad34c4e7-01ec-4a4e-b8db-9edf6cea038e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:18.696116 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-ad34c4e7-01ec-4a4e-b8db-9edf6cea038e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:18.698397 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 859/1687] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:15:18 2022] DELETE /identity/v3/projects/c0ad346ca8de41eb81f09cf6136a8796 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:15:18.704318 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a4f3a-033b-4698-a222-078909f5af2f None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:18.705486 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a4f3a-033b-4698-a222-078909f5af2f None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:18.706517 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a4f3a-033b-4698-a222-078909f5af2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:18.768867 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-827a4f3a-033b-4698-a222-078909f5af2f None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:18.772132 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-827a4f3a-033b-4698-a222-078909f5af2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:18.910410 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 829/1688] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:15:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:15:18.919306 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c04da-1b7d-4be1-babd-1109bd921023 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:18.919434 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c04da-1b7d-4be1-babd-1109bd921023 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:18.919746 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c04da-1b7d-4be1-babd-1109bd921023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:18.988889 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-dc9c04da-1b7d-4be1-babd-1109bd921023 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:18.990068 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-dc9c04da-1b7d-4be1-babd-1109bd921023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:19.007686 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 860/1689] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:15:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:15:19.011698 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a4f3a-033b-4698-a222-078909f5af2f None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:19.023552 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a4f3a-033b-4698-a222-078909f5af2f None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:19.029053 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32df793-a550-4fb2-9e77-1d005f496391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:19.032610 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32df793-a550-4fb2-9e77-1d005f496391 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:19.032893 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32df793-a550-4fb2-9e77-1d005f496391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:19.033163 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32df793-a550-4fb2-9e77-1d005f496391 admin admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:19.033960 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32df793-a550-4fb2-9e77-1d005f496391 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:15:19.034255 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32df793-a550-4fb2-9e77-1d005f496391 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:19.036167 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32df793-a550-4fb2-9e77-1d005f496391 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:19.049836 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 830/1690] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:15:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:15:19.055542 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c04da-1b7d-4be1-babd-1109bd921023 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:19.069673 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c04da-1b7d-4be1-babd-1109bd921023 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:19.076171 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596b893-f53b-4f6d-9ba1-e2c6a4da7e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:19.076773 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596b893-f53b-4f6d-9ba1-e2c6a4da7e39 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:19.077154 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596b893-f53b-4f6d-9ba1-e2c6a4da7e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:19.077566 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596b893-f53b-4f6d-9ba1-e2c6a4da7e39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:19.078338 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596b893-f53b-4f6d-9ba1-e2c6a4da7e39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:19.080738 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596b893-f53b-4f6d-9ba1-e2c6a4da7e39 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:19.129548 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32df793-a550-4fb2-9e77-1d005f496391 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:19.141608 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 861/1691] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:15:19 2022] POST /identity/v3/projects => generated 367 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:15:19.148254 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32df793-a550-4fb2-9e77-1d005f496391 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:19.226111 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9ba2c-8c0a-4b8a-a99b-da629f3c49ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:19.227003 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9ba2c-8c0a-4b8a-a99b-da629f3c49ef admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:19.227379 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9ba2c-8c0a-4b8a-a99b-da629f3c49ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:19.227771 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9ba2c-8c0a-4b8a-a99b-da629f3c49ef admin admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:19.228640 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9ba2c-8c0a-4b8a-a99b-da629f3c49ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:19.231111 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9ba2c-8c0a-4b8a-a99b-da629f3c49ef admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:19.269758 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 831/1692] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:15:19 2022] POST /identity/v3/users => generated 284 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:15:19.274228 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596b893-f53b-4f6d-9ba1-e2c6a4da7e39 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:19.289559 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596b893-f53b-4f6d-9ba1-e2c6a4da7e39 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:19.307057 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc619b7-d81a-49b6-a7df-98e56c1b595d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:19.307938 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc619b7-d81a-49b6-a7df-98e56c1b595d admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:19.311915 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc619b7-d81a-49b6-a7df-98e56c1b595d admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:19.312307 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc619b7-d81a-49b6-a7df-98e56c1b595d admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:19.313186 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc619b7-d81a-49b6-a7df-98e56c1b595d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:19.316784 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc619b7-d81a-49b6-a7df-98e56c1b595d admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:19.358147 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9ba2c-8c0a-4b8a-a99b-da629f3c49ef admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:19.365479 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 862/1693] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:15:19.371994 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9ba2c-8c0a-4b8a-a99b-da629f3c49ef admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:19.389801 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba10802-0432-4202-a8aa-2731ebfc5c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:19.399247 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba10802-0432-4202-a8aa-2731ebfc5c8a admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:19.399587 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba10802-0432-4202-a8aa-2731ebfc5c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:19.399857 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba10802-0432-4202-a8aa-2731ebfc5c8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:19.400617 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba10802-0432-4202-a8aa-2731ebfc5c8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:19.402271 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba10802-0432-4202-a8aa-2731ebfc5c8a admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:19.429903 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 832/1694] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:15:19.431656 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc619b7-d81a-49b6-a7df-98e56c1b595d admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:19.443498 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc619b7-d81a-49b6-a7df-98e56c1b595d admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:19.448445 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421a613-8e6f-43ab-922a-5020cd66d4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:19.449239 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421a613-8e6f-43ab-922a-5020cd66d4e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:19.450390 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421a613-8e6f-43ab-922a-5020cd66d4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:19.450678 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421a613-8e6f-43ab-922a-5020cd66d4e2 admin admin] PATH_INFO: `/v3/projects/20d4f10a2f9d405493ebd0f95dc322fb/users/4b3826ceb1fe4d3b825091815c5ec400/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:19.501341 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6421a613-8e6f-43ab-922a-5020cd66d4e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20d4f10a2f9d405493ebd0f95dc322fb, user_id=4b3826ceb1fe4d3b825091815c5ec400, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:19.509426 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6421a613-8e6f-43ab-922a-5020cd66d4e2 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:19.538927 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:19.547956 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 863/1695] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:15:19 2022] PUT /identity/v3/projects/20d4f10a2f9d405493ebd0f95dc322fb/users/4b3826ceb1fe4d3b825091815c5ec400/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:15:19.560120 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb693545-88e4-476e-b6da-7b5f8e377c56 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:19.560425 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb693545-88e4-476e-b6da-7b5f8e377c56 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:19.560709 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb693545-88e4-476e-b6da-7b5f8e377c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:19.644150 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-eb693545-88e4-476e-b6da-7b5f8e377c56 None None] MFA Rules not processed for user `4b3826ceb1fe4d3b825091815c5ec400`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:19.645407 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-eb693545-88e4-476e-b6da-7b5f8e377c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:19.722754 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:19.757598 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 833/1696] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:15:19 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:15:19.761833 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421a613-8e6f-43ab-922a-5020cd66d4e2 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:19.848319 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421a613-8e6f-43ab-922a-5020cd66d4e2 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:19.856293 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d74a5-77d2-4695-a739-ade98bba5f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:19.858613 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d74a5-77d2-4695-a739-ade98bba5f81 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:19.859104 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d74a5-77d2-4695-a739-ade98bba5f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:19.859661 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d74a5-77d2-4695-a739-ade98bba5f81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:19.860873 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d74a5-77d2-4695-a739-ade98bba5f81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:19.863169 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d74a5-77d2-4695-a739-ade98bba5f81 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:19.949532 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 864/1697] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:15:19 2022] POST /identity/v3/projects => generated 367 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:15:19.954260 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb693545-88e4-476e-b6da-7b5f8e377c56 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:19.970499 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb693545-88e4-476e-b6da-7b5f8e377c56 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:20.056637 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287af579-192c-4863-8953-511df1046b64 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:20.058013 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287af579-192c-4863-8953-511df1046b64 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:20.058519 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287af579-192c-4863-8953-511df1046b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:20.098506 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-287af579-192c-4863-8953-511df1046b64 None None] MFA Rules not processed for user `5f4a326874b94ea899f450ba5d41b27c`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:20.101314 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-287af579-192c-4863-8953-511df1046b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:20.132717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8173ebd-a75b-423b-a5dd-722044128e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:20.133381 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8173ebd-a75b-423b-a5dd-722044128e6f admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:20.133783 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8173ebd-a75b-423b-a5dd-722044128e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:20.133976 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8173ebd-a75b-423b-a5dd-722044128e6f admin admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:20.134670 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8173ebd-a75b-423b-a5dd-722044128e6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:20.138510 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8173ebd-a75b-423b-a5dd-722044128e6f admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:20.196706 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 865/1698] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:15:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:15:20.202972 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 834/1699] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:15:19 2022] POST /identity/v3/users => generated 290 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:15:20.204782 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287af579-192c-4863-8953-511df1046b64 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:20.222746 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287af579-192c-4863-8953-511df1046b64 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:20.232326 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371b9a3-a6c6-4ff2-bc15-12cb819d04be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:20.233630 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371b9a3-a6c6-4ff2-bc15-12cb819d04be admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:20.234553 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371b9a3-a6c6-4ff2-bc15-12cb819d04be admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:20.235139 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371b9a3-a6c6-4ff2-bc15-12cb819d04be admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:20.237650 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f371b9a3-a6c6-4ff2-bc15-12cb819d04be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:20.239959 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f371b9a3-a6c6-4ff2-bc15-12cb819d04be admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:20.263188 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8173ebd-a75b-423b-a5dd-722044128e6f admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:20.266133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 866/1700] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:15:20.281777 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8173ebd-a75b-423b-a5dd-722044128e6f admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:20.292218 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10f538-be47-4974-b615-8edbcde00c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:20.293041 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10f538-be47-4974-b615-8edbcde00c1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:20.293319 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10f538-be47-4974-b615-8edbcde00c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:20.293584 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10f538-be47-4974-b615-8edbcde00c1c admin admin] PATH_INFO: `/v3/projects/cb4da6a8dea84fa3ad4a0cf637615781/users/8e1d527ed1704bfda69ffba8cc31764b/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:20.317266 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de8a7c-f8c2-45d0-9dc9-bc93a25431a7 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:20.317905 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de8a7c-f8c2-45d0-9dc9-bc93a25431a7 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:20.318436 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de8a7c-f8c2-45d0-9dc9-bc93a25431a7 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:20.321378 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 867/1701] 10.222.0.60 () {54 vars in 912 bytes} [Sun Jul 31 01:15:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:15:20.331121 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10f538-be47-4974-b615-8edbcde00c1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb4da6a8dea84fa3ad4a0cf637615781, user_id=8e1d527ed1704bfda69ffba8cc31764b, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:20.334639 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10f538-be47-4974-b615-8edbcde00c1c admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:20.350333 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94615f-a36d-4ef2-89f1-2e7db96721bf None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:20.350927 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94615f-a36d-4ef2-89f1-2e7db96721bf None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:20.355092 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94615f-a36d-4ef2-89f1-2e7db96721bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:20.378086 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 835/1702] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:15:20 2022] PUT /identity/v3/projects/cb4da6a8dea84fa3ad4a0cf637615781/users/8e1d527ed1704bfda69ffba8cc31764b/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:15:20.386490 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10f538-be47-4974-b615-8edbcde00c1c admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:20.412649 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-2c94615f-a36d-4ef2-89f1-2e7db96721bf None None] MFA Rules not processed for user `04591cd035ef4961b8b7a93e294eb881`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:20.416044 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-2c94615f-a36d-4ef2-89f1-2e7db96721bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:20.533264 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10f538-be47-4974-b615-8edbcde00c1c admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:20.547379 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dbc52a-975a-460e-b7ff-8aa89cfed3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:20.548537 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dbc52a-975a-460e-b7ff-8aa89cfed3a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:20.549576 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dbc52a-975a-460e-b7ff-8aa89cfed3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:20.550360 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dbc52a-975a-460e-b7ff-8aa89cfed3a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:20.552121 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dbc52a-975a-460e-b7ff-8aa89cfed3a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:20.555841 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dbc52a-975a-460e-b7ff-8aa89cfed3a4 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:20.584059 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 868/1703] 10.222.0.60 () {58 vars in 1009 bytes} [Sun Jul 31 01:15:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:15:20.585499 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6810f-92b4-4ae8-9f91-bb8887139f0b None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:20.585908 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 836/1704] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:15:20.586248 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6810f-92b4-4ae8-9f91-bb8887139f0b None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:20.586643 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6810f-92b4-4ae8-9f91-bb8887139f0b None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:20.587714 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dbc52a-975a-460e-b7ff-8aa89cfed3a4 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:20.593043 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 869/1705] 10.222.0.60 () {54 vars in 912 bytes} [Sun Jul 31 01:15:20 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:15:20.598895 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139b042-6283-4dcb-8c66-5a3cde09dff1 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:20.599541 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139b042-6283-4dcb-8c66-5a3cde09dff1 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:20.599541 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139b042-6283-4dcb-8c66-5a3cde09dff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:20.612242 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dbc52a-975a-460e-b7ff-8aa89cfed3a4 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:20.618500 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593caa78-6969-4a0f-8984-c2212cf563b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:20.619520 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593caa78-6969-4a0f-8984-c2212cf563b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:20.619989 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593caa78-6969-4a0f-8984-c2212cf563b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:20.621835 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593caa78-6969-4a0f-8984-c2212cf563b2 admin admin] PATH_INFO: `/v3/projects/cb4da6a8dea84fa3ad4a0cf637615781/users/8e1d527ed1704bfda69ffba8cc31764b/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:20.624595 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593caa78-6969-4a0f-8984-c2212cf563b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb4da6a8dea84fa3ad4a0cf637615781, user_id=8e1d527ed1704bfda69ffba8cc31764b, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:20.629260 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593caa78-6969-4a0f-8984-c2212cf563b2 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:20.645848 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 837/1706] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:15:20 2022] PUT /identity/v3/projects/cb4da6a8dea84fa3ad4a0cf637615781/users/8e1d527ed1704bfda69ffba8cc31764b/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:15:20.647799 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:20.648928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593caa78-6969-4a0f-8984-c2212cf563b2 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:20.651801 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-593caa78-6969-4a0f-8984-c2212cf563b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:20.690471 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-0139b042-6283-4dcb-8c66-5a3cde09dff1 None None] MFA Rules not processed for user `81117154f6d1474c805a69c5617c307d`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:20.691742 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-0139b042-6283-4dcb-8c66-5a3cde09dff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:20.713029 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:20.774242 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593caa78-6969-4a0f-8984-c2212cf563b2 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:20.779151 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c2eb2-b085-4220-b226-514fc523e2a6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdebcb0a2a7548a09b3e9d3cf085e40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:20.780077 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c2eb2-b085-4220-b226-514fc523e2a6 service glance] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:20.780682 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c2eb2-b085-4220-b226-514fc523e2a6 service glance] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:20.781109 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c2eb2-b085-4220-b226-514fc523e2a6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:20.805449 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 870/1707] 10.222.0.60 () {58 vars in 1009 bytes} [Sun Jul 31 01:15:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:15:20.806765 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb9cf2-cb5e-4042-9bbd-53f476e71c58 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:20.807049 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb9cf2-cb5e-4042-9bbd-53f476e71c58 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:20.807323 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb9cf2-cb5e-4042-9bbd-53f476e71c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:20.844430 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-1afb9cf2-cb5e-4042-9bbd-53f476e71c58 None None] MFA Rules not processed for user `8e1d527ed1704bfda69ffba8cc31764b`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:20.845521 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-1afb9cf2-cb5e-4042-9bbd-53f476e71c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:20.902289 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c2eb2-b085-4220-b226-514fc523e2a6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:20.903835 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c2eb2-b085-4220-b226-514fc523e2a6 service glance] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:20.933929 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 838/1708] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:15:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:15:20.935543 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c2eb2-b085-4220-b226-514fc523e2a6 service glance] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:20.938891 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-470c2eb2-b085-4220-b226-514fc523e2a6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:20.944434 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 871/1709] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:15:20 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:15:20.954504 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c2eb2-b085-4220-b226-514fc523e2a6 service glance] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:20.959212 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4444949-6177-4dc8-b816-ca8f9f7d782e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:20.960373 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4444949-6177-4dc8-b816-ca8f9f7d782e service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:20.960373 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4444949-6177-4dc8-b816-ca8f9f7d782e service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:20.960561 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4444949-6177-4dc8-b816-ca8f9f7d782e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:20.971510 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4444949-6177-4dc8-b816-ca8f9f7d782e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:20.973734 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4444949-6177-4dc8-b816-ca8f9f7d782e service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:20.994609 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 839/1710] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:15:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:15:21.013107 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb9cf2-cb5e-4042-9bbd-53f476e71c58 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:21.015051 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-1afb9cf2-cb5e-4042-9bbd-53f476e71c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:21.028455 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb9cf2-cb5e-4042-9bbd-53f476e71c58 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:21.034527 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4fd115-885d-42ac-b74c-c8177c2a7f84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:21.035928 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fd115-885d-42ac-b74c-c8177c2a7f84 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:21.036462 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fd115-885d-42ac-b74c-c8177c2a7f84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:21.037464 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fd115-885d-42ac-b74c-c8177c2a7f84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:21.057699 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4fd115-885d-42ac-b74c-c8177c2a7f84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:21.059355 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4fd115-885d-42ac-b74c-c8177c2a7f84 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:21.080726 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 872/1711] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:15:21 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:15:22.179542 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4444949-6177-4dc8-b816-ca8f9f7d782e service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:22.181374 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-d4444949-6177-4dc8-b816-ca8f9f7d782e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:22.323850 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4444949-6177-4dc8-b816-ca8f9f7d782e service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:22.344025 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf0523f-609d-42ff-932c-e95c9b13ee73 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:22.345065 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0523f-609d-42ff-932c-e95c9b13ee73 service placement] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:22.345652 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0523f-609d-42ff-932c-e95c9b13ee73 service placement] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:22.346244 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0523f-609d-42ff-932c-e95c9b13ee73 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:22.346794 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bd52d-eb7a-4690-89f3-9efea1ee9e6c None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:22.347241 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bd52d-eb7a-4690-89f3-9efea1ee9e6c None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:22.347313 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bd52d-eb7a-4690-89f3-9efea1ee9e6c None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:22.349707 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-4cf0523f-609d-42ff-932c-e95c9b13ee73 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:22.350106 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 873/1712] 10.222.0.60 () {54 vars in 912 bytes} [Sun Jul 31 01:15:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:15:22.371302 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab8415-152a-4f2d-954f-b0da61806918 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:22.371704 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab8415-152a-4f2d-954f-b0da61806918 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:22.372047 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab8415-152a-4f2d-954f-b0da61806918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:22.373623 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf0523f-609d-42ff-932c-e95c9b13ee73 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:22.375567 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf0523f-609d-42ff-932c-e95c9b13ee73 service placement] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:22.404237 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 840/1713] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:15:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:15:22.411693 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-bdab8415-152a-4f2d-954f-b0da61806918 None None] MFA Rules not processed for user `81117154f6d1474c805a69c5617c307d`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:22.413203 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-bdab8415-152a-4f2d-954f-b0da61806918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:22.443640 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 874/1714] 10.222.0.60 () {58 vars in 1009 bytes} [Sun Jul 31 01:15:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:15:22.560170 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf0523f-609d-42ff-932c-e95c9b13ee73 service placement] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:22.595336 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf0523f-609d-42ff-932c-e95c9b13ee73 service placement] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:22.604150 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365319e9-4583-42f8-93a4-54c5fa364dfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:22.605040 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365319e9-4583-42f8-93a4-54c5fa364dfb service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:22.605569 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365319e9-4583-42f8-93a4-54c5fa364dfb service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:22.606061 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365319e9-4583-42f8-93a4-54c5fa364dfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:22.617485 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365319e9-4583-42f8-93a4-54c5fa364dfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:22.621135 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365319e9-4583-42f8-93a4-54c5fa364dfb service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:22.635948 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 841/1715] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:15:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:15:23.592628 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c911d05-ec22-4e8d-b5b7-ccb8a5aba50f None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:23.593239 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c911d05-ec22-4e8d-b5b7-ccb8a5aba50f None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:23.593239 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c911d05-ec22-4e8d-b5b7-ccb8a5aba50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:23.630857 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-6c911d05-ec22-4e8d-b5b7-ccb8a5aba50f None None] MFA Rules not processed for user `24ff1700ea7a4456868990c1abc6dea9`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:23.633662 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-6c911d05-ec22-4e8d-b5b7-ccb8a5aba50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:23.838075 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 875/1716] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:15:23 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:15:25.257361 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04132587-721d-4adf-b522-495d28ede252 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:25.258171 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04132587-721d-4adf-b522-495d28ede252 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:25.258579 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04132587-721d-4adf-b522-495d28ede252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:25.367244 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-04132587-721d-4adf-b522-495d28ede252 None None] MFA Rules not processed for user `02ed9040d575462db4b270a5b57063f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:25.368395 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-04132587-721d-4adf-b522-495d28ede252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:25.374519 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:25.501685 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 842/1717] 10.222.0.60 () {58 vars in 1009 bytes} [Sun Jul 31 01:15:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:15:25.805643 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c911d05-ec22-4e8d-b5b7-ccb8a5aba50f None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:25.807269 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-6c911d05-ec22-4e8d-b5b7-ccb8a5aba50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:25.852905 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:25.962919 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c911d05-ec22-4e8d-b5b7-ccb8a5aba50f None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:25.971613 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba98287-ac7d-4007-b0a1-cdc8bc6ae2f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c8c98c1e2d24de89c7d07753fae02e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:25.973053 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba98287-ac7d-4007-b0a1-cdc8bc6ae2f1 service swift] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:25.973464 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba98287-ac7d-4007-b0a1-cdc8bc6ae2f1 service swift] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:25.973893 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba98287-ac7d-4007-b0a1-cdc8bc6ae2f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:25.985048 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba98287-ac7d-4007-b0a1-cdc8bc6ae2f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:25.987091 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba98287-ac7d-4007-b0a1-cdc8bc6ae2f1 service swift] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:26.012956 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 876/1718] 10.222.0.60 () {60 vars in 1384 bytes} [Sun Jul 31 01:15:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 01:15:29.192656 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2175df-2fa8-4685-a16d-ac2f766d2b4b None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:29.193257 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2175df-2fa8-4685-a16d-ac2f766d2b4b None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:29.193338 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2175df-2fa8-4685-a16d-ac2f766d2b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:29.238064 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-1d2175df-2fa8-4685-a16d-ac2f766d2b4b None None] MFA Rules not processed for user `81117154f6d1474c805a69c5617c307d`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:29.242903 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-1d2175df-2fa8-4685-a16d-ac2f766d2b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:29.276695 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 843/1719] 10.222.0.70 () {58 vars in 1015 bytes} [Sun Jul 31 01:15:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:15:29.322134 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba98287-ac7d-4007-b0a1-cdc8bc6ae2f1 service swift] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:29.374368 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba98287-ac7d-4007-b0a1-cdc8bc6ae2f1 service swift] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:29.392235 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a65813-f529-4311-89b1-413f34e4b02c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:29.394161 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a65813-f529-4311-89b1-413f34e4b02c service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:29.395039 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a65813-f529-4311-89b1-413f34e4b02c service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:29.407541 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a65813-f529-4311-89b1-413f34e4b02c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:29.416370 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a65813-f529-4311-89b1-413f34e4b02c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:29.417996 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a65813-f529-4311-89b1-413f34e4b02c service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:29.433083 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 877/1720] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:15:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:15:29.516183 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2175df-2fa8-4685-a16d-ac2f766d2b4b None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:29.518093 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-1d2175df-2fa8-4685-a16d-ac2f766d2b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:29.758791 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2175df-2fa8-4685-a16d-ac2f766d2b4b None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:29.768852 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386cc22-335e-4a0d-bbd0-b41d28535952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:29.769603 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386cc22-335e-4a0d-bbd0-b41d28535952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:29.769803 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386cc22-335e-4a0d-bbd0-b41d28535952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:29.770077 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386cc22-335e-4a0d-bbd0-b41d28535952 admin admin] PATH_INFO: `/v3/users/d4a740cae0994b70b8bd0ae43853f284` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:29.772652 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4386cc22-335e-4a0d-bbd0-b41d28535952 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4a740cae0994b70b8bd0ae43853f284)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:29.774590 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4386cc22-335e-4a0d-bbd0-b41d28535952 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:29.883599 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-4386cc22-335e-4a0d-bbd0-b41d28535952 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4a740cae0994b70b8bd0ae43853f284'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:29.884296 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-4386cc22-335e-4a0d-bbd0-b41d28535952 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4a740cae0994b70b8bd0ae43853f284'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:29.918853 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-4386cc22-335e-4a0d-bbd0-b41d28535952 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4a740cae0994b70b8bd0ae43853f284'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:29.936665 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-4386cc22-335e-4a0d-bbd0-b41d28535952 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4a740cae0994b70b8bd0ae43853f284'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:29.937289 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-4386cc22-335e-4a0d-bbd0-b41d28535952 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4a740cae0994b70b8bd0ae43853f284'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:29.975435 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 844/1721] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:15:29 2022] DELETE /identity/v3/users/d4a740cae0994b70b8bd0ae43853f284 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:15:29.981648 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7feb7-aea8-4c84-af52-038332684fa4 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:29.983198 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7feb7-aea8-4c84-af52-038332684fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:29.984015 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7feb7-aea8-4c84-af52-038332684fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:30.037187 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-4fc7feb7-aea8-4c84-af52-038332684fa4 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:30.047718 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-4fc7feb7-aea8-4c84-af52-038332684fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:30.202722 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 878/1722] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:15:30.255600 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386cc22-335e-4a0d-bbd0-b41d28535952 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:30.257145 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-4386cc22-335e-4a0d-bbd0-b41d28535952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:30.315280 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:30.404164 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386cc22-335e-4a0d-bbd0-b41d28535952 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:30.408455 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b9117f-6701-417f-beae-fab4393a64bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:30.409696 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9117f-6701-417f-beae-fab4393a64bb service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:30.409983 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9117f-6701-417f-beae-fab4393a64bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:30.410263 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9117f-6701-417f-beae-fab4393a64bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:30.423284 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b9117f-6701-417f-beae-fab4393a64bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:30.425230 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b9117f-6701-417f-beae-fab4393a64bb service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:30.437223 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 845/1723] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:15:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:15:31.049624 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7feb7-aea8-4c84-af52-038332684fa4 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:31.051309 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-4fc7feb7-aea8-4c84-af52-038332684fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:31.066415 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7feb7-aea8-4c84-af52-038332684fa4 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:31.089554 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda760b-3cf0-47ba-8a38-194bb487e2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:31.090205 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda760b-3cf0-47ba-8a38-194bb487e2bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:31.090623 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda760b-3cf0-47ba-8a38-194bb487e2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:31.090890 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda760b-3cf0-47ba-8a38-194bb487e2bc admin admin] PATH_INFO: `/v3/projects/c42c4ac63b43473a9a4f4648ebd2394c` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:31.092584 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dda760b-3cf0-47ba-8a38-194bb487e2bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c42c4ac63b43473a9a4f4648ebd2394c)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:31.094559 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dda760b-3cf0-47ba-8a38-194bb487e2bc admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:31.222128 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-9dda760b-3cf0-47ba-8a38-194bb487e2bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c42c4ac63b43473a9a4f4648ebd2394c', 'request_id': 'req-9dda760b-3cf0-47ba-8a38-194bb487e2bc'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:31.230887 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-9dda760b-3cf0-47ba-8a38-194bb487e2bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c42c4ac63b43473a9a4f4648ebd2394c', 'request_id': 'req-9dda760b-3cf0-47ba-8a38-194bb487e2bc'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:31.241251 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-9dda760b-3cf0-47ba-8a38-194bb487e2bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c42c4ac63b43473a9a4f4648ebd2394c', 'request_id': 'req-9dda760b-3cf0-47ba-8a38-194bb487e2bc'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:31.271187 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29dcb0-4cbb-48fb-b06f-2e681bac13b1 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:31.271685 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29dcb0-4cbb-48fb-b06f-2e681bac13b1 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:31.271805 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29dcb0-4cbb-48fb-b06f-2e681bac13b1 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:31.273562 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 846/1724] 10.222.0.60 () {54 vars in 921 bytes} [Sun Jul 31 01:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:15:31.280462 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:31.290217 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a8e97-35c6-4a42-a720-a90cab0bee6f None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:31.290500 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a8e97-35c6-4a42-a720-a90cab0bee6f None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:31.290877 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a8e97-35c6-4a42-a720-a90cab0bee6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:31.297982 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-9dda760b-3cf0-47ba-8a38-194bb487e2bc admin admin] The token cache is being invalidate because project c42c4ac63b43473a9a4f4648ebd2394c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:15:31.298280 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-9dda760b-3cf0-47ba-8a38-194bb487e2bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:31.298981 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-9dda760b-3cf0-47ba-8a38-194bb487e2bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:31.304669 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 879/1725] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:15:31 2022] DELETE /identity/v3/projects/c42c4ac63b43473a9a4f4648ebd2394c => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:15:31.305274 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda760b-3cf0-47ba-8a38-194bb487e2bc admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:31.312659 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-9dda760b-3cf0-47ba-8a38-194bb487e2bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:31.320002 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-8e9a8e97-35c6-4a42-a720-a90cab0bee6f None None] MFA Rules not processed for user `04591cd035ef4961b8b7a93e294eb881`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:31.321630 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-8e9a8e97-35c6-4a42-a720-a90cab0bee6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:31.427183 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 847/1726] 10.222.0.60 () {58 vars in 1018 bytes} [Sun Jul 31 01:15:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:15:31.440136 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a8e97-35c6-4a42-a720-a90cab0bee6f None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:31.442543 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-8e9a8e97-35c6-4a42-a720-a90cab0bee6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:31.456455 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda760b-3cf0-47ba-8a38-194bb487e2bc admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:31.463635 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82cb3a-75c8-4c2e-8836-b9ad42d34317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:31.464507 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82cb3a-75c8-4c2e-8836-b9ad42d34317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:31.478741 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a8e97-35c6-4a42-a720-a90cab0bee6f None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:31.479287 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82cb3a-75c8-4c2e-8836-b9ad42d34317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:31.480059 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82cb3a-75c8-4c2e-8836-b9ad42d34317 admin admin] PATH_INFO: `/v3/users/d6ad93e38fae42f5aff54a6dc13b0132` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:31.483241 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82cb3a-75c8-4c2e-8836-b9ad42d34317 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6ad93e38fae42f5aff54a6dc13b0132)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:31.485520 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82cb3a-75c8-4c2e-8836-b9ad42d34317 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:31.490431 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c597e9-1fd1-4545-ba32-05d7f0279523 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:31.491330 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c597e9-1fd1-4545-ba32-05d7f0279523 service nova] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:31.492670 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c597e9-1fd1-4545-ba32-05d7f0279523 service nova] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:31.493082 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c597e9-1fd1-4545-ba32-05d7f0279523 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:31.548864 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c597e9-1fd1-4545-ba32-05d7f0279523 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:31.559541 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-5e82cb3a-75c8-4c2e-8836-b9ad42d34317 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6ad93e38fae42f5aff54a6dc13b0132'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:31.560087 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c597e9-1fd1-4545-ba32-05d7f0279523 service nova] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:31.570361 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-5e82cb3a-75c8-4c2e-8836-b9ad42d34317 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6ad93e38fae42f5aff54a6dc13b0132'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:31.571527 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-5e82cb3a-75c8-4c2e-8836-b9ad42d34317 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6ad93e38fae42f5aff54a6dc13b0132'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:31.589613 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 848/1727] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:15:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:15:31.590314 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-5e82cb3a-75c8-4c2e-8836-b9ad42d34317 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6ad93e38fae42f5aff54a6dc13b0132'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:31.591063 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-5e82cb3a-75c8-4c2e-8836-b9ad42d34317 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6ad93e38fae42f5aff54a6dc13b0132'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:31.616633 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 880/1728] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:15:31 2022] DELETE /identity/v3/users/d6ad93e38fae42f5aff54a6dc13b0132 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:15:33.254309 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c597e9-1fd1-4545-ba32-05d7f0279523 service nova] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:33.280643 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c597e9-1fd1-4545-ba32-05d7f0279523 service nova] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:33.452702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553ee68-a080-4667-b767-0464e3ebeb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:33.454692 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553ee68-a080-4667-b767-0464e3ebeb0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:33.454978 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553ee68-a080-4667-b767-0464e3ebeb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:33.455250 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553ee68-a080-4667-b767-0464e3ebeb0c admin admin] PATH_INFO: `/v3/projects/d700ea394d78489787977e8c404e505e` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:33.460467 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0553ee68-a080-4667-b767-0464e3ebeb0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d700ea394d78489787977e8c404e505e)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:33.462647 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0553ee68-a080-4667-b767-0464e3ebeb0c admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:33.493041 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82cb3a-75c8-4c2e-8836-b9ad42d34317 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:33.495064 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-5e82cb3a-75c8-4c2e-8836-b9ad42d34317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:33.523637 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82cb3a-75c8-4c2e-8836-b9ad42d34317 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:33.545500 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d59396-a52c-4dbf-831e-101df8bdcf78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:33.546423 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d59396-a52c-4dbf-831e-101df8bdcf78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:33.548391 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d59396-a52c-4dbf-831e-101df8bdcf78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:33.548799 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d59396-a52c-4dbf-831e-101df8bdcf78 admin admin] PATH_INFO: `/v3/users/b6f87ffe270340ccb98e06f86615d700` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:33.550932 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d59396-a52c-4dbf-831e-101df8bdcf78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6f87ffe270340ccb98e06f86615d700)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:33.555541 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d59396-a52c-4dbf-831e-101df8bdcf78 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:33.632226 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:33.658501 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-0553ee68-a080-4667-b767-0464e3ebeb0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd700ea394d78489787977e8c404e505e', 'request_id': 'req-0553ee68-a080-4667-b767-0464e3ebeb0c'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:33.672518 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-0553ee68-a080-4667-b767-0464e3ebeb0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd700ea394d78489787977e8c404e505e', 'request_id': 'req-0553ee68-a080-4667-b767-0464e3ebeb0c'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:33.687335 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-0553ee68-a080-4667-b767-0464e3ebeb0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd700ea394d78489787977e8c404e505e', 'request_id': 'req-0553ee68-a080-4667-b767-0464e3ebeb0c'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:33.716667 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-0553ee68-a080-4667-b767-0464e3ebeb0c admin admin] The token cache is being invalidate because project d700ea394d78489787977e8c404e505e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:15:33.717365 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-0553ee68-a080-4667-b767-0464e3ebeb0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:33.718516 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-0553ee68-a080-4667-b767-0464e3ebeb0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:33.721018 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 849/1729] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:15:33 2022] DELETE /identity/v3/projects/d700ea394d78489787977e8c404e505e => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:15:33.728544 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98786843-af2e-4c01-940e-990ce6221440 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:33.728777 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-13d59396-a52c-4dbf-831e-101df8bdcf78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6f87ffe270340ccb98e06f86615d700'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:33.730252 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98786843-af2e-4c01-940e-990ce6221440 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:33.731466 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98786843-af2e-4c01-940e-990ce6221440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:33.751625 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-13d59396-a52c-4dbf-831e-101df8bdcf78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6f87ffe270340ccb98e06f86615d700'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:33.752946 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-13d59396-a52c-4dbf-831e-101df8bdcf78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6f87ffe270340ccb98e06f86615d700'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:33.768816 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:33.775142 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-13d59396-a52c-4dbf-831e-101df8bdcf78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6f87ffe270340ccb98e06f86615d700'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:33.776004 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-13d59396-a52c-4dbf-831e-101df8bdcf78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6f87ffe270340ccb98e06f86615d700'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:33.792741 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-98786843-af2e-4c01-940e-990ce6221440 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:33.794774 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-98786843-af2e-4c01-940e-990ce6221440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:33.805723 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 881/1730] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:15:33 2022] DELETE /identity/v3/users/b6f87ffe270340ccb98e06f86615d700 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:15:33.807646 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db628e-6a40-4e99-915b-87579881a45f None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:33.808058 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db628e-6a40-4e99-915b-87579881a45f None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:33.808632 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db628e-6a40-4e99-915b-87579881a45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:33.884334 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-c6db628e-6a40-4e99-915b-87579881a45f None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:33.888906 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-c6db628e-6a40-4e99-915b-87579881a45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:33.947161 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 850/1731] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:15:33.957157 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bc855-f53c-42e9-855c-ce5e41e837f7 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:33.957398 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bc855-f53c-42e9-855c-ce5e41e837f7 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:33.957591 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bc855-f53c-42e9-855c-ce5e41e837f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:33.996481 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-7c6bc855-f53c-42e9-855c-ce5e41e837f7 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:33.997641 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-7c6bc855-f53c-42e9-855c-ce5e41e837f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:34.032166 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 882/1732] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:15:34.046709 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db628e-6a40-4e99-915b-87579881a45f None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:34.048254 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-c6db628e-6a40-4e99-915b-87579881a45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:34.160971 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db628e-6a40-4e99-915b-87579881a45f None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:34.174806 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374f962-ce42-4451-a354-a0f9784f34f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:34.174806 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374f962-ce42-4451-a354-a0f9784f34f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:34.175110 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374f962-ce42-4451-a354-a0f9784f34f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:34.175410 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374f962-ce42-4451-a354-a0f9784f34f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:34.201372 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374f962-ce42-4451-a354-a0f9784f34f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:34.203007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374f962-ce42-4451-a354-a0f9784f34f3 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:34.214484 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 851/1733] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:15:34.217538 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6bc855-f53c-42e9-855c-ce5e41e837f7 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:34.220985 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 883/1734] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:15:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:15:34.241480 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6bc855-f53c-42e9-855c-ce5e41e837f7 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:34.252925 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14129be1-3fb5-4124-a04d-76cf2f5b148a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:34.254291 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14129be1-3fb5-4124-a04d-76cf2f5b148a admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:34.254745 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14129be1-3fb5-4124-a04d-76cf2f5b148a admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:34.255322 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14129be1-3fb5-4124-a04d-76cf2f5b148a admin admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:34.256266 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14129be1-3fb5-4124-a04d-76cf2f5b148a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:15:34.256784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14129be1-3fb5-4124-a04d-76cf2f5b148a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:34.259033 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14129be1-3fb5-4124-a04d-76cf2f5b148a admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:34.345587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374f962-ce42-4451-a354-a0f9784f34f3 service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:34.346352 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 852/1735] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:15:34.370095 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374f962-ce42-4451-a354-a0f9784f34f3 service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:34.384250 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61cb998-270f-4d5a-a31a-1282c728e62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:34.384902 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61cb998-270f-4d5a-a31a-1282c728e62d admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:34.385337 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61cb998-270f-4d5a-a31a-1282c728e62d admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:34.385614 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61cb998-270f-4d5a-a31a-1282c728e62d admin admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:34.386303 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61cb998-270f-4d5a-a31a-1282c728e62d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:34.388337 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61cb998-270f-4d5a-a31a-1282c728e62d admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:34.458559 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 884/1736] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:15:34 2022] POST /identity/v3/projects => generated 359 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:15:34.461071 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14129be1-3fb5-4124-a04d-76cf2f5b148a admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:34.476131 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14129be1-3fb5-4124-a04d-76cf2f5b148a admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:34.571406 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:34.587044 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627510d0-4366-493d-a8bf-1f7b22bffc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:34.588921 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627510d0-4366-493d-a8bf-1f7b22bffc3b admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:34.590881 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627510d0-4366-493d-a8bf-1f7b22bffc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:34.592260 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627510d0-4366-493d-a8bf-1f7b22bffc3b admin admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:34.593244 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627510d0-4366-493d-a8bf-1f7b22bffc3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:34.597262 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627510d0-4366-493d-a8bf-1f7b22bffc3b admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:34.629404 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 853/1737] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:15:34 2022] POST /identity/v3/users => generated 280 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:15:34.634323 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61cb998-270f-4d5a-a31a-1282c728e62d admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:34.653903 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61cb998-270f-4d5a-a31a-1282c728e62d admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:34.664912 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae1989-65dd-49ae-85ec-9231cb111eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:34.666468 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae1989-65dd-49ae-85ec-9231cb111eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:34.668033 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae1989-65dd-49ae-85ec-9231cb111eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:34.671050 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae1989-65dd-49ae-85ec-9231cb111eb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:34.672424 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae1989-65dd-49ae-85ec-9231cb111eb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:34.674392 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae1989-65dd-49ae-85ec-9231cb111eb2 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:34.699204 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627510d0-4366-493d-a8bf-1f7b22bffc3b admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:34.711003 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 885/1738] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:15:34.714334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627510d0-4366-493d-a8bf-1f7b22bffc3b admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:34.720895 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78790e8b-94a6-4b05-9eac-d08a31feb25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:34.721847 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78790e8b-94a6-4b05-9eac-d08a31feb25a admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:34.722274 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78790e8b-94a6-4b05-9eac-d08a31feb25a admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:34.723512 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78790e8b-94a6-4b05-9eac-d08a31feb25a admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:34.724468 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78790e8b-94a6-4b05-9eac-d08a31feb25a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:34.726773 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78790e8b-94a6-4b05-9eac-d08a31feb25a admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:34.747518 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae1989-65dd-49ae-85ec-9231cb111eb2 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:34.767614 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 854/1739] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:15:34.770560 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae1989-65dd-49ae-85ec-9231cb111eb2 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:34.777669 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d6e15-0e44-403d-a1df-cc43cde8fc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:34.778674 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d6e15-0e44-403d-a1df-cc43cde8fc26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:34.779098 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d6e15-0e44-403d-a1df-cc43cde8fc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:34.779588 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d6e15-0e44-403d-a1df-cc43cde8fc26 admin admin] PATH_INFO: `/v3/projects/51f81963b0bc42b9aa53956324bef28c/users/c5560aa280ca41c6a04ed9347737d826/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:34.800081 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d6e15-0e44-403d-a1df-cc43cde8fc26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51f81963b0bc42b9aa53956324bef28c, user_id=c5560aa280ca41c6a04ed9347737d826, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:34.803019 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d6e15-0e44-403d-a1df-cc43cde8fc26 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:34.826816 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 886/1740] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:15:34 2022] PUT /identity/v3/projects/51f81963b0bc42b9aa53956324bef28c/users/c5560aa280ca41c6a04ed9347737d826/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:15:34.838354 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca82e1-c3f5-42e5-a755-33fcadc093d7 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:34.838528 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca82e1-c3f5-42e5-a755-33fcadc093d7 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:34.838810 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca82e1-c3f5-42e5-a755-33fcadc093d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:34.877990 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-5cca82e1-c3f5-42e5-a755-33fcadc093d7 None None] MFA Rules not processed for user `c5560aa280ca41c6a04ed9347737d826`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:34.879469 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-5cca82e1-c3f5-42e5-a755-33fcadc093d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:34.975390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 855/1741] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:15:34 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:15:35.144394 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d6e15-0e44-403d-a1df-cc43cde8fc26 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:35.259820 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:35.309585 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d6e15-0e44-403d-a1df-cc43cde8fc26 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:35.315644 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fed924-ee96-4207-9ae2-38a4eaaa905c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:35.316298 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fed924-ee96-4207-9ae2-38a4eaaa905c service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:35.316621 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fed924-ee96-4207-9ae2-38a4eaaa905c service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:35.316831 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fed924-ee96-4207-9ae2-38a4eaaa905c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:35.329456 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fed924-ee96-4207-9ae2-38a4eaaa905c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:35.330914 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fed924-ee96-4207-9ae2-38a4eaaa905c service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:35.356086 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 887/1742] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:15:35 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:15:35.731949 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca82e1-c3f5-42e5-a755-33fcadc093d7 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:35.738882 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-5cca82e1-c3f5-42e5-a755-33fcadc093d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:35.867673 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca82e1-c3f5-42e5-a755-33fcadc093d7 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:35.874958 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29c014-b944-4f93-8625-0731561b4c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:35.876076 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29c014-b944-4f93-8625-0731561b4c83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:35.876354 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29c014-b944-4f93-8625-0731561b4c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:35.876761 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29c014-b944-4f93-8625-0731561b4c83 admin admin] PATH_INFO: `/v3/projects/db7a845ba95b4f15a1236d206950f98d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:35.882393 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd29c014-b944-4f93-8625-0731561b4c83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db7a845ba95b4f15a1236d206950f98d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:35.886180 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd29c014-b944-4f93-8625-0731561b4c83 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:35.956899 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-bd29c014-b944-4f93-8625-0731561b4c83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db7a845ba95b4f15a1236d206950f98d', 'request_id': 'req-bd29c014-b944-4f93-8625-0731561b4c83'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:35.963936 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-bd29c014-b944-4f93-8625-0731561b4c83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db7a845ba95b4f15a1236d206950f98d', 'request_id': 'req-bd29c014-b944-4f93-8625-0731561b4c83'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:35.971383 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-bd29c014-b944-4f93-8625-0731561b4c83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db7a845ba95b4f15a1236d206950f98d', 'request_id': 'req-bd29c014-b944-4f93-8625-0731561b4c83'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:35.975970 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:35.988966 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-bd29c014-b944-4f93-8625-0731561b4c83 admin admin] The token cache is being invalidate because project db7a845ba95b4f15a1236d206950f98d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:15:35.989151 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-bd29c014-b944-4f93-8625-0731561b4c83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:35.989755 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-bd29c014-b944-4f93-8625-0731561b4c83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:35.994772 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 856/1743] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:15:35 2022] DELETE /identity/v3/projects/db7a845ba95b4f15a1236d206950f98d => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:15:35.997065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fed924-ee96-4207-9ae2-38a4eaaa905c service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:36.009334 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fed924-ee96-4207-9ae2-38a4eaaa905c service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:36.109315 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f28f4e-1a40-4586-aa1f-1e91b5baaaf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:36.109315 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f28f4e-1a40-4586-aa1f-1e91b5baaaf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:36.110051 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f28f4e-1a40-4586-aa1f-1e91b5baaaf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:36.110226 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f28f4e-1a40-4586-aa1f-1e91b5baaaf6 admin admin] PATH_INFO: `/v3/users/da3472e8fd2e4f71939d3076cf46b97e` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:36.113204 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f28f4e-1a40-4586-aa1f-1e91b5baaaf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da3472e8fd2e4f71939d3076cf46b97e)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:36.121238 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f28f4e-1a40-4586-aa1f-1e91b5baaaf6 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:36.207738 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-95f28f4e-1a40-4586-aa1f-1e91b5baaaf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da3472e8fd2e4f71939d3076cf46b97e'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:36.216457 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-95f28f4e-1a40-4586-aa1f-1e91b5baaaf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da3472e8fd2e4f71939d3076cf46b97e'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:36.217598 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-95f28f4e-1a40-4586-aa1f-1e91b5baaaf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da3472e8fd2e4f71939d3076cf46b97e'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:36.244781 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-95f28f4e-1a40-4586-aa1f-1e91b5baaaf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da3472e8fd2e4f71939d3076cf46b97e'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:36.246391 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-95f28f4e-1a40-4586-aa1f-1e91b5baaaf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da3472e8fd2e4f71939d3076cf46b97e'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:36.284345 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 888/1744] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:15:35 2022] DELETE /identity/v3/users/da3472e8fd2e4f71939d3076cf46b97e => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:15:37.206287 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29c014-b944-4f93-8625-0731561b4c83 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:37.208056 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-bd29c014-b944-4f93-8625-0731561b4c83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:37.223107 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29c014-b944-4f93-8625-0731561b4c83 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:37.377184 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47186018-480f-4a04-aa16-7be68a1c94f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:37.378114 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47186018-480f-4a04-aa16-7be68a1c94f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:37.379086 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47186018-480f-4a04-aa16-7be68a1c94f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:37.379401 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47186018-480f-4a04-aa16-7be68a1c94f1 admin admin] PATH_INFO: `/v3/projects/0c361568389348339f879f51faeda1eb` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:37.381718 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47186018-480f-4a04-aa16-7be68a1c94f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c361568389348339f879f51faeda1eb)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:37.383866 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47186018-480f-4a04-aa16-7be68a1c94f1 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:37.452983 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-47186018-480f-4a04-aa16-7be68a1c94f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c361568389348339f879f51faeda1eb', 'request_id': 'req-47186018-480f-4a04-aa16-7be68a1c94f1'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:37.460416 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-47186018-480f-4a04-aa16-7be68a1c94f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c361568389348339f879f51faeda1eb', 'request_id': 'req-47186018-480f-4a04-aa16-7be68a1c94f1'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:37.468074 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-47186018-480f-4a04-aa16-7be68a1c94f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c361568389348339f879f51faeda1eb', 'request_id': 'req-47186018-480f-4a04-aa16-7be68a1c94f1'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:37.491719 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f28f4e-1a40-4586-aa1f-1e91b5baaaf6 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:37.493883 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-95f28f4e-1a40-4586-aa1f-1e91b5baaaf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:37.506804 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-47186018-480f-4a04-aa16-7be68a1c94f1 admin admin] The token cache is being invalidate because project 0c361568389348339f879f51faeda1eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:15:37.507453 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-47186018-480f-4a04-aa16-7be68a1c94f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:37.509607 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-47186018-480f-4a04-aa16-7be68a1c94f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:37.518748 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 857/1745] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:15:37 2022] DELETE /identity/v3/projects/0c361568389348339f879f51faeda1eb => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:15:37.518954 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f28f4e-1a40-4586-aa1f-1e91b5baaaf6 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:37.520579 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d78562-3f9f-4447-aabe-18397749231f None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:37.520961 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d78562-3f9f-4447-aabe-18397749231f None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:37.521323 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d78562-3f9f-4447-aabe-18397749231f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:37.564623 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-40d78562-3f9f-4447-aabe-18397749231f None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:37.566207 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-40d78562-3f9f-4447-aabe-18397749231f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:37.604143 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:37.616141 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4567e7-1cf0-4ad1-b12c-6adf0b6c357f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:37.618914 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4567e7-1cf0-4ad1-b12c-6adf0b6c357f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:37.619277 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4567e7-1cf0-4ad1-b12c-6adf0b6c357f admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:37.621155 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4567e7-1cf0-4ad1-b12c-6adf0b6c357f admin admin] PATH_INFO: `/v3/users/7f0dc64091fc4480a9b0f3aed10ecebe` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:37.625423 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4567e7-1cf0-4ad1-b12c-6adf0b6c357f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f0dc64091fc4480a9b0f3aed10ecebe)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:37.628133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4567e7-1cf0-4ad1-b12c-6adf0b6c357f admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:37.669523 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 858/1746] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:15:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:15:37.671381 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34322e9-6818-4b5d-bca7-7e5186db4791 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:37.671830 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34322e9-6818-4b5d-bca7-7e5186db4791 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:37.672288 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34322e9-6818-4b5d-bca7-7e5186db4791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:37.697346 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-b34322e9-6818-4b5d-bca7-7e5186db4791 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:37.698894 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-b34322e9-6818-4b5d-bca7-7e5186db4791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:37.713204 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 859/1747] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:15:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:15:37.716964 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34322e9-6818-4b5d-bca7-7e5186db4791 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:37.717121 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-4e4567e7-1cf0-4ad1-b12c-6adf0b6c357f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f0dc64091fc4480a9b0f3aed10ecebe'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:37.728452 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-4e4567e7-1cf0-4ad1-b12c-6adf0b6c357f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f0dc64091fc4480a9b0f3aed10ecebe'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:37.736973 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-4e4567e7-1cf0-4ad1-b12c-6adf0b6c357f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f0dc64091fc4480a9b0f3aed10ecebe'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:37.739709 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34322e9-6818-4b5d-bca7-7e5186db4791 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:37.746853 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387c827-8729-4a82-9f37-18764c380bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:37.747788 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387c827-8729-4a82-9f37-18764c380bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:37.748157 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387c827-8729-4a82-9f37-18764c380bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:37.748528 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387c827-8729-4a82-9f37-18764c380bf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:37.749505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2387c827-8729-4a82-9f37-18764c380bf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:15:37.749912 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2387c827-8729-4a82-9f37-18764c380bf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:37.752723 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2387c827-8729-4a82-9f37-18764c380bf1 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:37.769530 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-4e4567e7-1cf0-4ad1-b12c-6adf0b6c357f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f0dc64091fc4480a9b0f3aed10ecebe'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:37.770543 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-4e4567e7-1cf0-4ad1-b12c-6adf0b6c357f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f0dc64091fc4480a9b0f3aed10ecebe'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:37.783596 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 860/1748] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:15:37.787655 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387c827-8729-4a82-9f37-18764c380bf1 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:37.795707 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-2387c827-8729-4a82-9f37-18764c380bf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:37.800014 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 889/1749] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:15:37 2022] DELETE /identity/v3/users/7f0dc64091fc4480a9b0f3aed10ecebe => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:15:37.805291 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647ae4e-a6e6-42f2-8834-59acf46bae4b None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:37.807574 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647ae4e-a6e6-42f2-8834-59acf46bae4b None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:37.808117 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647ae4e-a6e6-42f2-8834-59acf46bae4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:37.816224 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387c827-8729-4a82-9f37-18764c380bf1 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:37.820573 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:37.843363 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-b647ae4e-a6e6-42f2-8834-59acf46bae4b None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:37.846633 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-b647ae4e-a6e6-42f2-8834-59acf46bae4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:37.904282 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329f62d-0327-4417-9882-5b65b231958f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:37.905254 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329f62d-0327-4417-9882-5b65b231958f admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:37.905692 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329f62d-0327-4417-9882-5b65b231958f admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:37.906101 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329f62d-0327-4417-9882-5b65b231958f admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:37.907214 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329f62d-0327-4417-9882-5b65b231958f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:37.910857 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329f62d-0327-4417-9882-5b65b231958f admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:37.966802 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 861/1750] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:15:37 2022] POST /identity/v3/projects => generated 367 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:15:37.971275 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329f62d-0327-4417-9882-5b65b231958f admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:37.982864 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 890/1751] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:15:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:15:37.993706 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647ae4e-a6e6-42f2-8834-59acf46bae4b None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:38.000620 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-b647ae4e-a6e6-42f2-8834-59acf46bae4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:38.074893 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329f62d-0327-4417-9882-5b65b231958f admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:38.086090 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee39e4d-5554-472e-b65e-f2d63ee46e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:38.087602 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee39e4d-5554-472e-b65e-f2d63ee46e4a admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:38.088844 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee39e4d-5554-472e-b65e-f2d63ee46e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:38.089117 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee39e4d-5554-472e-b65e-f2d63ee46e4a admin admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:38.089815 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee39e4d-5554-472e-b65e-f2d63ee46e4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:38.092010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee39e4d-5554-472e-b65e-f2d63ee46e4a admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:38.105572 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647ae4e-a6e6-42f2-8834-59acf46bae4b None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:38.147224 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 862/1752] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:15:37 2022] POST /identity/v3/users => generated 284 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:15:38.151095 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee39e4d-5554-472e-b65e-f2d63ee46e4a admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:38.153751 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:38.155994 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-0ee39e4d-5554-472e-b65e-f2d63ee46e4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:38.181636 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd7615-9a0d-446e-b05f-ea0355b81c55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:38.182627 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd7615-9a0d-446e-b05f-ea0355b81c55 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:38.183000 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd7615-9a0d-446e-b05f-ea0355b81c55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:38.183382 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd7615-9a0d-446e-b05f-ea0355b81c55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:38.194972 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd7615-9a0d-446e-b05f-ea0355b81c55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:38.196825 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd7615-9a0d-446e-b05f-ea0355b81c55 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:38.209503 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 891/1753] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:15:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:15:38.210109 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd7615-9a0d-446e-b05f-ea0355b81c55 service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:38.221108 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd7615-9a0d-446e-b05f-ea0355b81c55 service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:38.227165 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3cb9a8-349c-4478-838d-f1d4005bc5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:38.227884 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3cb9a8-349c-4478-838d-f1d4005bc5ee admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:38.228278 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3cb9a8-349c-4478-838d-f1d4005bc5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:38.228645 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3cb9a8-349c-4478-838d-f1d4005bc5ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:38.230161 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3cb9a8-349c-4478-838d-f1d4005bc5ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:38.232482 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3cb9a8-349c-4478-838d-f1d4005bc5ee admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:38.241829 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee39e4d-5554-472e-b65e-f2d63ee46e4a admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:38.246587 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f1e11-28fd-4db1-87a0-22ec4cc80b11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:38.247393 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f1e11-28fd-4db1-87a0-22ec4cc80b11 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:38.247526 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 892/1754] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:15:38.248023 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f1e11-28fd-4db1-87a0-22ec4cc80b11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:38.248453 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f1e11-28fd-4db1-87a0-22ec4cc80b11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:38.251437 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-b66f1e11-28fd-4db1-87a0-22ec4cc80b11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:38.251921 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3cb9a8-349c-4478-838d-f1d4005bc5ee admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:38.267282 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3cb9a8-349c-4478-838d-f1d4005bc5ee admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:38.272274 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2099b9-e024-4c8a-91f4-65f01742b07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:38.273169 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2099b9-e024-4c8a-91f4-65f01742b07b admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:38.273284 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2099b9-e024-4c8a-91f4-65f01742b07b admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:38.273555 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2099b9-e024-4c8a-91f4-65f01742b07b admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:38.274486 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2099b9-e024-4c8a-91f4-65f01742b07b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:38.276666 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2099b9-e024-4c8a-91f4-65f01742b07b admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:38.289622 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 893/1755] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:15:38.293970 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2099b9-e024-4c8a-91f4-65f01742b07b admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:38.295340 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:38.317435 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2099b9-e024-4c8a-91f4-65f01742b07b admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:38.333628 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e61cb-70bd-42b0-a851-99a6d1c5ff51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:38.335724 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e61cb-70bd-42b0-a851-99a6d1c5ff51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:38.336365 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e61cb-70bd-42b0-a851-99a6d1c5ff51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:38.338302 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e61cb-70bd-42b0-a851-99a6d1c5ff51 admin admin] PATH_INFO: `/v3/projects/322edb2c340048d3b05599eca021a5ed/users/125c245d3938444baea77d7908ab0034/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:38.352953 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f1e11-28fd-4db1-87a0-22ec4cc80b11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:38.354496 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f1e11-28fd-4db1-87a0-22ec4cc80b11 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:38.379865 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 863/1756] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:15:38 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:15:38.389305 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e61cb-70bd-42b0-a851-99a6d1c5ff51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=322edb2c340048d3b05599eca021a5ed, user_id=125c245d3938444baea77d7908ab0034, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:38.398016 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e61cb-70bd-42b0-a851-99a6d1c5ff51 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:38.441379 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 894/1757] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:15:38 2022] PUT /identity/v3/projects/322edb2c340048d3b05599eca021a5ed/users/125c245d3938444baea77d7908ab0034/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:15:38.442948 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793397e-7d3c-40f8-a255-4c37dfb7a103 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:38.443235 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793397e-7d3c-40f8-a255-4c37dfb7a103 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:38.443531 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793397e-7d3c-40f8-a255-4c37dfb7a103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:38.475106 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-b793397e-7d3c-40f8-a255-4c37dfb7a103 None None] MFA Rules not processed for user `125c245d3938444baea77d7908ab0034`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:38.476516 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-b793397e-7d3c-40f8-a255-4c37dfb7a103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:38.509140 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e61cb-70bd-42b0-a851-99a6d1c5ff51 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:38.511104 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-6b5e61cb-70bd-42b0-a851-99a6d1c5ff51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:38.621802 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 864/1758] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:15:38 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:15:38.630298 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793397e-7d3c-40f8-a255-4c37dfb7a103 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:38.642260 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e61cb-70bd-42b0-a851-99a6d1c5ff51 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:38.648199 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340fb056-7765-41d4-b90d-c4ae88698467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:38.649316 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340fb056-7765-41d4-b90d-c4ae88698467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:38.649316 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340fb056-7765-41d4-b90d-c4ae88698467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:38.649580 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340fb056-7765-41d4-b90d-c4ae88698467 admin admin] PATH_INFO: `/v3/projects/a6a9449a682849ff8fbef0b5b228a6e1` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:38.650718 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340fb056-7765-41d4-b90d-c4ae88698467 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6a9449a682849ff8fbef0b5b228a6e1)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:38.652809 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340fb056-7765-41d4-b90d-c4ae88698467 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:38.656059 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793397e-7d3c-40f8-a255-4c37dfb7a103 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:38.662333 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214e043-0a46-4758-8bd9-c9501f9080fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:38.663308 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214e043-0a46-4758-8bd9-c9501f9080fc admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:38.663616 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214e043-0a46-4758-8bd9-c9501f9080fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:38.664032 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214e043-0a46-4758-8bd9-c9501f9080fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:38.664567 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3214e043-0a46-4758-8bd9-c9501f9080fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:38.666915 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3214e043-0a46-4758-8bd9-c9501f9080fc admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:38.734266 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 865/1759] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:15:38 2022] POST /identity/v3/projects => generated 369 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:15:38.735571 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214e043-0a46-4758-8bd9-c9501f9080fc admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:38.744292 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-340fb056-7765-41d4-b90d-c4ae88698467 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6a9449a682849ff8fbef0b5b228a6e1', 'request_id': 'req-340fb056-7765-41d4-b90d-c4ae88698467'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:38.754292 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-340fb056-7765-41d4-b90d-c4ae88698467 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6a9449a682849ff8fbef0b5b228a6e1', 'request_id': 'req-340fb056-7765-41d4-b90d-c4ae88698467'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:38.762549 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-340fb056-7765-41d4-b90d-c4ae88698467 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6a9449a682849ff8fbef0b5b228a6e1', 'request_id': 'req-340fb056-7765-41d4-b90d-c4ae88698467'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:38.786853 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-340fb056-7765-41d4-b90d-c4ae88698467 admin admin] The token cache is being invalidate because project a6a9449a682849ff8fbef0b5b228a6e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:15:38.787186 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-340fb056-7765-41d4-b90d-c4ae88698467 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:38.788119 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-340fb056-7765-41d4-b90d-c4ae88698467 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:38.793611 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 895/1760] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:15:38 2022] DELETE /identity/v3/projects/a6a9449a682849ff8fbef0b5b228a6e1 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:15:38.795709 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340fb056-7765-41d4-b90d-c4ae88698467 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:38.797751 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-340fb056-7765-41d4-b90d-c4ae88698467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:38.834304 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:38.848708 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214e043-0a46-4758-8bd9-c9501f9080fc admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:38.858176 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05fa802-1494-41ea-9a08-c02819bd1a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:38.858894 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05fa802-1494-41ea-9a08-c02819bd1a57 admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:38.859280 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05fa802-1494-41ea-9a08-c02819bd1a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:38.859446 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05fa802-1494-41ea-9a08-c02819bd1a57 admin admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:38.860256 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05fa802-1494-41ea-9a08-c02819bd1a57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:38.865758 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05fa802-1494-41ea-9a08-c02819bd1a57 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:38.945905 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 866/1761] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:15:38 2022] POST /identity/v3/users => generated 291 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:15:38.947613 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05fa802-1494-41ea-9a08-c02819bd1a57 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:38.949670 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-b05fa802-1494-41ea-9a08-c02819bd1a57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:38.949952 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340fb056-7765-41d4-b90d-c4ae88698467 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:38.960740 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62518f8b-2b9e-4466-a2dc-410734a7524e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:38.961417 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62518f8b-2b9e-4466-a2dc-410734a7524e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:38.961692 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62518f8b-2b9e-4466-a2dc-410734a7524e admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:38.961959 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62518f8b-2b9e-4466-a2dc-410734a7524e admin admin] PATH_INFO: `/v3/users/a9ccb8500c5440d5ad6a74e99d0a1aa6` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:38.963881 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62518f8b-2b9e-4466-a2dc-410734a7524e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9ccb8500c5440d5ad6a74e99d0a1aa6)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:38.965819 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62518f8b-2b9e-4466-a2dc-410734a7524e admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:38.988346 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05fa802-1494-41ea-9a08-c02819bd1a57 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:39.004407 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7ca85-acb8-47e8-9a80-f4bef9ead078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:39.005792 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7ca85-acb8-47e8-9a80-f4bef9ead078 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:39.006765 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7ca85-acb8-47e8-9a80-f4bef9ead078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:39.009381 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7ca85-acb8-47e8-9a80-f4bef9ead078 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:39.010873 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad7ca85-acb8-47e8-9a80-f4bef9ead078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:39.018287 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad7ca85-acb8-47e8-9a80-f4bef9ead078 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:39.055665 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 867/1762] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:15:39.056898 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7ca85-acb8-47e8-9a80-f4bef9ead078 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:39.075775 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-62518f8b-2b9e-4466-a2dc-410734a7524e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9ccb8500c5440d5ad6a74e99d0a1aa6'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:39.078185 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7ca85-acb8-47e8-9a80-f4bef9ead078 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:39.084151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-62518f8b-2b9e-4466-a2dc-410734a7524e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9ccb8500c5440d5ad6a74e99d0a1aa6'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:39.090253 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d45230-96ff-4519-afde-5ba76390b063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:39.091116 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d45230-96ff-4519-afde-5ba76390b063 admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:39.092100 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-62518f8b-2b9e-4466-a2dc-410734a7524e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9ccb8500c5440d5ad6a74e99d0a1aa6'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:39.092520 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d45230-96ff-4519-afde-5ba76390b063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:39.093533 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d45230-96ff-4519-afde-5ba76390b063 admin admin] PATH_INFO: `/v3/projects/74fbf64153cf451f905e85f5a0ba2abf/users/a71065c7423e48e08758a4a977cd95d7/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:39.112803 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-62518f8b-2b9e-4466-a2dc-410734a7524e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9ccb8500c5440d5ad6a74e99d0a1aa6'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:39.114387 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-62518f8b-2b9e-4466-a2dc-410734a7524e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9ccb8500c5440d5ad6a74e99d0a1aa6'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:39.145507 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 896/1763] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:15:38 2022] DELETE /identity/v3/users/a9ccb8500c5440d5ad6a74e99d0a1aa6 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:15:39.151121 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d45230-96ff-4519-afde-5ba76390b063 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74fbf64153cf451f905e85f5a0ba2abf, user_id=a71065c7423e48e08758a4a977cd95d7, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:39.159914 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d45230-96ff-4519-afde-5ba76390b063 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:39.174017 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:39.205500 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 868/1764] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:15:39 2022] PUT /identity/v3/projects/74fbf64153cf451f905e85f5a0ba2abf/users/a71065c7423e48e08758a4a977cd95d7/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:15:39.209650 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62518f8b-2b9e-4466-a2dc-410734a7524e admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:39.211153 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-62518f8b-2b9e-4466-a2dc-410734a7524e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:39.340587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62518f8b-2b9e-4466-a2dc-410734a7524e admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:39.487912 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:39.530744 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ab58d-e308-4ea4-a5d8-8bb6cea06654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:39.531539 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ab58d-e308-4ea4-a5d8-8bb6cea06654 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:39.531689 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ab58d-e308-4ea4-a5d8-8bb6cea06654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:39.532035 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ab58d-e308-4ea4-a5d8-8bb6cea06654 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:39.532657 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ab58d-e308-4ea4-a5d8-8bb6cea06654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:39.534450 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ab58d-e308-4ea4-a5d8-8bb6cea06654 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:39.551279 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 897/1765] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:15:39.555840 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d45230-96ff-4519-afde-5ba76390b063 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:39.573957 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d45230-96ff-4519-afde-5ba76390b063 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:39.594156 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b439e9d-03b4-48a5-8675-cc0a07b2e22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:39.596134 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b439e9d-03b4-48a5-8675-cc0a07b2e22b admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:39.596524 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b439e9d-03b4-48a5-8675-cc0a07b2e22b admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:39.599080 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b439e9d-03b4-48a5-8675-cc0a07b2e22b admin admin] PATH_INFO: `/v3/projects/74fbf64153cf451f905e85f5a0ba2abf/users/a71065c7423e48e08758a4a977cd95d7/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:39.606953 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b439e9d-03b4-48a5-8675-cc0a07b2e22b admin admin] RBAC: Authorizing `identity:create_grant(project_id=74fbf64153cf451f905e85f5a0ba2abf, user_id=a71065c7423e48e08758a4a977cd95d7, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:39.615923 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b439e9d-03b4-48a5-8675-cc0a07b2e22b admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:39.660511 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 869/1766] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:15:39 2022] PUT /identity/v3/projects/74fbf64153cf451f905e85f5a0ba2abf/users/a71065c7423e48e08758a4a977cd95d7/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:15:39.662737 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c024e-4eea-4ab4-997a-6b0675ed7c53 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:39.662737 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c024e-4eea-4ab4-997a-6b0675ed7c53 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:39.662895 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c024e-4eea-4ab4-997a-6b0675ed7c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:39.747386 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-be5c024e-4eea-4ab4-997a-6b0675ed7c53 None None] MFA Rules not processed for user `a71065c7423e48e08758a4a977cd95d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:39.748868 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-be5c024e-4eea-4ab4-997a-6b0675ed7c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:39.869382 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 898/1767] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:15:39 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:15:39.929215 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b439e9d-03b4-48a5-8675-cc0a07b2e22b admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:39.938574 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-2b439e9d-03b4-48a5-8675-cc0a07b2e22b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:40.086179 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b439e9d-03b4-48a5-8675-cc0a07b2e22b admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:40.096827 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa17db7-632c-43d7-adc4-cb0d26e871d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:40.100396 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa17db7-632c-43d7-adc4-cb0d26e871d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:40.101631 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa17db7-632c-43d7-adc4-cb0d26e871d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:40.102657 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa17db7-632c-43d7-adc4-cb0d26e871d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:40.128190 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa17db7-632c-43d7-adc4-cb0d26e871d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:40.133692 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa17db7-632c-43d7-adc4-cb0d26e871d2 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:40.163089 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 870/1768] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:15:39 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:15:42.699636 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c024e-4eea-4ab4-997a-6b0675ed7c53 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:42.701640 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-be5c024e-4eea-4ab4-997a-6b0675ed7c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:42.758442 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffa60c-2daa-479f-a6de-c10e4aa3af21 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:42.759005 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffa60c-2daa-479f-a6de-c10e4aa3af21 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:42.759005 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffa60c-2daa-479f-a6de-c10e4aa3af21 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:42.760812 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 871/1769] 10.222.0.60 () {54 vars in 921 bytes} [Sun Jul 31 01:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:15:42.781624 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ec5c1-f6d7-485c-948c-a34154ad66e4 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:42.781819 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ec5c1-f6d7-485c-948c-a34154ad66e4 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:42.782371 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ec5c1-f6d7-485c-948c-a34154ad66e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:42.822403 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-fc8ec5c1-f6d7-485c-948c-a34154ad66e4 None None] MFA Rules not processed for user `04591cd035ef4961b8b7a93e294eb881`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:42.823679 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-fc8ec5c1-f6d7-485c-948c-a34154ad66e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:42.844836 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c024e-4eea-4ab4-997a-6b0675ed7c53 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:42.861987 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ba549-74da-4b8d-858b-2a50d3e7aa03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:42.863460 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ba549-74da-4b8d-858b-2a50d3e7aa03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:42.864047 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ba549-74da-4b8d-858b-2a50d3e7aa03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:42.864515 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ba549-74da-4b8d-858b-2a50d3e7aa03 admin admin] PATH_INFO: `/v3/projects/c112ee823bed4d08a0b3bb879d926659` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:42.867424 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ba549-74da-4b8d-858b-2a50d3e7aa03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c112ee823bed4d08a0b3bb879d926659)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:42.872451 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ba549-74da-4b8d-858b-2a50d3e7aa03 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:42.963737 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 872/1770] 10.222.0.60 () {58 vars in 1018 bytes} [Sun Jul 31 01:15:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:15:42.974759 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-ab0ba549-74da-4b8d-858b-2a50d3e7aa03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c112ee823bed4d08a0b3bb879d926659', 'request_id': 'req-ab0ba549-74da-4b8d-858b-2a50d3e7aa03'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:42.987245 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-ab0ba549-74da-4b8d-858b-2a50d3e7aa03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c112ee823bed4d08a0b3bb879d926659', 'request_id': 'req-ab0ba549-74da-4b8d-858b-2a50d3e7aa03'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:43.002129 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-ab0ba549-74da-4b8d-858b-2a50d3e7aa03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c112ee823bed4d08a0b3bb879d926659', 'request_id': 'req-ab0ba549-74da-4b8d-858b-2a50d3e7aa03'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:43.019789 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:43.031424 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-ab0ba549-74da-4b8d-858b-2a50d3e7aa03 admin admin] The token cache is being invalidate because project c112ee823bed4d08a0b3bb879d926659 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:15:43.032301 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-ab0ba549-74da-4b8d-858b-2a50d3e7aa03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:43.033363 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-ab0ba549-74da-4b8d-858b-2a50d3e7aa03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:43.061298 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef08a8-a1d9-45f5-9966-902c13832a05 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:43.061612 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef08a8-a1d9-45f5-9966-902c13832a05 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:43.061857 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef08a8-a1d9-45f5-9966-902c13832a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:43.075636 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 899/1771] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:15:42 2022] DELETE /identity/v3/projects/c112ee823bed4d08a0b3bb879d926659 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:15:43.111979 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-39ef08a8-a1d9-45f5-9966-902c13832a05 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:43.113229 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-39ef08a8-a1d9-45f5-9966-902c13832a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:43.236879 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 873/1772] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:15:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:15:43.247379 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58cde3-61a7-477a-a94e-ce811a3130ae None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:43.247693 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58cde3-61a7-477a-a94e-ce811a3130ae None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:43.248037 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58cde3-61a7-477a-a94e-ce811a3130ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:43.285275 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef08a8-a1d9-45f5-9966-902c13832a05 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:43.292393 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-39ef08a8-a1d9-45f5-9966-902c13832a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:43.313634 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-9d58cde3-61a7-477a-a94e-ce811a3130ae None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:43.315223 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-9d58cde3-61a7-477a-a94e-ce811a3130ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:43.354942 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 900/1773] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:15:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:15:43.356321 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58cde3-61a7-477a-a94e-ce811a3130ae None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:43.364382 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:43.415476 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58cde3-61a7-477a-a94e-ce811a3130ae None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:43.445495 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d76037-80f9-40a6-bf71-a34fe29f55c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:43.446520 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d76037-80f9-40a6-bf71-a34fe29f55c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:43.447073 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d76037-80f9-40a6-bf71-a34fe29f55c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:43.447541 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d76037-80f9-40a6-bf71-a34fe29f55c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:43.448449 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d76037-80f9-40a6-bf71-a34fe29f55c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:15:43.448900 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d76037-80f9-40a6-bf71-a34fe29f55c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:43.450654 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d76037-80f9-40a6-bf71-a34fe29f55c3 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:43.473965 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 901/1774] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:15:43.478421 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d76037-80f9-40a6-bf71-a34fe29f55c3 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:43.485434 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef08a8-a1d9-45f5-9966-902c13832a05 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:43.491314 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135a7ee-60d3-432e-bc35-30962d0c1a35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:43.492253 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135a7ee-60d3-432e-bc35-30962d0c1a35 service nova] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:43.492457 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135a7ee-60d3-432e-bc35-30962d0c1a35 service nova] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:43.492840 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135a7ee-60d3-432e-bc35-30962d0c1a35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:43.495536 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-2135a7ee-60d3-432e-bc35-30962d0c1a35 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:43.498013 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d76037-80f9-40a6-bf71-a34fe29f55c3 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:43.510257 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2135a7ee-60d3-432e-bc35-30962d0c1a35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:43.510467 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5473cac-aa45-4734-8081-0d796429e0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:43.510909 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5473cac-aa45-4734-8081-0d796429e0ca admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:43.511188 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5473cac-aa45-4734-8081-0d796429e0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:43.511459 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5473cac-aa45-4734-8081-0d796429e0ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:43.512234 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2135a7ee-60d3-432e-bc35-30962d0c1a35 service nova] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:43.512337 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5473cac-aa45-4734-8081-0d796429e0ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:43.514266 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5473cac-aa45-4734-8081-0d796429e0ca admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:43.525391 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 874/1775] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:15:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:15:43.582240 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 902/1776] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:15:43 2022] POST /identity/v3/projects => generated 357 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:15:43.588001 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135a7ee-60d3-432e-bc35-30962d0c1a35 service nova] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:43.618678 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135a7ee-60d3-432e-bc35-30962d0c1a35 service nova] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:43.784428 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a33a82-66f7-453a-b9be-7b7f6a68fa45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:43.786600 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a33a82-66f7-453a-b9be-7b7f6a68fa45 admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:43.787908 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a33a82-66f7-453a-b9be-7b7f6a68fa45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:43.788297 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a33a82-66f7-453a-b9be-7b7f6a68fa45 admin admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:43.789104 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a33a82-66f7-453a-b9be-7b7f6a68fa45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:43.800095 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a33a82-66f7-453a-b9be-7b7f6a68fa45 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:43.869425 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 875/1777] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:15:43 2022] POST /identity/v3/users => generated 279 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:15:43.873760 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5473cac-aa45-4734-8081-0d796429e0ca admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:43.892823 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5473cac-aa45-4734-8081-0d796429e0ca admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:43.906717 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30076a-9143-4fd8-b433-41605f71ca86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:43.911198 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30076a-9143-4fd8-b433-41605f71ca86 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:43.911799 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30076a-9143-4fd8-b433-41605f71ca86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:43.912280 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30076a-9143-4fd8-b433-41605f71ca86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:43.913454 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c30076a-9143-4fd8-b433-41605f71ca86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:43.918790 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c30076a-9143-4fd8-b433-41605f71ca86 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:43.948540 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 903/1778] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:15:43.952949 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a33a82-66f7-453a-b9be-7b7f6a68fa45 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:43.967655 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a33a82-66f7-453a-b9be-7b7f6a68fa45 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:43.974370 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67961ad8-0b5b-4e65-a51a-a7a55e38ba95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:43.975107 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67961ad8-0b5b-4e65-a51a-a7a55e38ba95 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:43.975520 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67961ad8-0b5b-4e65-a51a-a7a55e38ba95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:43.977098 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67961ad8-0b5b-4e65-a51a-a7a55e38ba95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:43.977098 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67961ad8-0b5b-4e65-a51a-a7a55e38ba95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:43.978746 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67961ad8-0b5b-4e65-a51a-a7a55e38ba95 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:43.995782 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 876/1779] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:15:43.999992 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30076a-9143-4fd8-b433-41605f71ca86 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:44.012641 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30076a-9143-4fd8-b433-41605f71ca86 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:44.020086 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b73227-bd40-4b0c-b750-71b3f1027b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:44.021103 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b73227-bd40-4b0c-b750-71b3f1027b05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:44.021560 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b73227-bd40-4b0c-b750-71b3f1027b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:44.021972 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b73227-bd40-4b0c-b750-71b3f1027b05 admin admin] PATH_INFO: `/v3/projects/f1a17cf7210f44f5aba1e4a47de253eb/users/6f94d24300d04c93a14ec42834674dd2/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:44.041255 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b73227-bd40-4b0c-b750-71b3f1027b05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1a17cf7210f44f5aba1e4a47de253eb, user_id=6f94d24300d04c93a14ec42834674dd2, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:44.044251 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b73227-bd40-4b0c-b750-71b3f1027b05 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:44.076323 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 904/1780] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:15:43 2022] PUT /identity/v3/projects/f1a17cf7210f44f5aba1e4a47de253eb/users/6f94d24300d04c93a14ec42834674dd2/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:15:44.087882 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796693e4-463f-4edb-ab26-5f8ddcab7756 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:44.088429 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796693e4-463f-4edb-ab26-5f8ddcab7756 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:44.088804 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796693e4-463f-4edb-ab26-5f8ddcab7756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:44.144692 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-796693e4-463f-4edb-ab26-5f8ddcab7756 None None] MFA Rules not processed for user `6f94d24300d04c93a14ec42834674dd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:44.146421 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-796693e4-463f-4edb-ab26-5f8ddcab7756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:44.286685 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 877/1781] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:15:44 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:15:44.291201 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b73227-bd40-4b0c-b750-71b3f1027b05 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:44.441270 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b73227-bd40-4b0c-b750-71b3f1027b05 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:44.447375 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ae921-51fc-4ee4-8387-63e5c360f4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:44.448622 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ae921-51fc-4ee4-8387-63e5c360f4fa admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:44.449097 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ae921-51fc-4ee4-8387-63e5c360f4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:44.449563 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ae921-51fc-4ee4-8387-63e5c360f4fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:44.450447 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ae921-51fc-4ee4-8387-63e5c360f4fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:44.452845 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ae921-51fc-4ee4-8387-63e5c360f4fa admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:44.497677 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 905/1782] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:15:44 2022] POST /identity/v3/projects => generated 357 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:15:44.500892 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796693e4-463f-4edb-ab26-5f8ddcab7756 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:44.515035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796693e4-463f-4edb-ab26-5f8ddcab7756 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:44.520688 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:44.620986 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de0541-d3e2-46f0-9f16-308b7c47cd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:44.621968 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de0541-d3e2-46f0-9f16-308b7c47cd2c admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:44.622362 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de0541-d3e2-46f0-9f16-308b7c47cd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:44.622913 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de0541-d3e2-46f0-9f16-308b7c47cd2c admin admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:44.624393 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de0541-d3e2-46f0-9f16-308b7c47cd2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:44.628105 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de0541-d3e2-46f0-9f16-308b7c47cd2c admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:44.678315 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 878/1783] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:15:44 2022] POST /identity/v3/users => generated 285 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:15:44.678655 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ae921-51fc-4ee4-8387-63e5c360f4fa admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:44.694837 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ae921-51fc-4ee4-8387-63e5c360f4fa admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:44.704847 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7805a2-125b-49d5-87ce-f4df36eb1396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:44.705636 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7805a2-125b-49d5-87ce-f4df36eb1396 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:44.706670 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7805a2-125b-49d5-87ce-f4df36eb1396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:44.707263 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7805a2-125b-49d5-87ce-f4df36eb1396 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:44.707979 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7805a2-125b-49d5-87ce-f4df36eb1396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:44.711178 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7805a2-125b-49d5-87ce-f4df36eb1396 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:44.731998 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 906/1784] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:15:44.735439 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de0541-d3e2-46f0-9f16-308b7c47cd2c admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:44.752840 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de0541-d3e2-46f0-9f16-308b7c47cd2c admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:44.758792 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d97278-6793-4a7a-b20e-1465ca76ba85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:44.759676 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d97278-6793-4a7a-b20e-1465ca76ba85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:44.760127 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d97278-6793-4a7a-b20e-1465ca76ba85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:44.760504 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d97278-6793-4a7a-b20e-1465ca76ba85 admin admin] PATH_INFO: `/v3/projects/818082492dcb49c1a3a1bc81b1b6afa9/users/b6e8f45d08f6489f87c563cbae27cf3d/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:44.802276 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d97278-6793-4a7a-b20e-1465ca76ba85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=818082492dcb49c1a3a1bc81b1b6afa9, user_id=b6e8f45d08f6489f87c563cbae27cf3d, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:44.807592 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d97278-6793-4a7a-b20e-1465ca76ba85 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:44.849019 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 879/1785] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:15:44 2022] PUT /identity/v3/projects/818082492dcb49c1a3a1bc81b1b6afa9/users/b6e8f45d08f6489f87c563cbae27cf3d/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:15:44.853427 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7805a2-125b-49d5-87ce-f4df36eb1396 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:44.871783 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7805a2-125b-49d5-87ce-f4df36eb1396 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:44.948971 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:44.963823 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c72e53-6b3f-4895-8037-d4f08646627a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:44.964904 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c72e53-6b3f-4895-8037-d4f08646627a admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:44.965390 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c72e53-6b3f-4895-8037-d4f08646627a admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:44.965975 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c72e53-6b3f-4895-8037-d4f08646627a admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:44.967088 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c72e53-6b3f-4895-8037-d4f08646627a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:44.969648 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c72e53-6b3f-4895-8037-d4f08646627a admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:44.987589 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 907/1786] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:15:44.993650 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d97278-6793-4a7a-b20e-1465ca76ba85 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:45.028054 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d97278-6793-4a7a-b20e-1465ca76ba85 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:45.042742 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf43c4-48e0-4cab-b840-2dccaa328f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:45.043552 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf43c4-48e0-4cab-b840-2dccaa328f5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:45.044384 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf43c4-48e0-4cab-b840-2dccaa328f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:45.044853 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf43c4-48e0-4cab-b840-2dccaa328f5a admin admin] PATH_INFO: `/v3/projects/818082492dcb49c1a3a1bc81b1b6afa9/users/b6e8f45d08f6489f87c563cbae27cf3d/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:45.052636 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf43c4-48e0-4cab-b840-2dccaa328f5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=818082492dcb49c1a3a1bc81b1b6afa9, user_id=b6e8f45d08f6489f87c563cbae27cf3d, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:45.057467 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf43c4-48e0-4cab-b840-2dccaa328f5a admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:45.092231 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 880/1787] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:15:44 2022] PUT /identity/v3/projects/818082492dcb49c1a3a1bc81b1b6afa9/users/b6e8f45d08f6489f87c563cbae27cf3d/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:15:45.094803 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409f243-afa1-442e-bdbb-6da34a83dc96 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:45.095275 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409f243-afa1-442e-bdbb-6da34a83dc96 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:45.095605 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409f243-afa1-442e-bdbb-6da34a83dc96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:45.138875 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-3409f243-afa1-442e-bdbb-6da34a83dc96 None None] MFA Rules not processed for user `b6e8f45d08f6489f87c563cbae27cf3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:45.140385 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-3409f243-afa1-442e-bdbb-6da34a83dc96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:45.239935 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 908/1788] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:15:45 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:15:45.245876 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf43c4-48e0-4cab-b840-2dccaa328f5a admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:45.274792 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf43c4-48e0-4cab-b840-2dccaa328f5a admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:45.285020 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3409f243-afa1-442e-bdbb-6da34a83dc96 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:45.287069 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-3409f243-afa1-442e-bdbb-6da34a83dc96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:45.291791 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436c5aa-ac3c-4e44-a670-0da5d9476134 tempest-QuotasTest-1891295424 tempest-QuotasTest-1891295424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6e8f45d08f6489f87c563cbae27cf3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818082492dcb49c1a3a1bc81b1b6afa9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:45.293010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436c5aa-ac3c-4e44-a670-0da5d9476134 tempest-QuotasTest-1891295424 tempest-QuotasTest-1891295424-project-admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:45.293628 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436c5aa-ac3c-4e44-a670-0da5d9476134 tempest-QuotasTest-1891295424 tempest-QuotasTest-1891295424-project-admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:45.294095 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436c5aa-ac3c-4e44-a670-0da5d9476134 tempest-QuotasTest-1891295424 tempest-QuotasTest-1891295424-project-admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:45.297285 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7436c5aa-ac3c-4e44-a670-0da5d9476134 tempest-QuotasTest-1891295424 tempest-QuotasTest-1891295424-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:15:45.298154 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7436c5aa-ac3c-4e44-a670-0da5d9476134 tempest-QuotasTest-1891295424 tempest-QuotasTest-1891295424-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:45.301375 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7436c5aa-ac3c-4e44-a670-0da5d9476134 tempest-QuotasTest-1891295424 tempest-QuotasTest-1891295424-project-admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:45.323147 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 881/1789] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:15:45.327161 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436c5aa-ac3c-4e44-a670-0da5d9476134 tempest-QuotasTest-1891295424 tempest-QuotasTest-1891295424-project-admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:45.361826 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436c5aa-ac3c-4e44-a670-0da5d9476134 tempest-QuotasTest-1891295424 tempest-QuotasTest-1891295424-project-admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:45.377861 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b868360-01ff-441f-8398-907e8f8d8c29 tempest-QuotasTest-1891295424 tempest-QuotasTest-1891295424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6e8f45d08f6489f87c563cbae27cf3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818082492dcb49c1a3a1bc81b1b6afa9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:45.378522 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b868360-01ff-441f-8398-907e8f8d8c29 tempest-QuotasTest-1891295424 tempest-QuotasTest-1891295424-project-admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:45.379024 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b868360-01ff-441f-8398-907e8f8d8c29 tempest-QuotasTest-1891295424 tempest-QuotasTest-1891295424-project-admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:45.379129 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b868360-01ff-441f-8398-907e8f8d8c29 tempest-QuotasTest-1891295424 tempest-QuotasTest-1891295424-project-admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:45.386813 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b868360-01ff-441f-8398-907e8f8d8c29 tempest-QuotasTest-1891295424 tempest-QuotasTest-1891295424-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:45.389055 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b868360-01ff-441f-8398-907e8f8d8c29 tempest-QuotasTest-1891295424 tempest-QuotasTest-1891295424-project-admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:45.468619 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 882/1790] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:15:45 2022] POST /identity/v3/projects => generated 349 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:15:45.469409 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3409f243-afa1-442e-bdbb-6da34a83dc96 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:45.471661 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b868360-01ff-441f-8398-907e8f8d8c29 tempest-QuotasTest-1891295424 tempest-QuotasTest-1891295424-project-admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:45.606687 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b868360-01ff-441f-8398-907e8f8d8c29 tempest-QuotasTest-1891295424 tempest-QuotasTest-1891295424-project-admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:45.613036 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e24786-1177-4cd5-bcaf-2f57d60ea20b tempest-QuotasTest-1891295424 tempest-QuotasTest-1891295424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6e8f45d08f6489f87c563cbae27cf3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818082492dcb49c1a3a1bc81b1b6afa9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:45.613677 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e24786-1177-4cd5-bcaf-2f57d60ea20b tempest-QuotasTest-1891295424 tempest-QuotasTest-1891295424-project-admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:45.614051 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e24786-1177-4cd5-bcaf-2f57d60ea20b tempest-QuotasTest-1891295424 tempest-QuotasTest-1891295424-project-admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:45.614335 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e24786-1177-4cd5-bcaf-2f57d60ea20b tempest-QuotasTest-1891295424 tempest-QuotasTest-1891295424-project-admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:45.615053 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e24786-1177-4cd5-bcaf-2f57d60ea20b tempest-QuotasTest-1891295424 tempest-QuotasTest-1891295424-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:15:45.615360 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e24786-1177-4cd5-bcaf-2f57d60ea20b tempest-QuotasTest-1891295424 tempest-QuotasTest-1891295424-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:45.616946 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0986f-52cf-4e29-9dcd-982ee7b3eb0a tempest-RoutersAdminTest-369225791 tempest-RoutersAdminTest-369225791-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e1d527ed1704bfda69ffba8cc31764b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb4da6a8dea84fa3ad4a0cf637615781', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:45.617184 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e24786-1177-4cd5-bcaf-2f57d60ea20b tempest-QuotasTest-1891295424 tempest-QuotasTest-1891295424-project-admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:45.617780 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0986f-52cf-4e29-9dcd-982ee7b3eb0a tempest-RoutersAdminTest-369225791 tempest-RoutersAdminTest-369225791-project-admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:45.618164 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0986f-52cf-4e29-9dcd-982ee7b3eb0a tempest-RoutersAdminTest-369225791 tempest-RoutersAdminTest-369225791-project-admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:45.618535 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0986f-52cf-4e29-9dcd-982ee7b3eb0a tempest-RoutersAdminTest-369225791 tempest-RoutersAdminTest-369225791-project-admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:45.619343 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea0986f-52cf-4e29-9dcd-982ee7b3eb0a tempest-RoutersAdminTest-369225791 tempest-RoutersAdminTest-369225791-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:15:45.619777 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea0986f-52cf-4e29-9dcd-982ee7b3eb0a tempest-RoutersAdminTest-369225791 tempest-RoutersAdminTest-369225791-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:45.621493 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea0986f-52cf-4e29-9dcd-982ee7b3eb0a tempest-RoutersAdminTest-369225791 tempest-RoutersAdminTest-369225791-project-admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:45.631732 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 883/1791] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:15:45.641779 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e24786-1177-4cd5-bcaf-2f57d60ea20b tempest-QuotasTest-1891295424 tempest-QuotasTest-1891295424-project-admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:45.644271 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-26e24786-1177-4cd5-bcaf-2f57d60ea20b tempest-QuotasTest-1891295424 tempest-QuotasTest-1891295424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:45.656981 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 909/1792] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:15:45.660584 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0986f-52cf-4e29-9dcd-982ee7b3eb0a tempest-RoutersAdminTest-369225791 tempest-RoutersAdminTest-369225791-project-admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:45.678268 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0986f-52cf-4e29-9dcd-982ee7b3eb0a tempest-RoutersAdminTest-369225791 tempest-RoutersAdminTest-369225791-project-admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:45.679262 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:45.692584 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d099f3a-8ede-4465-971b-afe3bcf53615 tempest-RoutersAdminTest-369225791 tempest-RoutersAdminTest-369225791-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e1d527ed1704bfda69ffba8cc31764b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb4da6a8dea84fa3ad4a0cf637615781', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:45.693408 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d099f3a-8ede-4465-971b-afe3bcf53615 tempest-RoutersAdminTest-369225791 tempest-RoutersAdminTest-369225791-project-admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:45.693766 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d099f3a-8ede-4465-971b-afe3bcf53615 tempest-RoutersAdminTest-369225791 tempest-RoutersAdminTest-369225791-project-admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:45.694133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d099f3a-8ede-4465-971b-afe3bcf53615 tempest-RoutersAdminTest-369225791 tempest-RoutersAdminTest-369225791-project-admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:45.694929 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d099f3a-8ede-4465-971b-afe3bcf53615 tempest-RoutersAdminTest-369225791 tempest-RoutersAdminTest-369225791-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:45.697637 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d099f3a-8ede-4465-971b-afe3bcf53615 tempest-RoutersAdminTest-369225791 tempest-RoutersAdminTest-369225791-project-admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:45.726935 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e24786-1177-4cd5-bcaf-2f57d60ea20b tempest-QuotasTest-1891295424 tempest-QuotasTest-1891295424-project-admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:45.733255 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:45.746544 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f25fa-6a47-481f-bec1-3186432962b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:45.747147 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f25fa-6a47-481f-bec1-3186432962b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:45.747425 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f25fa-6a47-481f-bec1-3186432962b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:45.748082 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f25fa-6a47-481f-bec1-3186432962b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:45.758737 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 910/1793] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:15:45 2022] POST /identity/v3/projects => generated 349 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:15:45.763419 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d099f3a-8ede-4465-971b-afe3bcf53615 tempest-RoutersAdminTest-369225791 tempest-RoutersAdminTest-369225791-project-admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:45.774164 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061f25fa-6a47-481f-bec1-3186432962b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:45.775804 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061f25fa-6a47-481f-bec1-3186432962b9 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:45.788601 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 884/1794] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:15:45 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:15:45.864808 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d099f3a-8ede-4465-971b-afe3bcf53615 tempest-RoutersAdminTest-369225791 tempest-RoutersAdminTest-369225791-project-admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:45.874914 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7fb6e9-6268-4591-a979-7098d9161bbc tempest-RoutersAdminTest-369225791 tempest-RoutersAdminTest-369225791-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e1d527ed1704bfda69ffba8cc31764b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb4da6a8dea84fa3ad4a0cf637615781', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:45.876445 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7fb6e9-6268-4591-a979-7098d9161bbc tempest-RoutersAdminTest-369225791 tempest-RoutersAdminTest-369225791-project-admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:45.876906 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7fb6e9-6268-4591-a979-7098d9161bbc tempest-RoutersAdminTest-369225791 tempest-RoutersAdminTest-369225791-project-admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:45.877385 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7fb6e9-6268-4591-a979-7098d9161bbc tempest-RoutersAdminTest-369225791 tempest-RoutersAdminTest-369225791-project-admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:45.878973 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7fb6e9-6268-4591-a979-7098d9161bbc tempest-RoutersAdminTest-369225791 tempest-RoutersAdminTest-369225791-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:15:45.879450 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7fb6e9-6268-4591-a979-7098d9161bbc tempest-RoutersAdminTest-369225791 tempest-RoutersAdminTest-369225791-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:45.881454 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7fb6e9-6268-4591-a979-7098d9161bbc tempest-RoutersAdminTest-369225791 tempest-RoutersAdminTest-369225791-project-admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:45.926023 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 911/1795] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:15:45.998473 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f25fa-6a47-481f-bec1-3186432962b9 service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:46.018083 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f25fa-6a47-481f-bec1-3186432962b9 service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:46.135625 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c210a-6979-410f-b4ec-3ccbbd70fb8f tempest-QuotasTest-1891295424 tempest-QuotasTest-1891295424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6e8f45d08f6489f87c563cbae27cf3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818082492dcb49c1a3a1bc81b1b6afa9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:46.136320 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c210a-6979-410f-b4ec-3ccbbd70fb8f tempest-QuotasTest-1891295424 tempest-QuotasTest-1891295424-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:46.136717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c210a-6979-410f-b4ec-3ccbbd70fb8f tempest-QuotasTest-1891295424 tempest-QuotasTest-1891295424-project-admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:46.137000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c210a-6979-410f-b4ec-3ccbbd70fb8f tempest-QuotasTest-1891295424 tempest-QuotasTest-1891295424-project-admin] PATH_INFO: `/v3/projects/84d33cbb4d1340f4abfaa8918f7aeb7f` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:46.139507 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396c210a-6979-410f-b4ec-3ccbbd70fb8f tempest-QuotasTest-1891295424 tempest-QuotasTest-1891295424-project-admin] RBAC: Authorizing `identity:delete_project(project_id=84d33cbb4d1340f4abfaa8918f7aeb7f)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:46.144849 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396c210a-6979-410f-b4ec-3ccbbd70fb8f tempest-QuotasTest-1891295424 tempest-QuotasTest-1891295424-project-admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:46.211698 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-396c210a-6979-410f-b4ec-3ccbbd70fb8f tempest-QuotasTest-1891295424 tempest-QuotasTest-1891295424-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84d33cbb4d1340f4abfaa8918f7aeb7f', 'request_id': 'req-396c210a-6979-410f-b4ec-3ccbbd70fb8f'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:46.218049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-396c210a-6979-410f-b4ec-3ccbbd70fb8f tempest-QuotasTest-1891295424 tempest-QuotasTest-1891295424-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84d33cbb4d1340f4abfaa8918f7aeb7f', 'request_id': 'req-396c210a-6979-410f-b4ec-3ccbbd70fb8f'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:46.225012 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-396c210a-6979-410f-b4ec-3ccbbd70fb8f tempest-QuotasTest-1891295424 tempest-QuotasTest-1891295424-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84d33cbb4d1340f4abfaa8918f7aeb7f', 'request_id': 'req-396c210a-6979-410f-b4ec-3ccbbd70fb8f'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:46.242951 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-396c210a-6979-410f-b4ec-3ccbbd70fb8f tempest-QuotasTest-1891295424 tempest-QuotasTest-1891295424-project-admin] The token cache is being invalidate because project 84d33cbb4d1340f4abfaa8918f7aeb7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:15:46.243252 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-396c210a-6979-410f-b4ec-3ccbbd70fb8f tempest-QuotasTest-1891295424 tempest-QuotasTest-1891295424-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:46.243960 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-396c210a-6979-410f-b4ec-3ccbbd70fb8f tempest-QuotasTest-1891295424 tempest-QuotasTest-1891295424-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:46.246176 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 885/1796] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:15:45 2022] DELETE /identity/v3/projects/84d33cbb4d1340f4abfaa8918f7aeb7f => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:15:46.575247 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7fb6e9-6268-4591-a979-7098d9161bbc tempest-RoutersAdminTest-369225791 tempest-RoutersAdminTest-369225791-project-admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:46.577541 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-4f7fb6e9-6268-4591-a979-7098d9161bbc tempest-RoutersAdminTest-369225791 tempest-RoutersAdminTest-369225791-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:46.593370 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7fb6e9-6268-4591-a979-7098d9161bbc tempest-RoutersAdminTest-369225791 tempest-RoutersAdminTest-369225791-project-admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:46.674354 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72abbb30-0003-40b1-ac4b-deb3462f776f tempest-RoutersAdminTest-369225791 tempest-RoutersAdminTest-369225791-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e1d527ed1704bfda69ffba8cc31764b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb4da6a8dea84fa3ad4a0cf637615781', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:46.675533 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72abbb30-0003-40b1-ac4b-deb3462f776f tempest-RoutersAdminTest-369225791 tempest-RoutersAdminTest-369225791-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:46.675533 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72abbb30-0003-40b1-ac4b-deb3462f776f tempest-RoutersAdminTest-369225791 tempest-RoutersAdminTest-369225791-project-admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:46.676052 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72abbb30-0003-40b1-ac4b-deb3462f776f tempest-RoutersAdminTest-369225791 tempest-RoutersAdminTest-369225791-project-admin] PATH_INFO: `/v3/projects/9d3b7a9945794818bcd8d3434be3c97d` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:46.677525 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72abbb30-0003-40b1-ac4b-deb3462f776f tempest-RoutersAdminTest-369225791 tempest-RoutersAdminTest-369225791-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9d3b7a9945794818bcd8d3434be3c97d)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:46.679854 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72abbb30-0003-40b1-ac4b-deb3462f776f tempest-RoutersAdminTest-369225791 tempest-RoutersAdminTest-369225791-project-admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:46.711414 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c210a-6979-410f-b4ec-3ccbbd70fb8f tempest-QuotasTest-1891295424 tempest-QuotasTest-1891295424-project-admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:46.714009 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-396c210a-6979-410f-b4ec-3ccbbd70fb8f tempest-QuotasTest-1891295424 tempest-QuotasTest-1891295424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:46.764820 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-72abbb30-0003-40b1-ac4b-deb3462f776f tempest-RoutersAdminTest-369225791 tempest-RoutersAdminTest-369225791-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d3b7a9945794818bcd8d3434be3c97d', 'request_id': 'req-72abbb30-0003-40b1-ac4b-deb3462f776f'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:46.773055 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-72abbb30-0003-40b1-ac4b-deb3462f776f tempest-RoutersAdminTest-369225791 tempest-RoutersAdminTest-369225791-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d3b7a9945794818bcd8d3434be3c97d', 'request_id': 'req-72abbb30-0003-40b1-ac4b-deb3462f776f'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:46.781232 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:46.781395 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-72abbb30-0003-40b1-ac4b-deb3462f776f tempest-RoutersAdminTest-369225791 tempest-RoutersAdminTest-369225791-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d3b7a9945794818bcd8d3434be3c97d', 'request_id': 'req-72abbb30-0003-40b1-ac4b-deb3462f776f'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:46.798592 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-72abbb30-0003-40b1-ac4b-deb3462f776f tempest-RoutersAdminTest-369225791 tempest-RoutersAdminTest-369225791-project-admin] The token cache is being invalidate because project 9d3b7a9945794818bcd8d3434be3c97d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:15:46.798809 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c210a-6979-410f-b4ec-3ccbbd70fb8f tempest-QuotasTest-1891295424 tempest-QuotasTest-1891295424-project-admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:46.799248 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-72abbb30-0003-40b1-ac4b-deb3462f776f tempest-RoutersAdminTest-369225791 tempest-RoutersAdminTest-369225791-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:46.800371 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-72abbb30-0003-40b1-ac4b-deb3462f776f tempest-RoutersAdminTest-369225791 tempest-RoutersAdminTest-369225791-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:46.802980 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 912/1797] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:15:46 2022] DELETE /identity/v3/projects/9d3b7a9945794818bcd8d3434be3c97d => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:15:46.812027 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72abbb30-0003-40b1-ac4b-deb3462f776f tempest-RoutersAdminTest-369225791 tempest-RoutersAdminTest-369225791-project-admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:46.813723 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-72abbb30-0003-40b1-ac4b-deb3462f776f tempest-RoutersAdminTest-369225791 tempest-RoutersAdminTest-369225791-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:46.839362 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:46.882562 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49067761-9c6b-4e92-a1df-57fdd0fd1e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:46.883732 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49067761-9c6b-4e92-a1df-57fdd0fd1e35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:46.884036 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49067761-9c6b-4e92-a1df-57fdd0fd1e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:46.884310 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49067761-9c6b-4e92-a1df-57fdd0fd1e35 admin admin] PATH_INFO: `/v3/users/6f94d24300d04c93a14ec42834674dd2` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:46.885594 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49067761-9c6b-4e92-a1df-57fdd0fd1e35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f94d24300d04c93a14ec42834674dd2)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:46.888097 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49067761-9c6b-4e92-a1df-57fdd0fd1e35 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:46.900956 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72abbb30-0003-40b1-ac4b-deb3462f776f tempest-RoutersAdminTest-369225791 tempest-RoutersAdminTest-369225791-project-admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:46.910166 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd71c9e2-144b-42c0-b098-9922f48c3acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:46.910837 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71c9e2-144b-42c0-b098-9922f48c3acc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:46.911110 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71c9e2-144b-42c0-b098-9922f48c3acc admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:46.911383 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71c9e2-144b-42c0-b098-9922f48c3acc admin admin] PATH_INFO: `/v3/users/125c245d3938444baea77d7908ab0034` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:46.916647 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd71c9e2-144b-42c0-b098-9922f48c3acc admin admin] RBAC: Authorizing `identity:delete_user(user_id=125c245d3938444baea77d7908ab0034)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:46.919380 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd71c9e2-144b-42c0-b098-9922f48c3acc admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:46.966401 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-49067761-9c6b-4e92-a1df-57fdd0fd1e35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f94d24300d04c93a14ec42834674dd2'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:46.967353 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-49067761-9c6b-4e92-a1df-57fdd0fd1e35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f94d24300d04c93a14ec42834674dd2'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:46.989411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-49067761-9c6b-4e92-a1df-57fdd0fd1e35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f94d24300d04c93a14ec42834674dd2'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:46.992289 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-bd71c9e2-144b-42c0-b098-9922f48c3acc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '125c245d3938444baea77d7908ab0034'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:47.002736 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-49067761-9c6b-4e92-a1df-57fdd0fd1e35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f94d24300d04c93a14ec42834674dd2'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:47.003425 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-bd71c9e2-144b-42c0-b098-9922f48c3acc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '125c245d3938444baea77d7908ab0034'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:47.003864 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-49067761-9c6b-4e92-a1df-57fdd0fd1e35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f94d24300d04c93a14ec42834674dd2'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:47.004449 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-bd71c9e2-144b-42c0-b098-9922f48c3acc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '125c245d3938444baea77d7908ab0034'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:47.019449 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 886/1798] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:15:46 2022] DELETE /identity/v3/users/6f94d24300d04c93a14ec42834674dd2 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:15:47.021167 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-bd71c9e2-144b-42c0-b098-9922f48c3acc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '125c245d3938444baea77d7908ab0034'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:47.022131 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-bd71c9e2-144b-42c0-b098-9922f48c3acc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '125c245d3938444baea77d7908ab0034'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:47.023686 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49067761-9c6b-4e92-a1df-57fdd0fd1e35 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:47.025259 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-49067761-9c6b-4e92-a1df-57fdd0fd1e35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:47.038470 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 913/1799] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:15:46 2022] DELETE /identity/v3/users/125c245d3938444baea77d7908ab0034 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:15:47.041206 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41326fd1-374c-4937-b7eb-cbdecb08a217 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:47.042081 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41326fd1-374c-4937-b7eb-cbdecb08a217 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:47.042566 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41326fd1-374c-4937-b7eb-cbdecb08a217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:47.066380 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-41326fd1-374c-4937-b7eb-cbdecb08a217 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:47.067746 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-41326fd1-374c-4937-b7eb-cbdecb08a217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:47.089296 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49067761-9c6b-4e92-a1df-57fdd0fd1e35 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:47.137670 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:47.163113 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8970fe-0dbf-4faa-a2da-02a8194f5112 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:47.164126 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8970fe-0dbf-4faa-a2da-02a8194f5112 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:47.164474 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8970fe-0dbf-4faa-a2da-02a8194f5112 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:47.164803 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8970fe-0dbf-4faa-a2da-02a8194f5112 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:47.166898 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-4b8970fe-0dbf-4faa-a2da-02a8194f5112 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:47.179971 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 914/1800] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:15:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:15:47.182715 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a07e8-9b62-49b3-9ae9-3e99d49e7b82 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:47.183202 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a07e8-9b62-49b3-9ae9-3e99d49e7b82 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:47.183877 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a07e8-9b62-49b3-9ae9-3e99d49e7b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:47.220760 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-fd6a07e8-9b62-49b3-9ae9-3e99d49e7b82 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:47.222072 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-fd6a07e8-9b62-49b3-9ae9-3e99d49e7b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:47.237219 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 915/1801] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:15:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:15:47.237219 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a07e8-9b62-49b3-9ae9-3e99d49e7b82 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:47.237219 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-fd6a07e8-9b62-49b3-9ae9-3e99d49e7b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:47.258346 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a07e8-9b62-49b3-9ae9-3e99d49e7b82 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:47.263618 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e200dc8-daaf-40ee-a4f4-a9ca1555af86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:47.264260 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e200dc8-daaf-40ee-a4f4-a9ca1555af86 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:47.265047 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e200dc8-daaf-40ee-a4f4-a9ca1555af86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:47.265047 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e200dc8-daaf-40ee-a4f4-a9ca1555af86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:47.276286 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e200dc8-daaf-40ee-a4f4-a9ca1555af86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:47.277698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e200dc8-daaf-40ee-a4f4-a9ca1555af86 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:47.279094 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8970fe-0dbf-4faa-a2da-02a8194f5112 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:47.281018 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8970fe-0dbf-4faa-a2da-02a8194f5112 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:47.290038 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 916/1802] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:15:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:15:47.290997 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e200dc8-daaf-40ee-a4f4-a9ca1555af86 service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:47.301040 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e200dc8-daaf-40ee-a4f4-a9ca1555af86 service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:47.306897 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6767d3c-ce53-45e9-912a-d2c125a4bb4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:47.307781 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6767d3c-ce53-45e9-912a-d2c125a4bb4d service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:47.308493 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6767d3c-ce53-45e9-912a-d2c125a4bb4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:47.308979 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6767d3c-ce53-45e9-912a-d2c125a4bb4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:47.309652 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 887/1803] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:15:47 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:15:47.320822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6767d3c-ce53-45e9-912a-d2c125a4bb4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:47.322680 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6767d3c-ce53-45e9-912a-d2c125a4bb4d service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:47.334369 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 917/1804] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:15:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:15:48.831835 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8970fe-0dbf-4faa-a2da-02a8194f5112 service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:48.833878 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-4b8970fe-0dbf-4faa-a2da-02a8194f5112 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:48.851933 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8970fe-0dbf-4faa-a2da-02a8194f5112 service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:48.857815 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9989d7-e96f-4c58-86a2-8b65e7ad142b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:48.858790 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9989d7-e96f-4c58-86a2-8b65e7ad142b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:48.859242 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9989d7-e96f-4c58-86a2-8b65e7ad142b admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:48.859737 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9989d7-e96f-4c58-86a2-8b65e7ad142b admin admin] PATH_INFO: `/v3/projects/f1a17cf7210f44f5aba1e4a47de253eb` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:48.861214 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9989d7-e96f-4c58-86a2-8b65e7ad142b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1a17cf7210f44f5aba1e4a47de253eb)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:48.863885 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9989d7-e96f-4c58-86a2-8b65e7ad142b admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:48.945360 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6767d3c-ce53-45e9-912a-d2c125a4bb4d service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:48.947913 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-a6767d3c-ce53-45e9-912a-d2c125a4bb4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:48.977128 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6767d3c-ce53-45e9-912a-d2c125a4bb4d service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:48.988071 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:48.989197 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-6c9989d7-e96f-4c58-86a2-8b65e7ad142b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1a17cf7210f44f5aba1e4a47de253eb', 'request_id': 'req-6c9989d7-e96f-4c58-86a2-8b65e7ad142b'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:49.006917 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-6c9989d7-e96f-4c58-86a2-8b65e7ad142b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1a17cf7210f44f5aba1e4a47de253eb', 'request_id': 'req-6c9989d7-e96f-4c58-86a2-8b65e7ad142b'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:49.020576 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-6c9989d7-e96f-4c58-86a2-8b65e7ad142b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1a17cf7210f44f5aba1e4a47de253eb', 'request_id': 'req-6c9989d7-e96f-4c58-86a2-8b65e7ad142b'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:49.043052 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-6c9989d7-e96f-4c58-86a2-8b65e7ad142b admin admin] The token cache is being invalidate because project f1a17cf7210f44f5aba1e4a47de253eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:15:49.043345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-6c9989d7-e96f-4c58-86a2-8b65e7ad142b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:49.044926 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-6c9989d7-e96f-4c58-86a2-8b65e7ad142b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:49.048138 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 888/1805] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:15:48 2022] DELETE /identity/v3/projects/f1a17cf7210f44f5aba1e4a47de253eb => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:15:49.052240 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9989d7-e96f-4c58-86a2-8b65e7ad142b admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:49.053926 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-6c9989d7-e96f-4c58-86a2-8b65e7ad142b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:49.147746 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d24693-e20a-42a1-8fe8-8c00a2178540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:49.148385 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d24693-e20a-42a1-8fe8-8c00a2178540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:49.148667 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d24693-e20a-42a1-8fe8-8c00a2178540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:49.149036 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d24693-e20a-42a1-8fe8-8c00a2178540 admin admin] PATH_INFO: `/v3/projects/322edb2c340048d3b05599eca021a5ed` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:49.154923 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d24693-e20a-42a1-8fe8-8c00a2178540 admin admin] RBAC: Authorizing `identity:delete_project(project_id=322edb2c340048d3b05599eca021a5ed)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:49.159907 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d24693-e20a-42a1-8fe8-8c00a2178540 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:49.219555 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9989d7-e96f-4c58-86a2-8b65e7ad142b admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:49.226725 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1fd01-6f61-49dc-b02d-66b02dc6b059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:49.227726 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1fd01-6f61-49dc-b02d-66b02dc6b059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:49.228174 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1fd01-6f61-49dc-b02d-66b02dc6b059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:49.228605 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1fd01-6f61-49dc-b02d-66b02dc6b059 admin admin] PATH_INFO: `/v3/users/b6e8f45d08f6489f87c563cbae27cf3d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:49.230060 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1fd01-6f61-49dc-b02d-66b02dc6b059 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6e8f45d08f6489f87c563cbae27cf3d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:49.232392 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1fd01-6f61-49dc-b02d-66b02dc6b059 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:49.253147 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:49.266517 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-66d24693-e20a-42a1-8fe8-8c00a2178540 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '322edb2c340048d3b05599eca021a5ed', 'request_id': 'req-66d24693-e20a-42a1-8fe8-8c00a2178540'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:49.278925 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-66d24693-e20a-42a1-8fe8-8c00a2178540 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '322edb2c340048d3b05599eca021a5ed', 'request_id': 'req-66d24693-e20a-42a1-8fe8-8c00a2178540'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:49.286764 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-66d24693-e20a-42a1-8fe8-8c00a2178540 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '322edb2c340048d3b05599eca021a5ed', 'request_id': 'req-66d24693-e20a-42a1-8fe8-8c00a2178540'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:49.304929 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-66d24693-e20a-42a1-8fe8-8c00a2178540 admin admin] The token cache is being invalidate because project 322edb2c340048d3b05599eca021a5ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:15:49.305406 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-66d24693-e20a-42a1-8fe8-8c00a2178540 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:49.306323 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-66d24693-e20a-42a1-8fe8-8c00a2178540 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:49.310921 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 918/1806] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:15:48 2022] DELETE /identity/v3/projects/322edb2c340048d3b05599eca021a5ed => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:15:49.313193 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d24693-e20a-42a1-8fe8-8c00a2178540 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:49.316608 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-66d24693-e20a-42a1-8fe8-8c00a2178540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:49.329983 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-b7f1fd01-6f61-49dc-b02d-66b02dc6b059 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6e8f45d08f6489f87c563cbae27cf3d'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:49.330673 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-b7f1fd01-6f61-49dc-b02d-66b02dc6b059 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6e8f45d08f6489f87c563cbae27cf3d'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:49.345400 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-b7f1fd01-6f61-49dc-b02d-66b02dc6b059 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6e8f45d08f6489f87c563cbae27cf3d'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:49.359430 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-b7f1fd01-6f61-49dc-b02d-66b02dc6b059 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6e8f45d08f6489f87c563cbae27cf3d'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:49.360978 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-b7f1fd01-6f61-49dc-b02d-66b02dc6b059 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6e8f45d08f6489f87c563cbae27cf3d'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:49.397813 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 889/1807] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:15:49 2022] DELETE /identity/v3/users/b6e8f45d08f6489f87c563cbae27cf3d => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:15:49.469241 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d24693-e20a-42a1-8fe8-8c00a2178540 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:49.535666 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:49.555562 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc3237-ebdf-48c9-bdd3-4523b0fd1d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:49.556290 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc3237-ebdf-48c9-bdd3-4523b0fd1d21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:49.556582 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc3237-ebdf-48c9-bdd3-4523b0fd1d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:49.556895 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc3237-ebdf-48c9-bdd3-4523b0fd1d21 admin admin] PATH_INFO: `/v3/users/a71065c7423e48e08758a4a977cd95d7` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:49.558920 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cc3237-ebdf-48c9-bdd3-4523b0fd1d21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a71065c7423e48e08758a4a977cd95d7)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:49.562642 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cc3237-ebdf-48c9-bdd3-4523b0fd1d21 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:49.634210 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-e9cc3237-ebdf-48c9-bdd3-4523b0fd1d21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a71065c7423e48e08758a4a977cd95d7'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:49.645254 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-e9cc3237-ebdf-48c9-bdd3-4523b0fd1d21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a71065c7423e48e08758a4a977cd95d7'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:49.646079 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-e9cc3237-ebdf-48c9-bdd3-4523b0fd1d21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a71065c7423e48e08758a4a977cd95d7'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:49.667874 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-e9cc3237-ebdf-48c9-bdd3-4523b0fd1d21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a71065c7423e48e08758a4a977cd95d7'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:49.668812 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-e9cc3237-ebdf-48c9-bdd3-4523b0fd1d21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a71065c7423e48e08758a4a977cd95d7'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:49.694147 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 919/1808] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:15:49 2022] DELETE /identity/v3/users/a71065c7423e48e08758a4a977cd95d7 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:15:51.523233 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1fd01-6f61-49dc-b02d-66b02dc6b059 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:51.524914 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-b7f1fd01-6f61-49dc-b02d-66b02dc6b059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:51.612881 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1fd01-6f61-49dc-b02d-66b02dc6b059 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:51.645636 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc3237-ebdf-48c9-bdd3-4523b0fd1d21 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:51.647193 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-e9cc3237-ebdf-48c9-bdd3-4523b0fd1d21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:51.713592 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf2354-2000-4158-bb70-5d541b338d10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:51.714610 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf2354-2000-4158-bb70-5d541b338d10 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:51.715571 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf2354-2000-4158-bb70-5d541b338d10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:51.715885 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf2354-2000-4158-bb70-5d541b338d10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:51.719520 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-eadf2354-2000-4158-bb70-5d541b338d10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:51.736525 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc3237-ebdf-48c9-bdd3-4523b0fd1d21 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:51.744364 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82261c7b-12e9-4236-8d5d-ab8fc26e491c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:51.747047 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82261c7b-12e9-4236-8d5d-ab8fc26e491c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:51.747665 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82261c7b-12e9-4236-8d5d-ab8fc26e491c admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:51.748154 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82261c7b-12e9-4236-8d5d-ab8fc26e491c admin admin] PATH_INFO: `/v3/projects/74fbf64153cf451f905e85f5a0ba2abf` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:51.749933 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82261c7b-12e9-4236-8d5d-ab8fc26e491c admin admin] RBAC: Authorizing `identity:delete_project(project_id=74fbf64153cf451f905e85f5a0ba2abf)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:51.753732 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82261c7b-12e9-4236-8d5d-ab8fc26e491c admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:51.843394 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadf2354-2000-4158-bb70-5d541b338d10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:51.845024 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadf2354-2000-4158-bb70-5d541b338d10 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:51.845804 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-82261c7b-12e9-4236-8d5d-ab8fc26e491c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74fbf64153cf451f905e85f5a0ba2abf', 'request_id': 'req-82261c7b-12e9-4236-8d5d-ab8fc26e491c'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:51.856574 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 890/1809] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:15:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:15:51.858371 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf2354-2000-4158-bb70-5d541b338d10 service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:51.859099 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-82261c7b-12e9-4236-8d5d-ab8fc26e491c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74fbf64153cf451f905e85f5a0ba2abf', 'request_id': 'req-82261c7b-12e9-4236-8d5d-ab8fc26e491c'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:51.859943 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-eadf2354-2000-4158-bb70-5d541b338d10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:51.868938 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-82261c7b-12e9-4236-8d5d-ab8fc26e491c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74fbf64153cf451f905e85f5a0ba2abf', 'request_id': 'req-82261c7b-12e9-4236-8d5d-ab8fc26e491c'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:51.870665 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:51.875678 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:51.882762 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf2354-2000-4158-bb70-5d541b338d10 service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:51.901010 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-82261c7b-12e9-4236-8d5d-ab8fc26e491c admin admin] The token cache is being invalidate because project 74fbf64153cf451f905e85f5a0ba2abf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:15:51.902539 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-82261c7b-12e9-4236-8d5d-ab8fc26e491c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:51.903506 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-82261c7b-12e9-4236-8d5d-ab8fc26e491c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:51.906967 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 920/1810] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:15:51 2022] DELETE /identity/v3/projects/74fbf64153cf451f905e85f5a0ba2abf => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:15:51.911930 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379775e-a719-41c6-a6ca-79ce0f7bfff8 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:51.912696 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379775e-a719-41c6-a6ca-79ce0f7bfff8 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:51.913297 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379775e-a719-41c6-a6ca-79ce0f7bfff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:51.966197 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-a379775e-a719-41c6-a6ca-79ce0f7bfff8 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:51.967952 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-a379775e-a719-41c6-a6ca-79ce0f7bfff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:51.970504 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3065b6-e367-4e11-8921-d80c065bdb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:51.971182 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3065b6-e367-4e11-8921-d80c065bdb67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:51.971469 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3065b6-e367-4e11-8921-d80c065bdb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:51.972342 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3065b6-e367-4e11-8921-d80c065bdb67 admin admin] PATH_INFO: `/v3/projects/818082492dcb49c1a3a1bc81b1b6afa9` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:51.973590 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3065b6-e367-4e11-8921-d80c065bdb67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=818082492dcb49c1a3a1bc81b1b6afa9)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:51.976260 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3065b6-e367-4e11-8921-d80c065bdb67 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:51.981147 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 921/1811] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:15:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:15:51.989720 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7db9ab-bd09-4b2d-926a-e7bcdf3b28d3 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:51.990334 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7db9ab-bd09-4b2d-926a-e7bcdf3b28d3 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:51.990618 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7db9ab-bd09-4b2d-926a-e7bcdf3b28d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:52.027202 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-8b7db9ab-bd09-4b2d-926a-e7bcdf3b28d3 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:52.028544 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-8b7db9ab-bd09-4b2d-926a-e7bcdf3b28d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:52.046680 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 922/1812] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:15:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:15:52.047501 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7db9ab-bd09-4b2d-926a-e7bcdf3b28d3 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:52.056949 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-ec3065b6-e367-4e11-8921-d80c065bdb67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '818082492dcb49c1a3a1bc81b1b6afa9', 'request_id': 'req-ec3065b6-e367-4e11-8921-d80c065bdb67'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:52.059735 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7db9ab-bd09-4b2d-926a-e7bcdf3b28d3 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:52.064566 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-ec3065b6-e367-4e11-8921-d80c065bdb67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '818082492dcb49c1a3a1bc81b1b6afa9', 'request_id': 'req-ec3065b6-e367-4e11-8921-d80c065bdb67'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:52.074958 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-ec3065b6-e367-4e11-8921-d80c065bdb67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '818082492dcb49c1a3a1bc81b1b6afa9', 'request_id': 'req-ec3065b6-e367-4e11-8921-d80c065bdb67'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:52.095677 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-ec3065b6-e367-4e11-8921-d80c065bdb67 admin admin] The token cache is being invalidate because project 818082492dcb49c1a3a1bc81b1b6afa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:15:52.096762 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-ec3065b6-e367-4e11-8921-d80c065bdb67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:52.097741 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-ec3065b6-e367-4e11-8921-d80c065bdb67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:15:52.100679 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 891/1813] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:15:51 2022] DELETE /identity/v3/projects/818082492dcb49c1a3a1bc81b1b6afa9 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:15:52.107325 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f1afb-4789-4157-9c3f-9445b2214a5c None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:52.107739 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f1afb-4789-4157-9c3f-9445b2214a5c None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:52.108106 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f1afb-4789-4157-9c3f-9445b2214a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:52.134018 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-bf2f1afb-4789-4157-9c3f-9445b2214a5c None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:52.135273 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-bf2f1afb-4789-4157-9c3f-9445b2214a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:52.150653 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ea4db-6739-40a7-afe0-245012f1648e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:52.151408 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ea4db-6739-40a7-afe0-245012f1648e admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:52.151730 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ea4db-6739-40a7-afe0-245012f1648e admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:52.152000 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ea4db-6739-40a7-afe0-245012f1648e admin admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:52.152820 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6ea4db-6739-40a7-afe0-245012f1648e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:15:52.153147 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6ea4db-6739-40a7-afe0-245012f1648e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:52.155419 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6ea4db-6739-40a7-afe0-245012f1648e admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:52.181778 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 923/1814] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:15:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:15:52.185094 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ea4db-6739-40a7-afe0-245012f1648e admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:52.187045 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-9b6ea4db-6739-40a7-afe0-245012f1648e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:52.205995 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ea4db-6739-40a7-afe0-245012f1648e admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:52.218919 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5961f5-435a-46c5-876a-6a94b434ebcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:52.220525 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5961f5-435a-46c5-876a-6a94b434ebcd admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:52.221144 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5961f5-435a-46c5-876a-6a94b434ebcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:52.221799 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5961f5-435a-46c5-876a-6a94b434ebcd admin admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:52.222943 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5961f5-435a-46c5-876a-6a94b434ebcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:52.225650 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5961f5-435a-46c5-876a-6a94b434ebcd admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:52.230618 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 892/1815] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:15:52.242523 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3db345-93ed-4df8-a75c-6237fe8c2573 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:52.243135 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3db345-93ed-4df8-a75c-6237fe8c2573 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:52.243571 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3db345-93ed-4df8-a75c-6237fe8c2573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:52.266060 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 924/1816] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:15:52 2022] POST /identity/v3/projects => generated 395 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:15:52.267086 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5961f5-435a-46c5-876a-6a94b434ebcd admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:52.279225 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-8e3db345-93ed-4df8-a75c-6237fe8c2573 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:52.281008 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-8e3db345-93ed-4df8-a75c-6237fe8c2573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:52.322473 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:52.348555 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5961f5-435a-46c5-876a-6a94b434ebcd admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:52.357444 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8e571-97f6-44d6-bc5b-98e8d06f22f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:52.357444 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8e571-97f6-44d6-bc5b-98e8d06f22f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:52.357444 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8e571-97f6-44d6-bc5b-98e8d06f22f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:52.357444 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8e571-97f6-44d6-bc5b-98e8d06f22f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:52.357932 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b8e571-97f6-44d6-bc5b-98e8d06f22f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:52.358539 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b8e571-97f6-44d6-bc5b-98e8d06f22f8 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:52.389449 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 925/1817] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:15:52 2022] POST /identity/v3/users => generated 298 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:15:52.390531 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8e571-97f6-44d6-bc5b-98e8d06f22f8 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:52.396587 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 893/1818] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:15:52.400840 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3db345-93ed-4df8-a75c-6237fe8c2573 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:52.412192 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8e571-97f6-44d6-bc5b-98e8d06f22f8 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:52.413295 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3db345-93ed-4df8-a75c-6237fe8c2573 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:52.418471 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3b460-1840-4828-9be0-e2ec333b2100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:52.419628 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3b460-1840-4828-9be0-e2ec333b2100 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:52.420599 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3b460-1840-4828-9be0-e2ec333b2100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:52.421132 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd09c54-9473-4593-b6bc-a8333dbaaa75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:52.421450 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3b460-1840-4828-9be0-e2ec333b2100 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:52.421769 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd09c54-9473-4593-b6bc-a8333dbaaa75 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:52.422084 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd09c54-9473-4593-b6bc-a8333dbaaa75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:52.422356 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd09c54-9473-4593-b6bc-a8333dbaaa75 admin admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:52.423013 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb3b460-1840-4828-9be0-e2ec333b2100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:52.423128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd09c54-9473-4593-b6bc-a8333dbaaa75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:15:52.423345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd09c54-9473-4593-b6bc-a8333dbaaa75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:52.425036 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd09c54-9473-4593-b6bc-a8333dbaaa75 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:52.425398 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb3b460-1840-4828-9be0-e2ec333b2100 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:52.445785 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 894/1819] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:15:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:15:52.445785 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd09c54-9473-4593-b6bc-a8333dbaaa75 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:52.447844 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 926/1820] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:15:52.448994 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3b460-1840-4828-9be0-e2ec333b2100 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:52.463163 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3b460-1840-4828-9be0-e2ec333b2100 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:52.466334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd09c54-9473-4593-b6bc-a8333dbaaa75 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:52.473451 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab57005-2ef6-4732-b0b5-79c9860e008d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:52.474437 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab57005-2ef6-4732-b0b5-79c9860e008d admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:52.474816 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab57005-2ef6-4732-b0b5-79c9860e008d admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:52.475524 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab57005-2ef6-4732-b0b5-79c9860e008d admin admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:52.476141 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab57005-2ef6-4732-b0b5-79c9860e008d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:52.478376 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab57005-2ef6-4732-b0b5-79c9860e008d admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:52.480300 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11efb60f-3f3b-46d1-af5f-944243520c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:52.481113 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efb60f-3f3b-46d1-af5f-944243520c81 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:52.481239 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efb60f-3f3b-46d1-af5f-944243520c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:52.482096 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efb60f-3f3b-46d1-af5f-944243520c81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:52.482404 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11efb60f-3f3b-46d1-af5f-944243520c81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:52.483864 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11efb60f-3f3b-46d1-af5f-944243520c81 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:52.501726 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 895/1821] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:15:52.502988 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11efb60f-3f3b-46d1-af5f-944243520c81 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:52.535144 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 927/1822] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:15:52 2022] POST /identity/v3/projects => generated 375 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:15:52.535421 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11efb60f-3f3b-46d1-af5f-944243520c81 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:52.535876 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab57005-2ef6-4732-b0b5-79c9860e008d admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:52.565054 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:DELETE=1,keystone:SELECT=94,keystone:INSERT=5 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:52.671371 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5464c9-925c-4fb5-a3c7-3c38d68c3957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:52.675946 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5464c9-925c-4fb5-a3c7-3c38d68c3957 admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:52.676226 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5464c9-925c-4fb5-a3c7-3c38d68c3957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:52.676501 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5464c9-925c-4fb5-a3c7-3c38d68c3957 admin admin] PATH_INFO: `/v3/projects/410ec6eed8ee4a418fec029be85aa50a/users/153b3370f98745b39b44b8a82d3b361d/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:52.712652 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab57005-2ef6-4732-b0b5-79c9860e008d admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:52.721412 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5464c9-925c-4fb5-a3c7-3c38d68c3957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=410ec6eed8ee4a418fec029be85aa50a, user_id=153b3370f98745b39b44b8a82d3b361d, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:52.726196 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80289335-38c6-4885-93a9-ed67a2bf17fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:52.726840 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80289335-38c6-4885-93a9-ed67a2bf17fa admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:52.727113 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80289335-38c6-4885-93a9-ed67a2bf17fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:52.727380 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80289335-38c6-4885-93a9-ed67a2bf17fa admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:52.729700 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5464c9-925c-4fb5-a3c7-3c38d68c3957 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:52.732444 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80289335-38c6-4885-93a9-ed67a2bf17fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:52.736590 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80289335-38c6-4885-93a9-ed67a2bf17fa admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:52.759270 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 896/1823] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:15:52 2022] PUT /identity/v3/projects/410ec6eed8ee4a418fec029be85aa50a/users/153b3370f98745b39b44b8a82d3b361d/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:15:52.763030 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fa38e-f418-400c-a04e-2cb3595b4273 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:52.763439 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fa38e-f418-400c-a04e-2cb3595b4273 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:52.763795 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fa38e-f418-400c-a04e-2cb3595b4273 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:52.767257 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 897/1824] 10.222.0.60 () {54 vars in 921 bytes} [Sun Jul 31 01:15:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:15:52.775266 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94977ad9-2ea4-4711-af7f-5886eada8151 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:52.776314 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94977ad9-2ea4-4711-af7f-5886eada8151 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:52.776314 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94977ad9-2ea4-4711-af7f-5886eada8151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:52.793710 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 928/1825] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:15:52 2022] POST /identity/v3/users => generated 288 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:15:52.798102 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80289335-38c6-4885-93a9-ed67a2bf17fa admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:52.824375 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80289335-38c6-4885-93a9-ed67a2bf17fa admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:52.857994 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-94977ad9-2ea4-4711-af7f-5886eada8151 None None] MFA Rules not processed for user `153b3370f98745b39b44b8a82d3b361d`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:52.861808 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-94977ad9-2ea4-4711-af7f-5886eada8151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:52.977523 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04ca75-a29c-4a8c-8afe-3c9b972ed186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:52.978286 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04ca75-a29c-4a8c-8afe-3c9b972ed186 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:52.979012 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04ca75-a29c-4a8c-8afe-3c9b972ed186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:52.980824 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04ca75-a29c-4a8c-8afe-3c9b972ed186 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:52.983587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04ca75-a29c-4a8c-8afe-3c9b972ed186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:52.996800 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04ca75-a29c-4a8c-8afe-3c9b972ed186 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:53.026911 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 929/1826] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:15:53.028311 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89a979-5981-4ef8-9d06-5134c4f53563 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:53.030243 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89a979-5981-4ef8-9d06-5134c4f53563 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:53.030632 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89a979-5981-4ef8-9d06-5134c4f53563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:53.052631 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 898/1827] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:15:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:15:53.057601 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94977ad9-2ea4-4711-af7f-5886eada8151 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:53.083951 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94977ad9-2ea4-4711-af7f-5886eada8151 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:53.086847 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-6d89a979-5981-4ef8-9d06-5134c4f53563 None None] MFA Rules not processed for user `04591cd035ef4961b8b7a93e294eb881`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:53.088609 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-6d89a979-5981-4ef8-9d06-5134c4f53563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:53.096134 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6156d18-180a-4b1d-ac7f-13a97f3a6cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:53.097065 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6156d18-180a-4b1d-ac7f-13a97f3a6cab admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:53.097718 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6156d18-180a-4b1d-ac7f-13a97f3a6cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:53.098452 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6156d18-180a-4b1d-ac7f-13a97f3a6cab admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:53.102470 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6156d18-180a-4b1d-ac7f-13a97f3a6cab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:53.107676 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6156d18-180a-4b1d-ac7f-13a97f3a6cab admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:53.146722 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 899/1828] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:15:53.147857 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6156d18-180a-4b1d-ac7f-13a97f3a6cab admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:53.155193 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-f6156d18-180a-4b1d-ac7f-13a97f3a6cab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:53.213259 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:53.283153 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6156d18-180a-4b1d-ac7f-13a97f3a6cab admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:53.284572 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 930/1829] 10.222.0.60 () {58 vars in 1018 bytes} [Sun Jul 31 01:15:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:15:53.285555 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89a979-5981-4ef8-9d06-5134c4f53563 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:53.288696 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2eb67-2a06-462a-bda8-41be689c740c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:53.289576 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2eb67-2a06-462a-bda8-41be689c740c service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:53.290622 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2eb67-2a06-462a-bda8-41be689c740c service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:53.291175 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2eb67-2a06-462a-bda8-41be689c740c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:53.312346 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89a979-5981-4ef8-9d06-5134c4f53563 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:53.313854 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2eb67-2a06-462a-bda8-41be689c740c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:53.315330 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2eb67-2a06-462a-bda8-41be689c740c service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:53.330166 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589a1aa-7469-4082-ae56-8a18d60ce813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:53.330688 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589a1aa-7469-4082-ae56-8a18d60ce813 admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:53.330956 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589a1aa-7469-4082-ae56-8a18d60ce813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:53.331227 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589a1aa-7469-4082-ae56-8a18d60ce813 admin admin] PATH_INFO: `/v3/projects/fb150317dd1f42789fc9e53d75885442/users/611e5737b5334a228f9cd659b6295927/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:53.359175 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 900/1830] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:15:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:15:53.359175 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2eb67-2a06-462a-bda8-41be689c740c service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:53.364619 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-f9f2eb67-2a06-462a-bda8-41be689c740c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:53.388731 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7589a1aa-7469-4082-ae56-8a18d60ce813 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb150317dd1f42789fc9e53d75885442, user_id=611e5737b5334a228f9cd659b6295927, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:53.392093 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7589a1aa-7469-4082-ae56-8a18d60ce813 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:53.408748 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2eb67-2a06-462a-bda8-41be689c740c service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:53.435117 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 931/1831] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:15:53 2022] PUT /identity/v3/projects/fb150317dd1f42789fc9e53d75885442/users/611e5737b5334a228f9cd659b6295927/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:15:53.445515 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa676211-1589-4522-8d15-ed0bae1c0088 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:53.446419 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa676211-1589-4522-8d15-ed0bae1c0088 service nova] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:53.446539 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa676211-1589-4522-8d15-ed0bae1c0088 service nova] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:53.446733 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa676211-1589-4522-8d15-ed0bae1c0088 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:53.448900 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020c4ef-4e69-45b7-bfb3-f26973196493 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:53.449180 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020c4ef-4e69-45b7-bfb3-f26973196493 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:53.449522 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020c4ef-4e69-45b7-bfb3-f26973196493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:53.466716 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:53.469187 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa676211-1589-4522-8d15-ed0bae1c0088 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:53.471972 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa676211-1589-4522-8d15-ed0bae1c0088 service nova] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:53.491257 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 901/1832] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:15:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:15:53.516593 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-4020c4ef-4e69-45b7-bfb3-f26973196493 None None] MFA Rules not processed for user `611e5737b5334a228f9cd659b6295927`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:53.517836 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-4020c4ef-4e69-45b7-bfb3-f26973196493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:53.650926 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 932/1833] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:15:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:15:53.656468 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa676211-1589-4522-8d15-ed0bae1c0088 service nova] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:53.677017 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa676211-1589-4522-8d15-ed0bae1c0088 service nova] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:53.800696 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77ffd3-00e2-479f-a1f9-ec6be41ab8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:53.801185 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77ffd3-00e2-479f-a1f9-ec6be41ab8cb admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:53.801555 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77ffd3-00e2-479f-a1f9-ec6be41ab8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:53.802062 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77ffd3-00e2-479f-a1f9-ec6be41ab8cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:53.802836 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77ffd3-00e2-479f-a1f9-ec6be41ab8cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:53.805089 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77ffd3-00e2-479f-a1f9-ec6be41ab8cb admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:53.865437 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 902/1834] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:15:53 2022] POST /identity/v3/projects => generated 375 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:15:53.869703 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4020c4ef-4e69-45b7-bfb3-f26973196493 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:53.890205 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4020c4ef-4e69-45b7-bfb3-f26973196493 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:54.017275 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5e9fb0-2e02-4e0f-a388-4e4a41a6af6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:54.018214 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e9fb0-2e02-4e0f-a388-4e4a41a6af6c admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:54.018571 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e9fb0-2e02-4e0f-a388-4e4a41a6af6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:54.018927 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e9fb0-2e02-4e0f-a388-4e4a41a6af6c admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:54.019867 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5e9fb0-2e02-4e0f-a388-4e4a41a6af6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:54.021964 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5e9fb0-2e02-4e0f-a388-4e4a41a6af6c admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:54.065665 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 933/1835] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:15:53 2022] POST /identity/v3/users => generated 294 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:15:54.069757 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77ffd3-00e2-479f-a1f9-ec6be41ab8cb admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:54.084180 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77ffd3-00e2-479f-a1f9-ec6be41ab8cb admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:54.094177 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470437db-bfd5-477d-a71f-b3c6e392a334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:54.095160 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470437db-bfd5-477d-a71f-b3c6e392a334 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:54.095446 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470437db-bfd5-477d-a71f-b3c6e392a334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:54.095920 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470437db-bfd5-477d-a71f-b3c6e392a334 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:54.096641 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470437db-bfd5-477d-a71f-b3c6e392a334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:54.098368 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470437db-bfd5-477d-a71f-b3c6e392a334 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:54.113728 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 903/1836] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:15:54.119243 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5e9fb0-2e02-4e0f-a388-4e4a41a6af6c admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:54.134275 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5e9fb0-2e02-4e0f-a388-4e4a41a6af6c admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:54.141323 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73cc56-a1a0-4d3d-94bd-caa52497408d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:54.142411 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73cc56-a1a0-4d3d-94bd-caa52497408d admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:54.142966 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73cc56-a1a0-4d3d-94bd-caa52497408d admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:54.143431 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73cc56-a1a0-4d3d-94bd-caa52497408d admin admin] PATH_INFO: `/v3/projects/aa65a433ac40470dbd195639561da426/users/4ae7b58ba506480e8b646a428e833d7b/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:54.186115 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c73cc56-a1a0-4d3d-94bd-caa52497408d admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa65a433ac40470dbd195639561da426, user_id=4ae7b58ba506480e8b646a428e833d7b, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:54.190026 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c73cc56-a1a0-4d3d-94bd-caa52497408d admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:54.214250 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 934/1837] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:15:54 2022] PUT /identity/v3/projects/aa65a433ac40470dbd195639561da426/users/4ae7b58ba506480e8b646a428e833d7b/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:15:54.220453 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470437db-bfd5-477d-a71f-b3c6e392a334 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:54.242385 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470437db-bfd5-477d-a71f-b3c6e392a334 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:54.324614 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47101498-88cc-4cf9-bb3b-82eb8d541f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:54.325343 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47101498-88cc-4cf9-bb3b-82eb8d541f0d admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:54.325823 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47101498-88cc-4cf9-bb3b-82eb8d541f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:54.326116 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47101498-88cc-4cf9-bb3b-82eb8d541f0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:54.327096 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47101498-88cc-4cf9-bb3b-82eb8d541f0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:54.329056 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47101498-88cc-4cf9-bb3b-82eb8d541f0d admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:54.358042 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 904/1838] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:15:54.365035 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73cc56-a1a0-4d3d-94bd-caa52497408d admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:54.380709 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73cc56-a1a0-4d3d-94bd-caa52497408d admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:54.393285 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb497c6-4fb7-471c-91e9-e2e0eefcbabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:54.394261 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb497c6-4fb7-471c-91e9-e2e0eefcbabc admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:54.394629 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb497c6-4fb7-471c-91e9-e2e0eefcbabc admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:54.394971 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb497c6-4fb7-471c-91e9-e2e0eefcbabc admin admin] PATH_INFO: `/v3/projects/aa65a433ac40470dbd195639561da426/users/4ae7b58ba506480e8b646a428e833d7b/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:54.405926 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb497c6-4fb7-471c-91e9-e2e0eefcbabc admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa65a433ac40470dbd195639561da426, user_id=4ae7b58ba506480e8b646a428e833d7b, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:54.419659 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb497c6-4fb7-471c-91e9-e2e0eefcbabc admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:54.431831 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 935/1839] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:15:54 2022] PUT /identity/v3/projects/aa65a433ac40470dbd195639561da426/users/4ae7b58ba506480e8b646a428e833d7b/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:15:54.444639 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149dd31-c3a7-463e-b6e6-37a683b52352 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:54.445179 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149dd31-c3a7-463e-b6e6-37a683b52352 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:54.445930 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149dd31-c3a7-463e-b6e6-37a683b52352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:54.479971 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:54.490181 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-a149dd31-c3a7-463e-b6e6-37a683b52352 None None] MFA Rules not processed for user `4ae7b58ba506480e8b646a428e833d7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:15:54.492001 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-a149dd31-c3a7-463e-b6e6-37a683b52352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:15:54.584053 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 905/1840] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:15:54 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:15:54.618599 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb497c6-4fb7-471c-91e9-e2e0eefcbabc admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:15:54.713948 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:54.728082 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb497c6-4fb7-471c-91e9-e2e0eefcbabc admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:15:54.745547 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942312d-f9e5-4265-bb36-9b869fe880b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:15:54.747723 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942312d-f9e5-4265-bb36-9b869fe880b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:15:54.748688 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942312d-f9e5-4265-bb36-9b869fe880b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:15:54.753555 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942312d-f9e5-4265-bb36-9b869fe880b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:15:54.788166 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942312d-f9e5-4265-bb36-9b869fe880b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:15:54.790210 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942312d-f9e5-4265-bb36-9b869fe880b8 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:15:54.820226 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 936/1841] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:15:54 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:16:04.575754 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=29 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:04.803800 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=6 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:06.227429 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149dd31-c3a7-463e-b6e6-37a683b52352 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:06.241857 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149dd31-c3a7-463e-b6e6-37a683b52352 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:06.266041 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0616c16-0e69-4b89-9e57-bb8c24930a50 tempest-RoutersIpV6AdminTest-866059121 tempest-RoutersIpV6AdminTest-866059121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae7b58ba506480e8b646a428e833d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa65a433ac40470dbd195639561da426', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:06.266922 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0616c16-0e69-4b89-9e57-bb8c24930a50 tempest-RoutersIpV6AdminTest-866059121 tempest-RoutersIpV6AdminTest-866059121-project-admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:06.272814 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0616c16-0e69-4b89-9e57-bb8c24930a50 tempest-RoutersIpV6AdminTest-866059121 tempest-RoutersIpV6AdminTest-866059121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:06.273328 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0616c16-0e69-4b89-9e57-bb8c24930a50 tempest-RoutersIpV6AdminTest-866059121 tempest-RoutersIpV6AdminTest-866059121-project-admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:06.274731 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0616c16-0e69-4b89-9e57-bb8c24930a50 tempest-RoutersIpV6AdminTest-866059121 tempest-RoutersIpV6AdminTest-866059121-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:16:06.275282 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0616c16-0e69-4b89-9e57-bb8c24930a50 tempest-RoutersIpV6AdminTest-866059121 tempest-RoutersIpV6AdminTest-866059121-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:06.280582 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0616c16-0e69-4b89-9e57-bb8c24930a50 tempest-RoutersIpV6AdminTest-866059121 tempest-RoutersIpV6AdminTest-866059121-project-admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:06.325595 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942312d-f9e5-4265-bb36-9b869fe880b8 service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:06.326839 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 906/1842] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:16:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:16:06.336002 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942312d-f9e5-4265-bb36-9b869fe880b8 service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:06.358713 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c035e6-8999-4d9a-ae59-8c8a739b358a tempest-RoutersIpV6AdminTest-866059121 tempest-RoutersIpV6AdminTest-866059121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae7b58ba506480e8b646a428e833d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa65a433ac40470dbd195639561da426', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:06.358713 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c035e6-8999-4d9a-ae59-8c8a739b358a tempest-RoutersIpV6AdminTest-866059121 tempest-RoutersIpV6AdminTest-866059121-project-admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:06.358713 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c035e6-8999-4d9a-ae59-8c8a739b358a tempest-RoutersIpV6AdminTest-866059121 tempest-RoutersIpV6AdminTest-866059121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:06.359101 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c035e6-8999-4d9a-ae59-8c8a739b358a tempest-RoutersIpV6AdminTest-866059121 tempest-RoutersIpV6AdminTest-866059121-project-admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:06.359746 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c035e6-8999-4d9a-ae59-8c8a739b358a tempest-RoutersIpV6AdminTest-866059121 tempest-RoutersIpV6AdminTest-866059121-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:06.365399 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c035e6-8999-4d9a-ae59-8c8a739b358a tempest-RoutersIpV6AdminTest-866059121 tempest-RoutersIpV6AdminTest-866059121-project-admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:06.466637 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0616c16-0e69-4b89-9e57-bb8c24930a50 tempest-RoutersIpV6AdminTest-866059121 tempest-RoutersIpV6AdminTest-866059121-project-admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:06.467259 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 937/1843] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:16:06 2022] POST /identity/v3/projects => generated 349 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:16:06.482846 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0616c16-0e69-4b89-9e57-bb8c24930a50 tempest-RoutersIpV6AdminTest-866059121 tempest-RoutersIpV6AdminTest-866059121-project-admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:06.633825 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96276076-e3b6-4e68-84aa-c09df9966437 tempest-RoutersIpV6AdminTest-866059121 tempest-RoutersIpV6AdminTest-866059121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae7b58ba506480e8b646a428e833d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa65a433ac40470dbd195639561da426', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:06.634485 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96276076-e3b6-4e68-84aa-c09df9966437 tempest-RoutersIpV6AdminTest-866059121 tempest-RoutersIpV6AdminTest-866059121-project-admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:06.634765 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96276076-e3b6-4e68-84aa-c09df9966437 tempest-RoutersIpV6AdminTest-866059121 tempest-RoutersIpV6AdminTest-866059121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:06.635079 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96276076-e3b6-4e68-84aa-c09df9966437 tempest-RoutersIpV6AdminTest-866059121 tempest-RoutersIpV6AdminTest-866059121-project-admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:06.646415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96276076-e3b6-4e68-84aa-c09df9966437 tempest-RoutersIpV6AdminTest-866059121 tempest-RoutersIpV6AdminTest-866059121-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:16:06.646758 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96276076-e3b6-4e68-84aa-c09df9966437 tempest-RoutersIpV6AdminTest-866059121 tempest-RoutersIpV6AdminTest-866059121-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:06.654536 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96276076-e3b6-4e68-84aa-c09df9966437 tempest-RoutersIpV6AdminTest-866059121 tempest-RoutersIpV6AdminTest-866059121-project-admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:06.694489 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 907/1844] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:16:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:16:08.081472 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c035e6-8999-4d9a-ae59-8c8a739b358a tempest-RoutersIpV6AdminTest-866059121 tempest-RoutersIpV6AdminTest-866059121-project-admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:08.094753 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c035e6-8999-4d9a-ae59-8c8a739b358a tempest-RoutersIpV6AdminTest-866059121 tempest-RoutersIpV6AdminTest-866059121-project-admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:08.101642 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d803988-5842-4edd-b7c6-74bd7ac4c9d5 tempest-RoutersIpV6AdminTest-866059121 tempest-RoutersIpV6AdminTest-866059121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae7b58ba506480e8b646a428e833d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa65a433ac40470dbd195639561da426', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:08.102170 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d803988-5842-4edd-b7c6-74bd7ac4c9d5 tempest-RoutersIpV6AdminTest-866059121 tempest-RoutersIpV6AdminTest-866059121-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:08.102454 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d803988-5842-4edd-b7c6-74bd7ac4c9d5 tempest-RoutersIpV6AdminTest-866059121 tempest-RoutersIpV6AdminTest-866059121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:08.102760 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d803988-5842-4edd-b7c6-74bd7ac4c9d5 tempest-RoutersIpV6AdminTest-866059121 tempest-RoutersIpV6AdminTest-866059121-project-admin] PATH_INFO: `/v3/projects/e5e5b33a5af644eab6ae35506acb031e` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:08.104149 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d803988-5842-4edd-b7c6-74bd7ac4c9d5 tempest-RoutersIpV6AdminTest-866059121 tempest-RoutersIpV6AdminTest-866059121-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e5e5b33a5af644eab6ae35506acb031e)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:08.106284 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d803988-5842-4edd-b7c6-74bd7ac4c9d5 tempest-RoutersIpV6AdminTest-866059121 tempest-RoutersIpV6AdminTest-866059121-project-admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:08.187552 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-3d803988-5842-4edd-b7c6-74bd7ac4c9d5 tempest-RoutersIpV6AdminTest-866059121 tempest-RoutersIpV6AdminTest-866059121-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5e5b33a5af644eab6ae35506acb031e', 'request_id': 'req-3d803988-5842-4edd-b7c6-74bd7ac4c9d5'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:08.195537 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-3d803988-5842-4edd-b7c6-74bd7ac4c9d5 tempest-RoutersIpV6AdminTest-866059121 tempest-RoutersIpV6AdminTest-866059121-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5e5b33a5af644eab6ae35506acb031e', 'request_id': 'req-3d803988-5842-4edd-b7c6-74bd7ac4c9d5'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:08.206084 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-3d803988-5842-4edd-b7c6-74bd7ac4c9d5 tempest-RoutersIpV6AdminTest-866059121 tempest-RoutersIpV6AdminTest-866059121-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5e5b33a5af644eab6ae35506acb031e', 'request_id': 'req-3d803988-5842-4edd-b7c6-74bd7ac4c9d5'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:08.223407 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-3d803988-5842-4edd-b7c6-74bd7ac4c9d5 tempest-RoutersIpV6AdminTest-866059121 tempest-RoutersIpV6AdminTest-866059121-project-admin] The token cache is being invalidate because project e5e5b33a5af644eab6ae35506acb031e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:16:08.224056 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-3d803988-5842-4edd-b7c6-74bd7ac4c9d5 tempest-RoutersIpV6AdminTest-866059121 tempest-RoutersIpV6AdminTest-866059121-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:08.224828 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-3d803988-5842-4edd-b7c6-74bd7ac4c9d5 tempest-RoutersIpV6AdminTest-866059121 tempest-RoutersIpV6AdminTest-866059121-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:08.230901 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 938/1845] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:16:08 2022] DELETE /identity/v3/projects/e5e5b33a5af644eab6ae35506acb031e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:16:08.286295 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96276076-e3b6-4e68-84aa-c09df9966437 tempest-RoutersIpV6AdminTest-866059121 tempest-RoutersIpV6AdminTest-866059121-project-admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:08.290061 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-96276076-e3b6-4e68-84aa-c09df9966437 tempest-RoutersIpV6AdminTest-866059121 tempest-RoutersIpV6AdminTest-866059121-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:08.406645 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96276076-e3b6-4e68-84aa-c09df9966437 tempest-RoutersIpV6AdminTest-866059121 tempest-RoutersIpV6AdminTest-866059121-project-admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:08.496311 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea842d-1bce-46ce-9e53-418535a6ff6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:08.497971 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea842d-1bce-46ce-9e53-418535a6ff6b service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:08.497971 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea842d-1bce-46ce-9e53-418535a6ff6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:08.497971 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea842d-1bce-46ce-9e53-418535a6ff6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:08.501267 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-dcea842d-1bce-46ce-9e53-418535a6ff6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:08.606353 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:08.629761 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea842d-1bce-46ce-9e53-418535a6ff6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:08.631635 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea842d-1bce-46ce-9e53-418535a6ff6b service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:08.644948 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 908/1846] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:16:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:16:08.871631 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d803988-5842-4edd-b7c6-74bd7ac4c9d5 tempest-RoutersIpV6AdminTest-866059121 tempest-RoutersIpV6AdminTest-866059121-project-admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:08.873544 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-3d803988-5842-4edd-b7c6-74bd7ac4c9d5 tempest-RoutersIpV6AdminTest-866059121 tempest-RoutersIpV6AdminTest-866059121-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:08.948836 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d803988-5842-4edd-b7c6-74bd7ac4c9d5 tempest-RoutersIpV6AdminTest-866059121 tempest-RoutersIpV6AdminTest-866059121-project-admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:08.955388 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356bbaca-5749-4082-9397-858a3ef99db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:08.956276 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356bbaca-5749-4082-9397-858a3ef99db7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:08.956600 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356bbaca-5749-4082-9397-858a3ef99db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:08.957015 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356bbaca-5749-4082-9397-858a3ef99db7 admin admin] PATH_INFO: `/v3/users/6a278b4769e24f6c8b42aec507190c56` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:08.958645 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356bbaca-5749-4082-9397-858a3ef99db7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a278b4769e24f6c8b42aec507190c56)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:08.961408 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356bbaca-5749-4082-9397-858a3ef99db7 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:09.025423 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-356bbaca-5749-4082-9397-858a3ef99db7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a278b4769e24f6c8b42aec507190c56'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:09.035588 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-356bbaca-5749-4082-9397-858a3ef99db7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a278b4769e24f6c8b42aec507190c56'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:09.036435 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-356bbaca-5749-4082-9397-858a3ef99db7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a278b4769e24f6c8b42aec507190c56'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:09.045272 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=83,keystone:INSERT=2,keystone:DELETE=15 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:09.051576 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-356bbaca-5749-4082-9397-858a3ef99db7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a278b4769e24f6c8b42aec507190c56'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:09.053131 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-356bbaca-5749-4082-9397-858a3ef99db7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a278b4769e24f6c8b42aec507190c56'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:09.071156 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 939/1847] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:16:08 2022] DELETE /identity/v3/users/6a278b4769e24f6c8b42aec507190c56 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:16:09.075767 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ccf1fb-f995-4916-87c5-38f4d9780858 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:09.076160 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ccf1fb-f995-4916-87c5-38f4d9780858 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:09.076636 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ccf1fb-f995-4916-87c5-38f4d9780858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:09.105044 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-57ccf1fb-f995-4916-87c5-38f4d9780858 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:09.106605 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-57ccf1fb-f995-4916-87c5-38f4d9780858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:09.206958 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 909/1848] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:16:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:16:09.265967 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356bbaca-5749-4082-9397-858a3ef99db7 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:09.267829 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-356bbaca-5749-4082-9397-858a3ef99db7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:09.361250 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356bbaca-5749-4082-9397-858a3ef99db7 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:09.375705 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cfec1e-5a5e-4c74-9fa5-28d1ea28d2ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:09.376520 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfec1e-5a5e-4c74-9fa5-28d1ea28d2ad service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:09.377041 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfec1e-5a5e-4c74-9fa5-28d1ea28d2ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:09.377728 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfec1e-5a5e-4c74-9fa5-28d1ea28d2ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:09.398110 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cfec1e-5a5e-4c74-9fa5-28d1ea28d2ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:09.399608 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cfec1e-5a5e-4c74-9fa5-28d1ea28d2ad service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:09.414185 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 940/1849] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:16:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:16:10.243164 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ccf1fb-f995-4916-87c5-38f4d9780858 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:10.245987 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-57ccf1fb-f995-4916-87c5-38f4d9780858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:10.287758 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ccf1fb-f995-4916-87c5-38f4d9780858 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:10.299362 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0d5dc-5201-4fe8-aa17-06d9af2d279e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:10.300513 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0d5dc-5201-4fe8-aa17-06d9af2d279e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:10.300893 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0d5dc-5201-4fe8-aa17-06d9af2d279e admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:10.301488 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0d5dc-5201-4fe8-aa17-06d9af2d279e admin admin] PATH_INFO: `/v3/projects/d69bf2ca51c1472e903b9f4a3996258e` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:10.302967 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0d5dc-5201-4fe8-aa17-06d9af2d279e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d69bf2ca51c1472e903b9f4a3996258e)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:10.305509 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0d5dc-5201-4fe8-aa17-06d9af2d279e admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:10.443047 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-8ca0d5dc-5201-4fe8-aa17-06d9af2d279e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd69bf2ca51c1472e903b9f4a3996258e', 'request_id': 'req-8ca0d5dc-5201-4fe8-aa17-06d9af2d279e'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:10.456568 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-8ca0d5dc-5201-4fe8-aa17-06d9af2d279e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd69bf2ca51c1472e903b9f4a3996258e', 'request_id': 'req-8ca0d5dc-5201-4fe8-aa17-06d9af2d279e'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:10.473532 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-8ca0d5dc-5201-4fe8-aa17-06d9af2d279e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd69bf2ca51c1472e903b9f4a3996258e', 'request_id': 'req-8ca0d5dc-5201-4fe8-aa17-06d9af2d279e'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:10.502728 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-8ca0d5dc-5201-4fe8-aa17-06d9af2d279e admin admin] The token cache is being invalidate because project d69bf2ca51c1472e903b9f4a3996258e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:16:10.504065 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-8ca0d5dc-5201-4fe8-aa17-06d9af2d279e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:10.504953 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-8ca0d5dc-5201-4fe8-aa17-06d9af2d279e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:10.508086 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 910/1850] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:16:10 2022] DELETE /identity/v3/projects/d69bf2ca51c1472e903b9f4a3996258e => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:16:10.511553 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cfec1e-5a5e-4c74-9fa5-28d1ea28d2ad service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:10.523016 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cfec1e-5a5e-4c74-9fa5-28d1ea28d2ad service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:10.589181 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f23506b-b30e-43f4-b045-7a3444b6096f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:10.589841 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23506b-b30e-43f4-b045-7a3444b6096f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:10.590120 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23506b-b30e-43f4-b045-7a3444b6096f admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:10.590393 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23506b-b30e-43f4-b045-7a3444b6096f admin admin] PATH_INFO: `/v3/users/79771dfb39134ed8b7a4961a079bca02` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:10.591847 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f23506b-b30e-43f4-b045-7a3444b6096f admin admin] RBAC: Authorizing `identity:delete_user(user_id=79771dfb39134ed8b7a4961a079bca02)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:10.593945 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f23506b-b30e-43f4-b045-7a3444b6096f admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:10.696600 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-5f23506b-b30e-43f4-b045-7a3444b6096f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79771dfb39134ed8b7a4961a079bca02'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:10.713552 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-5f23506b-b30e-43f4-b045-7a3444b6096f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79771dfb39134ed8b7a4961a079bca02'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:10.714238 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-5f23506b-b30e-43f4-b045-7a3444b6096f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79771dfb39134ed8b7a4961a079bca02'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:10.739926 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-5f23506b-b30e-43f4-b045-7a3444b6096f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79771dfb39134ed8b7a4961a079bca02'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:10.740770 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-5f23506b-b30e-43f4-b045-7a3444b6096f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79771dfb39134ed8b7a4961a079bca02'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:10.764389 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 941/1851] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:16:10 2022] DELETE /identity/v3/users/79771dfb39134ed8b7a4961a079bca02 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:16:11.647605 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0d5dc-5201-4fe8-aa17-06d9af2d279e admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:11.650097 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-8ca0d5dc-5201-4fe8-aa17-06d9af2d279e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:11.670790 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0d5dc-5201-4fe8-aa17-06d9af2d279e admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:11.774653 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e823bc5-5e14-4eea-9006-ff483ac057a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:11.775624 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e823bc5-5e14-4eea-9006-ff483ac057a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:11.776065 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e823bc5-5e14-4eea-9006-ff483ac057a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:11.776492 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e823bc5-5e14-4eea-9006-ff483ac057a9 admin admin] PATH_INFO: `/v3/projects/2dff0191b8f64480a5a0e4db14b36195` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:11.778160 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e823bc5-5e14-4eea-9006-ff483ac057a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dff0191b8f64480a5a0e4db14b36195)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:11.780377 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e823bc5-5e14-4eea-9006-ff483ac057a9 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:11.803921 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:11.875921 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-3e823bc5-5e14-4eea-9006-ff483ac057a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dff0191b8f64480a5a0e4db14b36195', 'request_id': 'req-3e823bc5-5e14-4eea-9006-ff483ac057a9'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:11.884541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-3e823bc5-5e14-4eea-9006-ff483ac057a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dff0191b8f64480a5a0e4db14b36195', 'request_id': 'req-3e823bc5-5e14-4eea-9006-ff483ac057a9'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:11.892784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-3e823bc5-5e14-4eea-9006-ff483ac057a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dff0191b8f64480a5a0e4db14b36195', 'request_id': 'req-3e823bc5-5e14-4eea-9006-ff483ac057a9'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:11.917206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-3e823bc5-5e14-4eea-9006-ff483ac057a9 admin admin] The token cache is being invalidate because project 2dff0191b8f64480a5a0e4db14b36195 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:16:11.917506 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-3e823bc5-5e14-4eea-9006-ff483ac057a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:11.918439 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-3e823bc5-5e14-4eea-9006-ff483ac057a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:11.920091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 911/1852] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:16:11 2022] DELETE /identity/v3/projects/2dff0191b8f64480a5a0e4db14b36195 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:16:11.924340 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f23506b-b30e-43f4-b045-7a3444b6096f admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:11.926489 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-5f23506b-b30e-43f4-b045-7a3444b6096f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:11.934685 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:11.940151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f23506b-b30e-43f4-b045-7a3444b6096f admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:12.023636 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8c3256-d88d-4809-9515-747a04efc0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:12.024752 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c3256-d88d-4809-9515-747a04efc0cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:12.025246 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c3256-d88d-4809-9515-747a04efc0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:12.025756 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c3256-d88d-4809-9515-747a04efc0cd admin admin] PATH_INFO: `/v3/users/ec1e9a637ac5454ab598a47fc60d593b` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:12.027983 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8c3256-d88d-4809-9515-747a04efc0cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec1e9a637ac5454ab598a47fc60d593b)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:12.030458 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8c3256-d88d-4809-9515-747a04efc0cd admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:12.097965 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-dd8c3256-d88d-4809-9515-747a04efc0cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec1e9a637ac5454ab598a47fc60d593b'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:12.106050 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-dd8c3256-d88d-4809-9515-747a04efc0cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec1e9a637ac5454ab598a47fc60d593b'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:12.106834 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-dd8c3256-d88d-4809-9515-747a04efc0cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec1e9a637ac5454ab598a47fc60d593b'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:12.126695 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-dd8c3256-d88d-4809-9515-747a04efc0cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec1e9a637ac5454ab598a47fc60d593b'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:12.127869 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-dd8c3256-d88d-4809-9515-747a04efc0cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec1e9a637ac5454ab598a47fc60d593b'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:12.144685 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 942/1853] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:16:11 2022] DELETE /identity/v3/users/ec1e9a637ac5454ab598a47fc60d593b => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:16:12.809603 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e823bc5-5e14-4eea-9006-ff483ac057a9 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:12.812327 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-3e823bc5-5e14-4eea-9006-ff483ac057a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:12.830470 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e823bc5-5e14-4eea-9006-ff483ac057a9 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:12.901387 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7564d-e840-461c-9015-98cfc142e3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:12.902100 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7564d-e840-461c-9015-98cfc142e3c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:12.902373 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7564d-e840-461c-9015-98cfc142e3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:12.902817 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7564d-e840-461c-9015-98cfc142e3c1 admin admin] PATH_INFO: `/v3/projects/fdf2b48f565548a397667afd95428412` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:12.904179 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c7564d-e840-461c-9015-98cfc142e3c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdf2b48f565548a397667afd95428412)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:12.906222 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c7564d-e840-461c-9015-98cfc142e3c1 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:12.963243 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-18c7564d-e840-461c-9015-98cfc142e3c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdf2b48f565548a397667afd95428412', 'request_id': 'req-18c7564d-e840-461c-9015-98cfc142e3c1'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:12.970840 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-18c7564d-e840-461c-9015-98cfc142e3c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdf2b48f565548a397667afd95428412', 'request_id': 'req-18c7564d-e840-461c-9015-98cfc142e3c1'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:12.979596 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-18c7564d-e840-461c-9015-98cfc142e3c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdf2b48f565548a397667afd95428412', 'request_id': 'req-18c7564d-e840-461c-9015-98cfc142e3c1'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:13.008798 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-18c7564d-e840-461c-9015-98cfc142e3c1 admin admin] The token cache is being invalidate because project fdf2b48f565548a397667afd95428412 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:16:13.009463 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-18c7564d-e840-461c-9015-98cfc142e3c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:13.010342 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-18c7564d-e840-461c-9015-98cfc142e3c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:13.016199 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 912/1854] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:16:12 2022] DELETE /identity/v3/projects/fdf2b48f565548a397667afd95428412 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:16:13.017579 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc172d-3a48-4808-98ce-771d62fc9b92 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:13.018054 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc172d-3a48-4808-98ce-771d62fc9b92 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:13.018307 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc172d-3a48-4808-98ce-771d62fc9b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:13.040016 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-aebc172d-3a48-4808-98ce-771d62fc9b92 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:13.041601 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-aebc172d-3a48-4808-98ce-771d62fc9b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:13.111530 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 943/1855] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:16:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:16:13.120961 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22760d6-e50f-45a3-943d-d7df02e0f8d5 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:13.121281 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22760d6-e50f-45a3-943d-d7df02e0f8d5 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:13.121562 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22760d6-e50f-45a3-943d-d7df02e0f8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:13.167887 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-a22760d6-e50f-45a3-943d-d7df02e0f8d5 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:13.169284 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-a22760d6-e50f-45a3-943d-d7df02e0f8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:13.183155 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc172d-3a48-4808-98ce-771d62fc9b92 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:13.183845 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 913/1856] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:16:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:16:13.194623 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc172d-3a48-4808-98ce-771d62fc9b92 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:13.199650 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6cb38-5319-40c9-a5f8-ce6f9c2ae1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:13.200725 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6cb38-5319-40c9-a5f8-ce6f9c2ae1aa admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:13.201216 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6cb38-5319-40c9-a5f8-ce6f9c2ae1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:13.201482 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6cb38-5319-40c9-a5f8-ce6f9c2ae1aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:13.202187 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6cb38-5319-40c9-a5f8-ce6f9c2ae1aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:16:13.202484 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6cb38-5319-40c9-a5f8-ce6f9c2ae1aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:13.206724 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6cb38-5319-40c9-a5f8-ce6f9c2ae1aa admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:13.223568 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 944/1857] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:16:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:16:13.228302 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22760d6-e50f-45a3-943d-d7df02e0f8d5 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:13.241553 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22760d6-e50f-45a3-943d-d7df02e0f8d5 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:13.250919 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15ffda-ae38-4d3b-a96e-41360e2bb938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:13.251832 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15ffda-ae38-4d3b-a96e-41360e2bb938 admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:13.252294 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15ffda-ae38-4d3b-a96e-41360e2bb938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:13.252917 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15ffda-ae38-4d3b-a96e-41360e2bb938 admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:13.254130 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15ffda-ae38-4d3b-a96e-41360e2bb938 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:13.258331 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15ffda-ae38-4d3b-a96e-41360e2bb938 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:13.311253 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6cb38-5319-40c9-a5f8-ce6f9c2ae1aa admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:13.312365 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 914/1858] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:16:13 2022] POST /identity/v3/projects => generated 363 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:16:13.327211 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6cb38-5319-40c9-a5f8-ce6f9c2ae1aa admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:13.354540 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:13.450898 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb58e19d-6de4-4fcc-a975-a737204394da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:13.451582 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58e19d-6de4-4fcc-a975-a737204394da admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:13.451957 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58e19d-6de4-4fcc-a975-a737204394da admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:13.452151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58e19d-6de4-4fcc-a975-a737204394da admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:13.453270 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb58e19d-6de4-4fcc-a975-a737204394da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:13.457747 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb58e19d-6de4-4fcc-a975-a737204394da admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:13.500321 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 945/1859] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:16:13 2022] POST /identity/v3/users => generated 282 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:16:13.504787 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15ffda-ae38-4d3b-a96e-41360e2bb938 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:13.516941 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15ffda-ae38-4d3b-a96e-41360e2bb938 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:13.522502 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c26a9e-7a53-4a19-bc29-0c04702e948d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:13.522940 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c26a9e-7a53-4a19-bc29-0c04702e948d admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:13.523196 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c26a9e-7a53-4a19-bc29-0c04702e948d admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:13.523555 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c26a9e-7a53-4a19-bc29-0c04702e948d admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:13.524265 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c26a9e-7a53-4a19-bc29-0c04702e948d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:13.526029 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c26a9e-7a53-4a19-bc29-0c04702e948d admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:13.527742 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:13.541931 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 915/1860] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:16:13.542989 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb58e19d-6de4-4fcc-a975-a737204394da admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:13.558413 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb58e19d-6de4-4fcc-a975-a737204394da admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:13.563539 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959032e-b1e5-48c4-8056-8278578a715d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:13.564444 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959032e-b1e5-48c4-8056-8278578a715d admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:13.564444 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959032e-b1e5-48c4-8056-8278578a715d admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:13.564625 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959032e-b1e5-48c4-8056-8278578a715d admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:13.565392 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9959032e-b1e5-48c4-8056-8278578a715d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:13.567260 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9959032e-b1e5-48c4-8056-8278578a715d admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:13.580165 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 946/1861] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:16:13.584538 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c26a9e-7a53-4a19-bc29-0c04702e948d admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:13.596407 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c26a9e-7a53-4a19-bc29-0c04702e948d admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:13.601385 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f2439f-1be8-4862-ac89-17f374eb8b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:13.602070 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2439f-1be8-4862-ac89-17f374eb8b3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:13.602685 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2439f-1be8-4862-ac89-17f374eb8b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:13.602685 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2439f-1be8-4862-ac89-17f374eb8b3c admin admin] PATH_INFO: `/v3/projects/6aadcee381764ffc92f7ab3c3dca73eb/users/3879d12d3b4b4cdfaf3ff488f1bd9be0/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:13.620007 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f2439f-1be8-4862-ac89-17f374eb8b3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aadcee381764ffc92f7ab3c3dca73eb, user_id=3879d12d3b4b4cdfaf3ff488f1bd9be0, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:13.622783 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f2439f-1be8-4862-ac89-17f374eb8b3c admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:13.642005 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 916/1862] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:16:13 2022] PUT /identity/v3/projects/6aadcee381764ffc92f7ab3c3dca73eb/users/3879d12d3b4b4cdfaf3ff488f1bd9be0/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:16:13.652653 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37791317-c7e1-43bc-b2d2-5eef9ab88517 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:13.653713 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37791317-c7e1-43bc-b2d2-5eef9ab88517 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:13.653713 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37791317-c7e1-43bc-b2d2-5eef9ab88517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:13.685745 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-37791317-c7e1-43bc-b2d2-5eef9ab88517 None None] MFA Rules not processed for user `3879d12d3b4b4cdfaf3ff488f1bd9be0`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:13.687629 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-37791317-c7e1-43bc-b2d2-5eef9ab88517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:13.795947 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 947/1863] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:16:13 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:16:13.797608 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f2439f-1be8-4862-ac89-17f374eb8b3c admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:13.870205 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f2439f-1be8-4862-ac89-17f374eb8b3c admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:13.875650 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5120af4-5500-4c57-8612-8921889c29c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:13.876301 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5120af4-5500-4c57-8612-8921889c29c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:13.876580 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5120af4-5500-4c57-8612-8921889c29c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:13.876850 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5120af4-5500-4c57-8612-8921889c29c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:13.879663 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5120af4-5500-4c57-8612-8921889c29c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:13.879803 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5120af4-5500-4c57-8612-8921889c29c2 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:13.915348 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 917/1864] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:16:13 2022] POST /identity/v3/projects => generated 365 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:16:13.919308 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37791317-c7e1-43bc-b2d2-5eef9ab88517 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:13.932424 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37791317-c7e1-43bc-b2d2-5eef9ab88517 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:14.026798 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d7272-3d3f-4d0e-bea1-4e46ccc4d0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:14.027785 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d7272-3d3f-4d0e-bea1-4e46ccc4d0eb admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:14.028189 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d7272-3d3f-4d0e-bea1-4e46ccc4d0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:14.028640 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d7272-3d3f-4d0e-bea1-4e46ccc4d0eb admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:14.029363 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d7272-3d3f-4d0e-bea1-4e46ccc4d0eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:14.031719 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d7272-3d3f-4d0e-bea1-4e46ccc4d0eb admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:14.061464 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 948/1865] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:16:13 2022] POST /identity/v3/users => generated 289 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:16:14.061624 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5120af4-5500-4c57-8612-8921889c29c2 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:14.074663 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5120af4-5500-4c57-8612-8921889c29c2 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:14.081565 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a1845-0d52-41b7-a7dd-3a9ae8e82c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:14.082214 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a1845-0d52-41b7-a7dd-3a9ae8e82c7b admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:14.082496 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a1845-0d52-41b7-a7dd-3a9ae8e82c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:14.082965 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a1845-0d52-41b7-a7dd-3a9ae8e82c7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:14.083851 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a1845-0d52-41b7-a7dd-3a9ae8e82c7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:14.085951 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a1845-0d52-41b7-a7dd-3a9ae8e82c7b admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:14.103713 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 918/1866] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:16:14.105989 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d7272-3d3f-4d0e-bea1-4e46ccc4d0eb admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:14.131748 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d7272-3d3f-4d0e-bea1-4e46ccc4d0eb admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:14.140704 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d4949-fd87-42ae-a7a5-2c8c64297b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:14.142967 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d4949-fd87-42ae-a7a5-2c8c64297b74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:14.144015 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d4949-fd87-42ae-a7a5-2c8c64297b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:14.144310 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d4949-fd87-42ae-a7a5-2c8c64297b74 admin admin] PATH_INFO: `/v3/projects/b2facc5135584d808aae81352145bb78/users/1950069afe984ee88f15fc0306543c03/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:14.153925 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:14.189049 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d4949-fd87-42ae-a7a5-2c8c64297b74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2facc5135584d808aae81352145bb78, user_id=1950069afe984ee88f15fc0306543c03, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:14.194991 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d4949-fd87-42ae-a7a5-2c8c64297b74 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:14.213934 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 949/1867] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:16:14 2022] PUT /identity/v3/projects/b2facc5135584d808aae81352145bb78/users/1950069afe984ee88f15fc0306543c03/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:16:14.218137 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a1845-0d52-41b7-a7dd-3a9ae8e82c7b admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:14.231475 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a1845-0d52-41b7-a7dd-3a9ae8e82c7b admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:14.294818 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5ce81-575f-4122-8a1f-d0aec13df4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:14.295371 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5ce81-575f-4122-8a1f-d0aec13df4e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:14.295696 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5ce81-575f-4122-8a1f-d0aec13df4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:14.296139 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5ce81-575f-4122-8a1f-d0aec13df4e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:14.297428 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de5ce81-575f-4122-8a1f-d0aec13df4e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:14.298860 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de5ce81-575f-4122-8a1f-d0aec13df4e7 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:14.309924 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 919/1868] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:16:14.314210 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d4949-fd87-42ae-a7a5-2c8c64297b74 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:14.324771 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d4949-fd87-42ae-a7a5-2c8c64297b74 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:14.329948 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133006cf-7a0e-43a7-8d29-f8b4c0bec084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:14.330792 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133006cf-7a0e-43a7-8d29-f8b4c0bec084 admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:14.331067 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133006cf-7a0e-43a7-8d29-f8b4c0bec084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:14.331345 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133006cf-7a0e-43a7-8d29-f8b4c0bec084 admin admin] PATH_INFO: `/v3/projects/b2facc5135584d808aae81352145bb78/users/1950069afe984ee88f15fc0306543c03/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:14.333308 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133006cf-7a0e-43a7-8d29-f8b4c0bec084 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2facc5135584d808aae81352145bb78, user_id=1950069afe984ee88f15fc0306543c03, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:14.335998 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133006cf-7a0e-43a7-8d29-f8b4c0bec084 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:14.347142 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 950/1869] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:16:14 2022] PUT /identity/v3/projects/b2facc5135584d808aae81352145bb78/users/1950069afe984ee88f15fc0306543c03/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:16:14.358655 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad2405-c08c-4a27-a2c5-21e1448b88a9 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:14.358969 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad2405-c08c-4a27-a2c5-21e1448b88a9 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:14.359228 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad2405-c08c-4a27-a2c5-21e1448b88a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:14.393025 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-05ad2405-c08c-4a27-a2c5-21e1448b88a9 None None] MFA Rules not processed for user `1950069afe984ee88f15fc0306543c03`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:14.394309 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-05ad2405-c08c-4a27-a2c5-21e1448b88a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:14.427819 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:14.469046 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 920/1870] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:16:14 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:16:14.479257 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133006cf-7a0e-43a7-8d29-f8b4c0bec084 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:14.481023 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-133006cf-7a0e-43a7-8d29-f8b4c0bec084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:14.556785 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133006cf-7a0e-43a7-8d29-f8b4c0bec084 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:14.560920 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90144b73-73da-4776-8e75-07cc232cb78f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:14.561928 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90144b73-73da-4776-8e75-07cc232cb78f service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:14.561928 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90144b73-73da-4776-8e75-07cc232cb78f service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:14.562126 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90144b73-73da-4776-8e75-07cc232cb78f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:14.572454 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90144b73-73da-4776-8e75-07cc232cb78f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:14.574231 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90144b73-73da-4776-8e75-07cc232cb78f service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:14.585793 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 951/1871] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:16:14 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:16:17.198839 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad2405-c08c-4a27-a2c5-21e1448b88a9 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:17.200496 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-05ad2405-c08c-4a27-a2c5-21e1448b88a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:17.214635 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad2405-c08c-4a27-a2c5-21e1448b88a9 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:17.220065 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06174e1b-7e02-47a8-a4a3-069b0513c80a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:17.220711 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06174e1b-7e02-47a8-a4a3-069b0513c80a service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:17.221055 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06174e1b-7e02-47a8-a4a3-069b0513c80a service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:17.221328 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06174e1b-7e02-47a8-a4a3-069b0513c80a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:17.306830 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06174e1b-7e02-47a8-a4a3-069b0513c80a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:17.309174 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06174e1b-7e02-47a8-a4a3-069b0513c80a service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:17.324414 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 921/1872] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:16:17 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:16:19.420312 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90144b73-73da-4776-8e75-07cc232cb78f service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:19.542060 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90144b73-73da-4776-8e75-07cc232cb78f service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:19.550455 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e90a5c3-5c74-410b-bf24-92c36673d495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:19.551572 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90a5c3-5c74-410b-bf24-92c36673d495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:19.551857 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90a5c3-5c74-410b-bf24-92c36673d495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:19.552181 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90a5c3-5c74-410b-bf24-92c36673d495 admin admin] PATH_INFO: `/v3/users/3879d12d3b4b4cdfaf3ff488f1bd9be0` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:19.553752 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e90a5c3-5c74-410b-bf24-92c36673d495 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3879d12d3b4b4cdfaf3ff488f1bd9be0)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:19.556701 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e90a5c3-5c74-410b-bf24-92c36673d495 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:19.630985 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-7e90a5c3-5c74-410b-bf24-92c36673d495 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3879d12d3b4b4cdfaf3ff488f1bd9be0'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:19.641461 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-7e90a5c3-5c74-410b-bf24-92c36673d495 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3879d12d3b4b4cdfaf3ff488f1bd9be0'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:19.642419 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-7e90a5c3-5c74-410b-bf24-92c36673d495 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3879d12d3b4b4cdfaf3ff488f1bd9be0'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:19.661814 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-7e90a5c3-5c74-410b-bf24-92c36673d495 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3879d12d3b4b4cdfaf3ff488f1bd9be0'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:19.662649 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-7e90a5c3-5c74-410b-bf24-92c36673d495 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3879d12d3b4b4cdfaf3ff488f1bd9be0'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:19.665977 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:19.735624 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 952/1873] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:16:19 2022] DELETE /identity/v3/users/3879d12d3b4b4cdfaf3ff488f1bd9be0 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:16:19.742050 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985baa86-e800-40d8-b804-54101dbba19a None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:19.742586 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985baa86-e800-40d8-b804-54101dbba19a None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:19.742798 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985baa86-e800-40d8-b804-54101dbba19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:19.784079 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-985baa86-e800-40d8-b804-54101dbba19a None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:19.787437 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-985baa86-e800-40d8-b804-54101dbba19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:19.954570 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 922/1874] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:16:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:16:19.970340 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e90a5c3-5c74-410b-bf24-92c36673d495 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:19.972213 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-7e90a5c3-5c74-410b-bf24-92c36673d495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:20.116549 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e90a5c3-5c74-410b-bf24-92c36673d495 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:20.126000 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496e0d9-b122-4c01-b100-a3c8183ce120 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:20.126662 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496e0d9-b122-4c01-b100-a3c8183ce120 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:20.126980 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496e0d9-b122-4c01-b100-a3c8183ce120 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:20.127296 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496e0d9-b122-4c01-b100-a3c8183ce120 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:20.149844 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496e0d9-b122-4c01-b100-a3c8183ce120 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:20.154457 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496e0d9-b122-4c01-b100-a3c8183ce120 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:20.177567 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 953/1875] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:16:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:16:21.745960 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985baa86-e800-40d8-b804-54101dbba19a None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:21.748216 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-985baa86-e800-40d8-b804-54101dbba19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:21.770181 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985baa86-e800-40d8-b804-54101dbba19a None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:21.788585 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c160f4d-c62e-421d-922f-1cb21995eb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:21.789275 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c160f4d-c62e-421d-922f-1cb21995eb22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:21.789561 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c160f4d-c62e-421d-922f-1cb21995eb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:21.789836 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c160f4d-c62e-421d-922f-1cb21995eb22 admin admin] PATH_INFO: `/v3/projects/6aadcee381764ffc92f7ab3c3dca73eb` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:21.791082 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c160f4d-c62e-421d-922f-1cb21995eb22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aadcee381764ffc92f7ab3c3dca73eb)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:21.793628 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c160f4d-c62e-421d-922f-1cb21995eb22 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:21.907811 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-5c160f4d-c62e-421d-922f-1cb21995eb22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aadcee381764ffc92f7ab3c3dca73eb', 'request_id': 'req-5c160f4d-c62e-421d-922f-1cb21995eb22'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:21.914986 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-5c160f4d-c62e-421d-922f-1cb21995eb22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aadcee381764ffc92f7ab3c3dca73eb', 'request_id': 'req-5c160f4d-c62e-421d-922f-1cb21995eb22'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:21.918872 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:21.924846 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-5c160f4d-c62e-421d-922f-1cb21995eb22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aadcee381764ffc92f7ab3c3dca73eb', 'request_id': 'req-5c160f4d-c62e-421d-922f-1cb21995eb22'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:21.941046 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496e0d9-b122-4c01-b100-a3c8183ce120 service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:21.943983 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-e496e0d9-b122-4c01-b100-a3c8183ce120 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:21.962118 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-5c160f4d-c62e-421d-922f-1cb21995eb22 admin admin] The token cache is being invalidate because project 6aadcee381764ffc92f7ab3c3dca73eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:16:21.962683 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-5c160f4d-c62e-421d-922f-1cb21995eb22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:21.964103 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-5c160f4d-c62e-421d-922f-1cb21995eb22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:21.969769 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496e0d9-b122-4c01-b100-a3c8183ce120 service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:21.973981 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 923/1876] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:16:21 2022] DELETE /identity/v3/projects/6aadcee381764ffc92f7ab3c3dca73eb => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:16:21.977536 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c160f4d-c62e-421d-922f-1cb21995eb22 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:21.981325 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-5c160f4d-c62e-421d-922f-1cb21995eb22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:22.051746 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e2e52-01df-45fd-a439-f17a7877c750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:22.052546 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e2e52-01df-45fd-a439-f17a7877c750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:22.053784 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e2e52-01df-45fd-a439-f17a7877c750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:22.054104 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e2e52-01df-45fd-a439-f17a7877c750 admin admin] PATH_INFO: `/v3/users/153b3370f98745b39b44b8a82d3b361d` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:22.056484 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70e2e52-01df-45fd-a439-f17a7877c750 admin admin] RBAC: Authorizing `identity:delete_user(user_id=153b3370f98745b39b44b8a82d3b361d)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:22.058806 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70e2e52-01df-45fd-a439-f17a7877c750 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:22.139355 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c160f4d-c62e-421d-922f-1cb21995eb22 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:22.151256 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118b3cf-5539-4d2b-bab9-7f85a3f2a362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:22.151991 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-b70e2e52-01df-45fd-a439-f17a7877c750 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '153b3370f98745b39b44b8a82d3b361d'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:22.152363 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118b3cf-5539-4d2b-bab9-7f85a3f2a362 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:22.153064 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118b3cf-5539-4d2b-bab9-7f85a3f2a362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:22.153481 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118b3cf-5539-4d2b-bab9-7f85a3f2a362 admin admin] PATH_INFO: `/v3/users/1950069afe984ee88f15fc0306543c03` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:22.154912 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f118b3cf-5539-4d2b-bab9-7f85a3f2a362 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1950069afe984ee88f15fc0306543c03)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:22.157321 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f118b3cf-5539-4d2b-bab9-7f85a3f2a362 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:22.171401 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-b70e2e52-01df-45fd-a439-f17a7877c750 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '153b3370f98745b39b44b8a82d3b361d'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:22.172438 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-b70e2e52-01df-45fd-a439-f17a7877c750 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '153b3370f98745b39b44b8a82d3b361d'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:22.190568 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-b70e2e52-01df-45fd-a439-f17a7877c750 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '153b3370f98745b39b44b8a82d3b361d'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:22.192285 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-b70e2e52-01df-45fd-a439-f17a7877c750 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '153b3370f98745b39b44b8a82d3b361d'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:22.222700 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 954/1877] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:16:21 2022] DELETE /identity/v3/users/153b3370f98745b39b44b8a82d3b361d => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:16:22.227337 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1318e310-bbf8-4635-9c4c-fbb84e44a886 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:22.227891 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1318e310-bbf8-4635-9c4c-fbb84e44a886 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:22.228489 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1318e310-bbf8-4635-9c4c-fbb84e44a886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:22.238774 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-f118b3cf-5539-4d2b-bab9-7f85a3f2a362 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1950069afe984ee88f15fc0306543c03'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:22.242529 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-f118b3cf-5539-4d2b-bab9-7f85a3f2a362 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1950069afe984ee88f15fc0306543c03'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:22.258633 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-1318e310-bbf8-4635-9c4c-fbb84e44a886 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:22.258818 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-f118b3cf-5539-4d2b-bab9-7f85a3f2a362 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1950069afe984ee88f15fc0306543c03'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:22.260526 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-1318e310-bbf8-4635-9c4c-fbb84e44a886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:22.269627 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-f118b3cf-5539-4d2b-bab9-7f85a3f2a362 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1950069afe984ee88f15fc0306543c03'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:22.270290 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-f118b3cf-5539-4d2b-bab9-7f85a3f2a362 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1950069afe984ee88f15fc0306543c03'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:22.274723 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:22.289467 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 924/1878] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:16:21 2022] DELETE /identity/v3/users/1950069afe984ee88f15fc0306543c03 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:16:22.342944 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 955/1879] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:16:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:16:22.354939 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118b3cf-5539-4d2b-bab9-7f85a3f2a362 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:22.356773 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-f118b3cf-5539-4d2b-bab9-7f85a3f2a362 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:22.442892 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118b3cf-5539-4d2b-bab9-7f85a3f2a362 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:22.448880 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709cf282-bdab-4278-be98-a3d0aac1bef6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:22.449598 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cf282-bdab-4278-be98-a3d0aac1bef6 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:22.449999 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cf282-bdab-4278-be98-a3d0aac1bef6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:22.450377 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cf282-bdab-4278-be98-a3d0aac1bef6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:22.479534 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:22.536548 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709cf282-bdab-4278-be98-a3d0aac1bef6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:22.539156 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709cf282-bdab-4278-be98-a3d0aac1bef6 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:22.553877 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 925/1880] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:16:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:16:23.073996 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1318e310-bbf8-4635-9c4c-fbb84e44a886 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:23.076435 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-1318e310-bbf8-4635-9c4c-fbb84e44a886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:23.090198 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1318e310-bbf8-4635-9c4c-fbb84e44a886 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:23.097932 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb425ec0-ccbc-4b8e-8d6e-a53f345d575d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:23.098248 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb425ec0-ccbc-4b8e-8d6e-a53f345d575d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:23.098747 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb425ec0-ccbc-4b8e-8d6e-a53f345d575d admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:23.100185 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb425ec0-ccbc-4b8e-8d6e-a53f345d575d admin admin] PATH_INFO: `/v3/projects/410ec6eed8ee4a418fec029be85aa50a` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:23.102216 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb425ec0-ccbc-4b8e-8d6e-a53f345d575d admin admin] RBAC: Authorizing `identity:delete_project(project_id=410ec6eed8ee4a418fec029be85aa50a)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:23.104823 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb425ec0-ccbc-4b8e-8d6e-a53f345d575d admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:23.167200 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709cf282-bdab-4278-be98-a3d0aac1bef6 service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:23.169120 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-709cf282-bdab-4278-be98-a3d0aac1bef6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:23.197439 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709cf282-bdab-4278-be98-a3d0aac1bef6 service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:23.210530 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-eb425ec0-ccbc-4b8e-8d6e-a53f345d575d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '410ec6eed8ee4a418fec029be85aa50a', 'request_id': 'req-eb425ec0-ccbc-4b8e-8d6e-a53f345d575d'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:23.222157 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-eb425ec0-ccbc-4b8e-8d6e-a53f345d575d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '410ec6eed8ee4a418fec029be85aa50a', 'request_id': 'req-eb425ec0-ccbc-4b8e-8d6e-a53f345d575d'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:23.243051 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-eb425ec0-ccbc-4b8e-8d6e-a53f345d575d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '410ec6eed8ee4a418fec029be85aa50a', 'request_id': 'req-eb425ec0-ccbc-4b8e-8d6e-a53f345d575d'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:23.272767 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-eb425ec0-ccbc-4b8e-8d6e-a53f345d575d admin admin] The token cache is being invalidate because project 410ec6eed8ee4a418fec029be85aa50a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:16:23.273062 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-eb425ec0-ccbc-4b8e-8d6e-a53f345d575d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:23.273731 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-eb425ec0-ccbc-4b8e-8d6e-a53f345d575d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:23.278853 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 956/1881] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:16:23 2022] DELETE /identity/v3/projects/410ec6eed8ee4a418fec029be85aa50a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:16:23.282333 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66417bbf-b8ae-4c73-8309-676d7b03588e None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:23.282673 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66417bbf-b8ae-4c73-8309-676d7b03588e None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:23.283328 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66417bbf-b8ae-4c73-8309-676d7b03588e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:23.299411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ccfbf-2717-4eb8-866c-3e56e15a927c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:23.299763 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ccfbf-2717-4eb8-866c-3e56e15a927c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:23.300108 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ccfbf-2717-4eb8-866c-3e56e15a927c admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:23.300448 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ccfbf-2717-4eb8-866c-3e56e15a927c admin admin] PATH_INFO: `/v3/projects/b2facc5135584d808aae81352145bb78` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:23.301771 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ccfbf-2717-4eb8-866c-3e56e15a927c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2facc5135584d808aae81352145bb78)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:23.303873 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ccfbf-2717-4eb8-866c-3e56e15a927c admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:23.311548 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-66417bbf-b8ae-4c73-8309-676d7b03588e None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:23.314232 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-66417bbf-b8ae-4c73-8309-676d7b03588e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:23.339924 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 957/1882] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:16:23.357164 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832818d-2c05-40e3-887b-5685c84d6dfd None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:23.357455 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832818d-2c05-40e3-887b-5685c84d6dfd None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:23.357732 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832818d-2c05-40e3-887b-5685c84d6dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:23.393112 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-3f5ccfbf-2717-4eb8-866c-3e56e15a927c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2facc5135584d808aae81352145bb78', 'request_id': 'req-3f5ccfbf-2717-4eb8-866c-3e56e15a927c'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:23.406293 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-7832818d-2c05-40e3-887b-5685c84d6dfd None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:23.409683 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-3f5ccfbf-2717-4eb8-866c-3e56e15a927c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2facc5135584d808aae81352145bb78', 'request_id': 'req-3f5ccfbf-2717-4eb8-866c-3e56e15a927c'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:23.413008 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-7832818d-2c05-40e3-887b-5685c84d6dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:23.420125 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-3f5ccfbf-2717-4eb8-866c-3e56e15a927c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2facc5135584d808aae81352145bb78', 'request_id': 'req-3f5ccfbf-2717-4eb8-866c-3e56e15a927c'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:23.456468 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-3f5ccfbf-2717-4eb8-866c-3e56e15a927c admin admin] The token cache is being invalidate because project b2facc5135584d808aae81352145bb78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:16:23.456845 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-3f5ccfbf-2717-4eb8-866c-3e56e15a927c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:23.459997 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-3f5ccfbf-2717-4eb8-866c-3e56e15a927c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:23.465977 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 926/1883] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:16:23 2022] DELETE /identity/v3/projects/b2facc5135584d808aae81352145bb78 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:16:23.470648 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc4503-b85c-4a12-9c2d-428f7b00bb22 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:23.470920 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc4503-b85c-4a12-9c2d-428f7b00bb22 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:23.471197 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc4503-b85c-4a12-9c2d-428f7b00bb22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:23.524241 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-aabc4503-b85c-4a12-9c2d-428f7b00bb22 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:23.526365 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-aabc4503-b85c-4a12-9c2d-428f7b00bb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:23.547889 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 958/1884] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:16:23.552139 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832818d-2c05-40e3-887b-5685c84d6dfd None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:23.553460 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 927/1885] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:16:23.562214 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084910c-f7ea-4b45-8cd7-24b7849b9d5e None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:23.562502 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084910c-f7ea-4b45-8cd7-24b7849b9d5e None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:23.562778 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084910c-f7ea-4b45-8cd7-24b7849b9d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:23.568449 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832818d-2c05-40e3-887b-5685c84d6dfd None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:23.574071 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe00019-758d-4db4-894a-aace873cd4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:23.575085 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe00019-758d-4db4-894a-aace873cd4c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:23.575676 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe00019-758d-4db4-894a-aace873cd4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:23.576055 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe00019-758d-4db4-894a-aace873cd4c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:23.577370 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe00019-758d-4db4-894a-aace873cd4c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:16:23.577782 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe00019-758d-4db4-894a-aace873cd4c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:23.579672 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe00019-758d-4db4-894a-aace873cd4c6 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:23.587014 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-b084910c-f7ea-4b45-8cd7-24b7849b9d5e None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:23.588283 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-b084910c-f7ea-4b45-8cd7-24b7849b9d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:23.596415 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 959/1886] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:16:23.602177 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 928/1887] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:16:23.603243 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084910c-f7ea-4b45-8cd7-24b7849b9d5e None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:23.604811 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe00019-758d-4db4-894a-aace873cd4c6 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:23.615873 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084910c-f7ea-4b45-8cd7-24b7849b9d5e None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:23.622514 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf09db-782e-4eed-8562-078dc6015497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:23.623418 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf09db-782e-4eed-8562-078dc6015497 admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:23.623872 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf09db-782e-4eed-8562-078dc6015497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:23.624152 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf09db-782e-4eed-8562-078dc6015497 admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:23.625233 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf09db-782e-4eed-8562-078dc6015497 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:23.627677 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf09db-782e-4eed-8562-078dc6015497 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:23.634991 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe00019-758d-4db4-894a-aace873cd4c6 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:23.650245 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2a7eb-76f8-4b53-8351-31c67d8020f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:23.651189 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2a7eb-76f8-4b53-8351-31c67d8020f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:23.654778 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2a7eb-76f8-4b53-8351-31c67d8020f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:23.655199 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2a7eb-76f8-4b53-8351-31c67d8020f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:23.656204 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd2a7eb-76f8-4b53-8351-31c67d8020f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:16:23.656642 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd2a7eb-76f8-4b53-8351-31c67d8020f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:23.661324 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd2a7eb-76f8-4b53-8351-31c67d8020f5 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:23.666161 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 929/1888] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:16:23 2022] POST /identity/v3/projects => generated 393 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:16:23.670603 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf09db-782e-4eed-8562-078dc6015497 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:23.691183 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:23.713929 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 960/1889] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:16:23.716759 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2a7eb-76f8-4b53-8351-31c67d8020f5 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:23.733228 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:23.745882 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2a7eb-76f8-4b53-8351-31c67d8020f5 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:23.870161 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf09db-782e-4eed-8562-078dc6015497 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:23.883144 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade38c9-318b-48d0-bb40-8f39541640f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:23.884411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade38c9-318b-48d0-bb40-8f39541640f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:23.884691 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade38c9-318b-48d0-bb40-8f39541640f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:23.885313 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade38c9-318b-48d0-bb40-8f39541640f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:23.888162 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade38c9-318b-48d0-bb40-8f39541640f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:23.894600 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade38c9-318b-48d0-bb40-8f39541640f3 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:23.929530 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb7b1a-c20e-4dc0-b441-037e34f5626e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:23.930213 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb7b1a-c20e-4dc0-b441-037e34f5626e admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:23.930609 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb7b1a-c20e-4dc0-b441-037e34f5626e admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:23.930888 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb7b1a-c20e-4dc0-b441-037e34f5626e admin admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:23.931686 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcb7b1a-c20e-4dc0-b441-037e34f5626e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:23.934850 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcb7b1a-c20e-4dc0-b441-037e34f5626e admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:23.953971 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 930/1890] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:16:23 2022] POST /identity/v3/users => generated 297 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:16:23.959978 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade38c9-318b-48d0-bb40-8f39541640f3 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:23.972650 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade38c9-318b-48d0-bb40-8f39541640f3 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:23.978084 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab8060-b9e9-499f-be2a-5e9e98e90afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:23.978882 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab8060-b9e9-499f-be2a-5e9e98e90afb admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:23.979164 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab8060-b9e9-499f-be2a-5e9e98e90afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:23.979437 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab8060-b9e9-499f-be2a-5e9e98e90afb admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:23.980353 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab8060-b9e9-499f-be2a-5e9e98e90afb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:23.982352 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab8060-b9e9-499f-be2a-5e9e98e90afb admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:23.995911 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 931/1891] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:16:24.001071 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab8060-b9e9-499f-be2a-5e9e98e90afb admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:24.007047 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 961/1892] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:16:23 2022] POST /identity/v3/projects => generated 391 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:16:24.011665 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb7b1a-c20e-4dc0-b441-037e34f5626e admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:24.016639 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab8060-b9e9-499f-be2a-5e9e98e90afb admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:24.107641 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936667e-5675-4c30-b114-9f1b37a4c8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:24.108509 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936667e-5675-4c30-b114-9f1b37a4c8c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:24.108791 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936667e-5675-4c30-b114-9f1b37a4c8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:24.109062 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936667e-5675-4c30-b114-9f1b37a4c8c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:24.109930 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8936667e-5675-4c30-b114-9f1b37a4c8c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:24.112664 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8936667e-5675-4c30-b114-9f1b37a4c8c1 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:24.139694 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 932/1893] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:16:24.144011 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936667e-5675-4c30-b114-9f1b37a4c8c1 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:24.156670 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb7b1a-c20e-4dc0-b441-037e34f5626e admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:24.160353 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936667e-5675-4c30-b114-9f1b37a4c8c1 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:24.166973 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ae2d4-9acb-41c2-a09a-ac1e752acb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:24.167959 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ae2d4-9acb-41c2-a09a-ac1e752acb9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:24.168730 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ae2d4-9acb-41c2-a09a-ac1e752acb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:24.168730 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ae2d4-9acb-41c2-a09a-ac1e752acb9e admin admin] PATH_INFO: `/v3/projects/729e0f23cbb64fc3acfa447d6cf815b7/users/e4bf470af5d642a4b3ef5eaefe72e6b8/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:24.170796 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83ed7f-f21b-4cb4-b289-30b1f16f7ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:24.171645 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83ed7f-f21b-4cb4-b289-30b1f16f7ae1 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:24.172089 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83ed7f-f21b-4cb4-b289-30b1f16f7ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:24.172504 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83ed7f-f21b-4cb4-b289-30b1f16f7ae1 admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:24.173359 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce83ed7f-f21b-4cb4-b289-30b1f16f7ae1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:24.175584 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce83ed7f-f21b-4cb4-b289-30b1f16f7ae1 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:24.196269 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ae2d4-9acb-41c2-a09a-ac1e752acb9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=729e0f23cbb64fc3acfa447d6cf815b7, user_id=e4bf470af5d642a4b3ef5eaefe72e6b8, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:24.205580 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ae2d4-9acb-41c2-a09a-ac1e752acb9e admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:24.221110 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 962/1894] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:16:24 2022] POST /identity/v3/users => generated 296 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:16:24.225356 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83ed7f-f21b-4cb4-b289-30b1f16f7ae1 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:24.238015 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83ed7f-f21b-4cb4-b289-30b1f16f7ae1 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:24.243616 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 933/1895] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:16:24 2022] PUT /identity/v3/projects/729e0f23cbb64fc3acfa447d6cf815b7/users/e4bf470af5d642a4b3ef5eaefe72e6b8/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:16:24.255726 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1fa7e7-b210-4792-964b-3a35b0a417bf None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:24.255901 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1fa7e7-b210-4792-964b-3a35b0a417bf None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:24.256253 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1fa7e7-b210-4792-964b-3a35b0a417bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:24.292766 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-6a1fa7e7-b210-4792-964b-3a35b0a417bf None None] MFA Rules not processed for user `e4bf470af5d642a4b3ef5eaefe72e6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:24.294260 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-6a1fa7e7-b210-4792-964b-3a35b0a417bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:24.306755 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427c09d-11a3-463d-8d83-7e617a77529c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:24.311346 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427c09d-11a3-463d-8d83-7e617a77529c admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:24.312426 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427c09d-11a3-463d-8d83-7e617a77529c admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:24.312834 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427c09d-11a3-463d-8d83-7e617a77529c admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:24.313965 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3427c09d-11a3-463d-8d83-7e617a77529c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:24.316121 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3427c09d-11a3-463d-8d83-7e617a77529c admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:24.329932 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 963/1896] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:16:24.335830 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427c09d-11a3-463d-8d83-7e617a77529c admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:24.351262 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427c09d-11a3-463d-8d83-7e617a77529c admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:24.357051 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ebbe4b-191a-4ad6-925d-118b38cfd302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:24.357692 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebbe4b-191a-4ad6-925d-118b38cfd302 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:24.357982 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebbe4b-191a-4ad6-925d-118b38cfd302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:24.358279 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebbe4b-191a-4ad6-925d-118b38cfd302 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:24.358994 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ebbe4b-191a-4ad6-925d-118b38cfd302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:24.376360 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ebbe4b-191a-4ad6-925d-118b38cfd302 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:24.385522 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:24.400956 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 934/1897] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:16:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:16:24.409134 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1fa7e7-b210-4792-964b-3a35b0a417bf None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:24.409469 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 964/1898] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:16:24.421339 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1fa7e7-b210-4792-964b-3a35b0a417bf None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:24.425915 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e2ac56-d06c-49e8-afde-e0f8c956b66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:24.427191 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2ac56-d06c-49e8-afde-e0f8c956b66f admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:24.427473 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2ac56-d06c-49e8-afde-e0f8c956b66f admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:24.427778 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2ac56-d06c-49e8-afde-e0f8c956b66f admin admin] PATH_INFO: `/v3/projects/6a0655e94f8d44029a9d51000306250e/users/0ae5cf6b76df4130b4cc9c8b0f3f95d7/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:24.442991 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ebbe4b-191a-4ad6-925d-118b38cfd302 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:24.444933 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-23ebbe4b-191a-4ad6-925d-118b38cfd302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:24.453474 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:24.459966 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e2ac56-d06c-49e8-afde-e0f8c956b66f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a0655e94f8d44029a9d51000306250e, user_id=0ae5cf6b76df4130b4cc9c8b0f3f95d7, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:24.464569 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e2ac56-d06c-49e8-afde-e0f8c956b66f admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:24.494318 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 935/1899] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:16:24 2022] PUT /identity/v3/projects/6a0655e94f8d44029a9d51000306250e/users/0ae5cf6b76df4130b4cc9c8b0f3f95d7/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:16:24.496219 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6cf76-92e9-4043-ae1a-022829dbc035 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:24.496501 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6cf76-92e9-4043-ae1a-022829dbc035 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:24.496852 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6cf76-92e9-4043-ae1a-022829dbc035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:24.538073 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ebbe4b-191a-4ad6-925d-118b38cfd302 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:24.545623 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-26b6cf76-92e9-4043-ae1a-022829dbc035 None None] MFA Rules not processed for user `0ae5cf6b76df4130b4cc9c8b0f3f95d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:24.547550 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-26b6cf76-92e9-4043-ae1a-022829dbc035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:24.645250 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 936/1900] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:16:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:16:24.660085 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b118a-0de0-4cbd-9f4d-be2f5a93ac02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:24.661165 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b118a-0de0-4cbd-9f4d-be2f5a93ac02 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:24.661165 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b118a-0de0-4cbd-9f4d-be2f5a93ac02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:24.661615 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b118a-0de0-4cbd-9f4d-be2f5a93ac02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:24.661843 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6cf76-92e9-4043-ae1a-022829dbc035 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:24.691816 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6cf76-92e9-4043-ae1a-022829dbc035 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:24.698592 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc883b3-a3a4-425a-8ad3-85e74367ef07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:24.699401 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc883b3-a3a4-425a-8ad3-85e74367ef07 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:24.699855 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc883b3-a3a4-425a-8ad3-85e74367ef07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:24.700228 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc883b3-a3a4-425a-8ad3-85e74367ef07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:24.712298 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc883b3-a3a4-425a-8ad3-85e74367ef07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:24.715194 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc883b3-a3a4-425a-8ad3-85e74367ef07 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:24.725391 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 937/1901] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:16:24 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:16:24.761871 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b118a-0de0-4cbd-9f4d-be2f5a93ac02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:24.762711 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc883b3-a3a4-425a-8ad3-85e74367ef07 service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:24.764874 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b118a-0de0-4cbd-9f4d-be2f5a93ac02 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:24.777453 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 965/1902] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:16:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:16:24.855132 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc883b3-a3a4-425a-8ad3-85e74367ef07 service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:24.861428 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc6090-cfde-4673-bcb5-36b8ebe0c801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:24.862343 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc6090-cfde-4673-bcb5-36b8ebe0c801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:24.863770 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc6090-cfde-4673-bcb5-36b8ebe0c801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:24.864226 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc6090-cfde-4673-bcb5-36b8ebe0c801 admin admin] PATH_INFO: `/v3/users/0ae5cf6b76df4130b4cc9c8b0f3f95d7` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:24.866830 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbc6090-cfde-4673-bcb5-36b8ebe0c801 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ae5cf6b76df4130b4cc9c8b0f3f95d7)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:24.871197 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbc6090-cfde-4673-bcb5-36b8ebe0c801 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:24.927955 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-dbbc6090-cfde-4673-bcb5-36b8ebe0c801 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ae5cf6b76df4130b4cc9c8b0f3f95d7'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:24.928745 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-dbbc6090-cfde-4673-bcb5-36b8ebe0c801 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ae5cf6b76df4130b4cc9c8b0f3f95d7'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:24.929954 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:24.949048 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-dbbc6090-cfde-4673-bcb5-36b8ebe0c801 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ae5cf6b76df4130b4cc9c8b0f3f95d7'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:24.959903 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-dbbc6090-cfde-4673-bcb5-36b8ebe0c801 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ae5cf6b76df4130b4cc9c8b0f3f95d7'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:24.960623 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-dbbc6090-cfde-4673-bcb5-36b8ebe0c801 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ae5cf6b76df4130b4cc9c8b0f3f95d7'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:24.979539 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 938/1903] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:16:24 2022] DELETE /identity/v3/users/0ae5cf6b76df4130b4cc9c8b0f3f95d7 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:16:24.981021 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de567c-c732-40fb-850f-8be8f5950cae None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:24.981405 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de567c-c732-40fb-850f-8be8f5950cae None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:24.981752 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de567c-c732-40fb-850f-8be8f5950cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:25.001996 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-c9de567c-c732-40fb-850f-8be8f5950cae None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:25.003230 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-c9de567c-c732-40fb-850f-8be8f5950cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:25.100898 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 966/1904] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:16:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:16:25.126113 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc6090-cfde-4673-bcb5-36b8ebe0c801 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:25.127851 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-dbbc6090-cfde-4673-bcb5-36b8ebe0c801 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:25.209448 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc6090-cfde-4673-bcb5-36b8ebe0c801 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:25.216552 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08ca9c6-c681-41d0-8114-32327f1962bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:25.217396 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ca9c6-c681-41d0-8114-32327f1962bb service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:25.217948 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ca9c6-c681-41d0-8114-32327f1962bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:25.219717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ca9c6-c681-41d0-8114-32327f1962bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:25.250792 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08ca9c6-c681-41d0-8114-32327f1962bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:25.253088 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08ca9c6-c681-41d0-8114-32327f1962bb service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:25.274530 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 939/1905] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:16:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:16:26.876298 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de567c-c732-40fb-850f-8be8f5950cae None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:26.878462 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-c9de567c-c732-40fb-850f-8be8f5950cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:26.892776 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de567c-c732-40fb-850f-8be8f5950cae None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:26.898205 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a552b9ae-1b39-4ef1-9d3a-a8ec75ac6f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:26.899782 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552b9ae-1b39-4ef1-9d3a-a8ec75ac6f7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:26.900082 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552b9ae-1b39-4ef1-9d3a-a8ec75ac6f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:26.900504 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552b9ae-1b39-4ef1-9d3a-a8ec75ac6f7d admin admin] PATH_INFO: `/v3/projects/6a0655e94f8d44029a9d51000306250e` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:26.901893 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a552b9ae-1b39-4ef1-9d3a-a8ec75ac6f7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a0655e94f8d44029a9d51000306250e)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:26.904385 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a552b9ae-1b39-4ef1-9d3a-a8ec75ac6f7d admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:26.918685 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:26.976268 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-a552b9ae-1b39-4ef1-9d3a-a8ec75ac6f7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a0655e94f8d44029a9d51000306250e', 'request_id': 'req-a552b9ae-1b39-4ef1-9d3a-a8ec75ac6f7d'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:26.984813 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-a552b9ae-1b39-4ef1-9d3a-a8ec75ac6f7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a0655e94f8d44029a9d51000306250e', 'request_id': 'req-a552b9ae-1b39-4ef1-9d3a-a8ec75ac6f7d'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:26.994311 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-a552b9ae-1b39-4ef1-9d3a-a8ec75ac6f7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a0655e94f8d44029a9d51000306250e', 'request_id': 'req-a552b9ae-1b39-4ef1-9d3a-a8ec75ac6f7d'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:27.015400 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-a552b9ae-1b39-4ef1-9d3a-a8ec75ac6f7d admin admin] The token cache is being invalidate because project 6a0655e94f8d44029a9d51000306250e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:16:27.015991 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-a552b9ae-1b39-4ef1-9d3a-a8ec75ac6f7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:27.017024 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-a552b9ae-1b39-4ef1-9d3a-a8ec75ac6f7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:27.024866 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 967/1906] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:16:26 2022] DELETE /identity/v3/projects/6a0655e94f8d44029a9d51000306250e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:16:27.026173 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c20ec1-a845-47b6-854b-13894b2bf0fc None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:27.027246 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c20ec1-a845-47b6-854b-13894b2bf0fc None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:27.028091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c20ec1-a845-47b6-854b-13894b2bf0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:27.105808 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-a1c20ec1-a845-47b6-854b-13894b2bf0fc None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:27.108496 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-a1c20ec1-a845-47b6-854b-13894b2bf0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:27.297415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 940/1907] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:16:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:16:27.306897 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e4c70-73ac-408d-913f-7ca11e0212d4 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:27.307757 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e4c70-73ac-408d-913f-7ca11e0212d4 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:27.308763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e4c70-73ac-408d-913f-7ca11e0212d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:27.335238 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-308e4c70-73ac-408d-913f-7ca11e0212d4 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:27.336727 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-308e4c70-73ac-408d-913f-7ca11e0212d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:27.377693 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 968/1908] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:16:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:16:27.382210 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c20ec1-a845-47b6-854b-13894b2bf0fc None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:27.398946 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c20ec1-a845-47b6-854b-13894b2bf0fc None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:27.422702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50b963-f2da-41da-abad-64b3a7316e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:27.424042 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50b963-f2da-41da-abad-64b3a7316e91 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:27.425517 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50b963-f2da-41da-abad-64b3a7316e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:27.429258 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50b963-f2da-41da-abad-64b3a7316e91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:27.431050 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50b963-f2da-41da-abad-64b3a7316e91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:16:27.431469 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50b963-f2da-41da-abad-64b3a7316e91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:27.447043 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50b963-f2da-41da-abad-64b3a7316e91 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:27.487762 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 941/1909] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:16:27.492888 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e4c70-73ac-408d-913f-7ca11e0212d4 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:27.511751 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e4c70-73ac-408d-913f-7ca11e0212d4 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:27.520169 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbedd9d-fc8a-4742-b325-fb0b103a7886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:27.520861 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbedd9d-fc8a-4742-b325-fb0b103a7886 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:27.521401 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbedd9d-fc8a-4742-b325-fb0b103a7886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:27.521840 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbedd9d-fc8a-4742-b325-fb0b103a7886 admin admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:27.522699 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbedd9d-fc8a-4742-b325-fb0b103a7886 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:27.524890 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbedd9d-fc8a-4742-b325-fb0b103a7886 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:27.575397 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 969/1910] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:16:27 2022] POST /identity/v3/projects => generated 373 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:16:27.579587 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50b963-f2da-41da-abad-64b3a7316e91 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:27.591794 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50b963-f2da-41da-abad-64b3a7316e91 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:27.681662 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:27.693289 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c160e4-f4a9-49be-bc9b-a02be5f466ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:27.694890 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c160e4-f4a9-49be-bc9b-a02be5f466ba admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:27.697277 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c160e4-f4a9-49be-bc9b-a02be5f466ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:27.697664 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c160e4-f4a9-49be-bc9b-a02be5f466ba admin admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:27.698460 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c160e4-f4a9-49be-bc9b-a02be5f466ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:27.702419 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c160e4-f4a9-49be-bc9b-a02be5f466ba admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:27.741334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 942/1911] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:16:27 2022] POST /identity/v3/users => generated 287 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:16:27.745019 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbedd9d-fc8a-4742-b325-fb0b103a7886 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:27.758464 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbedd9d-fc8a-4742-b325-fb0b103a7886 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:27.764566 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1b587-d39a-4b3b-9e85-d1436784bf7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:27.765975 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1b587-d39a-4b3b-9e85-d1436784bf7f admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:27.766250 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1b587-d39a-4b3b-9e85-d1436784bf7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:27.766514 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1b587-d39a-4b3b-9e85-d1436784bf7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:27.767965 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc1b587-d39a-4b3b-9e85-d1436784bf7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:27.770117 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc1b587-d39a-4b3b-9e85-d1436784bf7f admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:27.785413 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 970/1912] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:16:27.786714 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c160e4-f4a9-49be-bc9b-a02be5f466ba admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:27.805211 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c160e4-f4a9-49be-bc9b-a02be5f466ba admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:27.811700 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ddb3e1-a2d0-41ab-906a-79188e08f7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:27.812588 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ddb3e1-a2d0-41ab-906a-79188e08f7cd admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:27.813147 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ddb3e1-a2d0-41ab-906a-79188e08f7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:27.813567 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ddb3e1-a2d0-41ab-906a-79188e08f7cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:27.815227 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ddb3e1-a2d0-41ab-906a-79188e08f7cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:27.817350 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ddb3e1-a2d0-41ab-906a-79188e08f7cd admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:27.838358 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 943/1913] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:16:27.840513 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1b587-d39a-4b3b-9e85-d1436784bf7f admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:27.854140 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1b587-d39a-4b3b-9e85-d1436784bf7f admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:27.862978 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc3def-3027-41f5-950e-4d687eb91c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:27.863858 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc3def-3027-41f5-950e-4d687eb91c66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:27.864134 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc3def-3027-41f5-950e-4d687eb91c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:27.864405 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc3def-3027-41f5-950e-4d687eb91c66 admin admin] PATH_INFO: `/v3/projects/0d2143b16ec24dfb8a3aec58b4dee90a/users/7d2c02fcf92d481b8db3e4ee9ed475ed/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:27.887185 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc3def-3027-41f5-950e-4d687eb91c66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d2143b16ec24dfb8a3aec58b4dee90a, user_id=7d2c02fcf92d481b8db3e4ee9ed475ed, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:27.892053 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc3def-3027-41f5-950e-4d687eb91c66 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:27.931543 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 971/1914] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:16:27 2022] PUT /identity/v3/projects/0d2143b16ec24dfb8a3aec58b4dee90a/users/7d2c02fcf92d481b8db3e4ee9ed475ed/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:16:27.941722 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e988d-c27f-45be-beba-b34b7a85c260 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:27.942010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e988d-c27f-45be-beba-b34b7a85c260 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:27.942288 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e988d-c27f-45be-beba-b34b7a85c260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:28.008222 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-3f1e988d-c27f-45be-beba-b34b7a85c260 None None] MFA Rules not processed for user `7d2c02fcf92d481b8db3e4ee9ed475ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:28.011780 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-3f1e988d-c27f-45be-beba-b34b7a85c260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:28.188920 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 944/1915] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:16:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:16:28.261564 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc3def-3027-41f5-950e-4d687eb91c66 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:28.269248 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-95dc3def-3027-41f5-950e-4d687eb91c66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:28.411930 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc3def-3027-41f5-950e-4d687eb91c66 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:28.417166 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b08cd0-2546-4d8a-851d-c2a228aec8dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:28.417848 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b08cd0-2546-4d8a-851d-c2a228aec8dc service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:28.418121 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b08cd0-2546-4d8a-851d-c2a228aec8dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:28.418422 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b08cd0-2546-4d8a-851d-c2a228aec8dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:28.432717 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b08cd0-2546-4d8a-851d-c2a228aec8dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:28.434267 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b08cd0-2546-4d8a-851d-c2a228aec8dc service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:28.452483 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 972/1916] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:16:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:16:38.162330 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=41,keystone:INSERT=3 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:38.446869 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=73,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:38.682261 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e988d-c27f-45be-beba-b34b7a85c260 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:38.684107 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-3f1e988d-c27f-45be-beba-b34b7a85c260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:38.766667 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e988d-c27f-45be-beba-b34b7a85c260 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:38.773474 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154577e-1823-4d17-b051-79ca940c737f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:38.774473 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154577e-1823-4d17-b051-79ca940c737f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:38.775002 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154577e-1823-4d17-b051-79ca940c737f admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:38.775569 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154577e-1823-4d17-b051-79ca940c737f admin admin] PATH_INFO: `/v3/users/e4bf470af5d642a4b3ef5eaefe72e6b8` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:38.777107 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154577e-1823-4d17-b051-79ca940c737f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4bf470af5d642a4b3ef5eaefe72e6b8)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:38.779577 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154577e-1823-4d17-b051-79ca940c737f admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:38.862633 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-e154577e-1823-4d17-b051-79ca940c737f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4bf470af5d642a4b3ef5eaefe72e6b8'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:38.864220 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-e154577e-1823-4d17-b051-79ca940c737f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4bf470af5d642a4b3ef5eaefe72e6b8'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:38.881418 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-e154577e-1823-4d17-b051-79ca940c737f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4bf470af5d642a4b3ef5eaefe72e6b8'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:38.894128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-e154577e-1823-4d17-b051-79ca940c737f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4bf470af5d642a4b3ef5eaefe72e6b8'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:38.894128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-e154577e-1823-4d17-b051-79ca940c737f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4bf470af5d642a4b3ef5eaefe72e6b8'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:38.922632 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 945/1917] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:16:38 2022] DELETE /identity/v3/users/e4bf470af5d642a4b3ef5eaefe72e6b8 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:16:38.927458 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f98c9-874a-4e49-ab48-2025438c1aed None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:38.927736 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f98c9-874a-4e49-ab48-2025438c1aed None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:38.928034 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f98c9-874a-4e49-ab48-2025438c1aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:38.950993 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-9a4f98c9-874a-4e49-ab48-2025438c1aed None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:38.952371 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-9a4f98c9-874a-4e49-ab48-2025438c1aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:39.020216 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 973/1918] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:16:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:16:39.043153 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154577e-1823-4d17-b051-79ca940c737f admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:39.045180 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-e154577e-1823-4d17-b051-79ca940c737f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:39.121589 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154577e-1823-4d17-b051-79ca940c737f admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:39.126366 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf3849-39f7-4bde-a606-e39069c8d8ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:39.126854 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf3849-39f7-4bde-a606-e39069c8d8ab service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:39.127281 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf3849-39f7-4bde-a606-e39069c8d8ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:39.127591 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf3849-39f7-4bde-a606-e39069c8d8ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:39.138616 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf3849-39f7-4bde-a606-e39069c8d8ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:39.140139 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf3849-39f7-4bde-a606-e39069c8d8ab service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:39.151063 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 946/1919] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:16:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:16:40.280458 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f98c9-874a-4e49-ab48-2025438c1aed None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:40.282007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-9a4f98c9-874a-4e49-ab48-2025438c1aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:40.297127 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f98c9-874a-4e49-ab48-2025438c1aed None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:40.301938 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3187993-2130-49b2-a32d-e041afc6dbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:40.302664 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3187993-2130-49b2-a32d-e041afc6dbbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:40.303001 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3187993-2130-49b2-a32d-e041afc6dbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:40.303801 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3187993-2130-49b2-a32d-e041afc6dbbb admin admin] PATH_INFO: `/v3/projects/729e0f23cbb64fc3acfa447d6cf815b7` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:40.305179 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3187993-2130-49b2-a32d-e041afc6dbbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=729e0f23cbb64fc3acfa447d6cf815b7)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:40.307285 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3187993-2130-49b2-a32d-e041afc6dbbb admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:40.420494 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-b3187993-2130-49b2-a32d-e041afc6dbbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '729e0f23cbb64fc3acfa447d6cf815b7', 'request_id': 'req-b3187993-2130-49b2-a32d-e041afc6dbbb'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:40.427004 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-b3187993-2130-49b2-a32d-e041afc6dbbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '729e0f23cbb64fc3acfa447d6cf815b7', 'request_id': 'req-b3187993-2130-49b2-a32d-e041afc6dbbb'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:40.434867 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-b3187993-2130-49b2-a32d-e041afc6dbbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '729e0f23cbb64fc3acfa447d6cf815b7', 'request_id': 'req-b3187993-2130-49b2-a32d-e041afc6dbbb'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:40.454786 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-b3187993-2130-49b2-a32d-e041afc6dbbb admin admin] The token cache is being invalidate because project 729e0f23cbb64fc3acfa447d6cf815b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:16:40.455104 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-b3187993-2130-49b2-a32d-e041afc6dbbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:40.455784 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-b3187993-2130-49b2-a32d-e041afc6dbbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:40.464289 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 974/1920] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:16:40 2022] DELETE /identity/v3/projects/729e0f23cbb64fc3acfa447d6cf815b7 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:16:40.465653 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e051b-e923-4496-95bc-d16afac3d353 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:40.466198 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e051b-e923-4496-95bc-d16afac3d353 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:40.466198 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e051b-e923-4496-95bc-d16afac3d353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:40.486961 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-138e051b-e923-4496-95bc-d16afac3d353 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:40.488276 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-138e051b-e923-4496-95bc-d16afac3d353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:40.510814 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:40.568550 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 947/1921] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:16:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:16:40.570499 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f48b1f-2438-4d26-97b2-b847bd82cc5a None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:40.570872 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f48b1f-2438-4d26-97b2-b847bd82cc5a None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:40.571156 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f48b1f-2438-4d26-97b2-b847bd82cc5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:40.595459 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-90f48b1f-2438-4d26-97b2-b847bd82cc5a None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:40.597241 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-90f48b1f-2438-4d26-97b2-b847bd82cc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:40.610553 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 975/1922] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:16:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:16:40.615389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e051b-e923-4496-95bc-d16afac3d353 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:40.628603 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e051b-e923-4496-95bc-d16afac3d353 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:40.636968 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a499b-eef7-476e-8277-51900a47758e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:40.638067 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a499b-eef7-476e-8277-51900a47758e admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:40.638959 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a499b-eef7-476e-8277-51900a47758e admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:40.639090 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a499b-eef7-476e-8277-51900a47758e admin admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:40.640033 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a499b-eef7-476e-8277-51900a47758e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:16:40.640676 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a499b-eef7-476e-8277-51900a47758e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:40.642526 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a499b-eef7-476e-8277-51900a47758e admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:40.662173 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f48b1f-2438-4d26-97b2-b847bd82cc5a None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:40.667398 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 948/1923] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:16:40.674724 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f48b1f-2438-4d26-97b2-b847bd82cc5a None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:40.681116 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66e21c-89c7-4439-ac43-8aef7824b5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:40.681745 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66e21c-89c7-4439-ac43-8aef7824b5b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:40.682023 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66e21c-89c7-4439-ac43-8aef7824b5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:40.682294 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66e21c-89c7-4439-ac43-8aef7824b5b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:40.683021 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e66e21c-89c7-4439-ac43-8aef7824b5b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:40.685073 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e66e21c-89c7-4439-ac43-8aef7824b5b4 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:40.725877 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a499b-eef7-476e-8277-51900a47758e admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:40.739408 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 976/1924] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:16:40 2022] POST /identity/v3/projects => generated 385 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:16:40.741332 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a499b-eef7-476e-8277-51900a47758e admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:40.813465 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d2179-d269-4160-9bb6-a4391cc327bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:40.814218 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d2179-d269-4160-9bb6-a4391cc327bc admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:40.814558 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d2179-d269-4160-9bb6-a4391cc327bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:40.814939 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d2179-d269-4160-9bb6-a4391cc327bc admin admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:40.815881 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d2179-d269-4160-9bb6-a4391cc327bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:40.818664 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d2179-d269-4160-9bb6-a4391cc327bc admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:40.847665 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 949/1925] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:16:40 2022] POST /identity/v3/users => generated 293 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:16:40.850960 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66e21c-89c7-4439-ac43-8aef7824b5b4 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:40.862671 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66e21c-89c7-4439-ac43-8aef7824b5b4 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:40.867545 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76868ff-880e-473a-8c55-62147dbdcc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:40.868211 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76868ff-880e-473a-8c55-62147dbdcc0f admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:40.868484 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76868ff-880e-473a-8c55-62147dbdcc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:40.869075 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76868ff-880e-473a-8c55-62147dbdcc0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:40.870530 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76868ff-880e-473a-8c55-62147dbdcc0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:40.872894 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76868ff-880e-473a-8c55-62147dbdcc0f admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:40.889902 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 977/1926] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:16:40.891132 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d2179-d269-4160-9bb6-a4391cc327bc admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:40.903712 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d2179-d269-4160-9bb6-a4391cc327bc admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:40.909059 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b738b-13bb-4ad0-95bf-6233f1cae440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:40.910035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b738b-13bb-4ad0-95bf-6233f1cae440 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:40.910321 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b738b-13bb-4ad0-95bf-6233f1cae440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:40.910601 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b738b-13bb-4ad0-95bf-6233f1cae440 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:40.911297 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b738b-13bb-4ad0-95bf-6233f1cae440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:40.912960 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b738b-13bb-4ad0-95bf-6233f1cae440 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:40.933462 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 950/1927] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:16:40.934659 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76868ff-880e-473a-8c55-62147dbdcc0f admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:40.948594 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76868ff-880e-473a-8c55-62147dbdcc0f admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:40.955180 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82afacd8-c4fd-419c-96ad-8e9363f69236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:40.956323 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82afacd8-c4fd-419c-96ad-8e9363f69236 admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:40.956323 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82afacd8-c4fd-419c-96ad-8e9363f69236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:40.956546 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82afacd8-c4fd-419c-96ad-8e9363f69236 admin admin] PATH_INFO: `/v3/projects/e9ed1fa6d2294d20b0029fbf4928fc05/users/e00cb734489b43b6943ab435b6f15828/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:40.974706 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82afacd8-c4fd-419c-96ad-8e9363f69236 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9ed1fa6d2294d20b0029fbf4928fc05, user_id=e00cb734489b43b6943ab435b6f15828, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:40.977065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82afacd8-c4fd-419c-96ad-8e9363f69236 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:41.009234 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 978/1928] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:16:40 2022] PUT /identity/v3/projects/e9ed1fa6d2294d20b0029fbf4928fc05/users/e00cb734489b43b6943ab435b6f15828/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:16:41.021452 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b938f0-11af-4f87-8071-2520bbadd80d None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:41.021841 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b938f0-11af-4f87-8071-2520bbadd80d None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:41.022000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b938f0-11af-4f87-8071-2520bbadd80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:41.073546 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-69b938f0-11af-4f87-8071-2520bbadd80d None None] MFA Rules not processed for user `e00cb734489b43b6943ab435b6f15828`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:41.075638 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-69b938f0-11af-4f87-8071-2520bbadd80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:41.181080 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 951/1929] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:16:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:16:41.217682 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82afacd8-c4fd-419c-96ad-8e9363f69236 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:41.219821 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-82afacd8-c4fd-419c-96ad-8e9363f69236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:41.252274 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:41.302166 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82afacd8-c4fd-419c-96ad-8e9363f69236 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:41.307428 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243cdd0e-16e3-4025-9840-54e1fdb076a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:41.308172 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243cdd0e-16e3-4025-9840-54e1fdb076a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:41.308869 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243cdd0e-16e3-4025-9840-54e1fdb076a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:41.309324 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243cdd0e-16e3-4025-9840-54e1fdb076a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:41.319910 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243cdd0e-16e3-4025-9840-54e1fdb076a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:41.321852 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243cdd0e-16e3-4025-9840-54e1fdb076a6 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:41.332826 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 979/1930] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:16:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:16:46.087039 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b938f0-11af-4f87-8071-2520bbadd80d None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:46.088570 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-69b938f0-11af-4f87-8071-2520bbadd80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:46.119811 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:46.227887 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b938f0-11af-4f87-8071-2520bbadd80d None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:46.239717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9d4fd-8403-4d37-a580-60a1ac134362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:46.241234 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9d4fd-8403-4d37-a580-60a1ac134362 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:46.241882 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9d4fd-8403-4d37-a580-60a1ac134362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:46.242471 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9d4fd-8403-4d37-a580-60a1ac134362 admin admin] PATH_INFO: `/v3/users/75e6d2aeb13145bc8057b7b314d26dcb` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:46.244113 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9d4fd-8403-4d37-a580-60a1ac134362 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75e6d2aeb13145bc8057b7b314d26dcb)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:46.248448 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9d4fd-8403-4d37-a580-60a1ac134362 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:46.324991 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-ffb9d4fd-8403-4d37-a580-60a1ac134362 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75e6d2aeb13145bc8057b7b314d26dcb'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:46.326027 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-ffb9d4fd-8403-4d37-a580-60a1ac134362 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75e6d2aeb13145bc8057b7b314d26dcb'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:46.356977 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-ffb9d4fd-8403-4d37-a580-60a1ac134362 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75e6d2aeb13145bc8057b7b314d26dcb'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:46.373030 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-ffb9d4fd-8403-4d37-a580-60a1ac134362 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75e6d2aeb13145bc8057b7b314d26dcb'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:46.374594 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-ffb9d4fd-8403-4d37-a580-60a1ac134362 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75e6d2aeb13145bc8057b7b314d26dcb'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:46.397160 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 952/1931] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:16:46 2022] DELETE /identity/v3/users/75e6d2aeb13145bc8057b7b314d26dcb => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:16:46.826704 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243cdd0e-16e3-4025-9840-54e1fdb076a6 service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:46.841068 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243cdd0e-16e3-4025-9840-54e1fdb076a6 service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:46.974618 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456a6ef-8f9e-4b02-8e80-d17cef3fc84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:46.975308 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456a6ef-8f9e-4b02-8e80-d17cef3fc84b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:46.975730 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456a6ef-8f9e-4b02-8e80-d17cef3fc84b admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:46.975859 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456a6ef-8f9e-4b02-8e80-d17cef3fc84b admin admin] PATH_INFO: `/v3/projects/595e24c0b8924723b8074676ebfad2e2` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:46.978762 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9456a6ef-8f9e-4b02-8e80-d17cef3fc84b admin admin] RBAC: Authorizing `identity:delete_project(project_id=595e24c0b8924723b8074676ebfad2e2)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:46.981583 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9456a6ef-8f9e-4b02-8e80-d17cef3fc84b admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:47.080376 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-9456a6ef-8f9e-4b02-8e80-d17cef3fc84b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '595e24c0b8924723b8074676ebfad2e2', 'request_id': 'req-9456a6ef-8f9e-4b02-8e80-d17cef3fc84b'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:47.092192 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-9456a6ef-8f9e-4b02-8e80-d17cef3fc84b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '595e24c0b8924723b8074676ebfad2e2', 'request_id': 'req-9456a6ef-8f9e-4b02-8e80-d17cef3fc84b'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:47.106428 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-9456a6ef-8f9e-4b02-8e80-d17cef3fc84b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '595e24c0b8924723b8074676ebfad2e2', 'request_id': 'req-9456a6ef-8f9e-4b02-8e80-d17cef3fc84b'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:47.124385 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-9456a6ef-8f9e-4b02-8e80-d17cef3fc84b admin admin] The token cache is being invalidate because project 595e24c0b8924723b8074676ebfad2e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:16:47.128534 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-9456a6ef-8f9e-4b02-8e80-d17cef3fc84b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:47.129420 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-9456a6ef-8f9e-4b02-8e80-d17cef3fc84b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:47.143236 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 980/1932] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:16:46 2022] DELETE /identity/v3/projects/595e24c0b8924723b8074676ebfad2e2 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:16:47.145956 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9ffd8-368d-4438-b8a1-db75c42bb833 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:47.145956 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9ffd8-368d-4438-b8a1-db75c42bb833 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:47.146605 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9ffd8-368d-4438-b8a1-db75c42bb833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:47.179014 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-1bd9ffd8-368d-4438-b8a1-db75c42bb833 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:47.180322 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-1bd9ffd8-368d-4438-b8a1-db75c42bb833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:47.301921 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 953/1933] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:16:47.304577 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc651a-82c9-41b9-b628-4dda0872090e None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:47.305022 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc651a-82c9-41b9-b628-4dda0872090e None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:47.305462 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc651a-82c9-41b9-b628-4dda0872090e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:47.364825 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-6edc651a-82c9-41b9-b628-4dda0872090e None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:47.368837 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-6edc651a-82c9-41b9-b628-4dda0872090e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:47.398392 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9ffd8-368d-4438-b8a1-db75c42bb833 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:47.404367 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 981/1934] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:16:47.411270 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9ffd8-368d-4438-b8a1-db75c42bb833 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:47.424233 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3eeb74-1f23-4dd4-92a2-a24035103556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:47.424943 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3eeb74-1f23-4dd4-92a2-a24035103556 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:47.425225 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3eeb74-1f23-4dd4-92a2-a24035103556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:47.425503 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3eeb74-1f23-4dd4-92a2-a24035103556 admin admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:47.426235 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3eeb74-1f23-4dd4-92a2-a24035103556 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:16:47.426543 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3eeb74-1f23-4dd4-92a2-a24035103556 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:47.432198 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3eeb74-1f23-4dd4-92a2-a24035103556 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:47.474192 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc651a-82c9-41b9-b628-4dda0872090e None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:47.478438 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 954/1935] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:16:47.488898 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc651a-82c9-41b9-b628-4dda0872090e None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:47.500099 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f7f42-fd4c-452d-8259-2d3fd8b638a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:47.500099 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f7f42-fd4c-452d-8259-2d3fd8b638a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:47.500370 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f7f42-fd4c-452d-8259-2d3fd8b638a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:47.500681 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f7f42-fd4c-452d-8259-2d3fd8b638a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:47.501297 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f7f42-fd4c-452d-8259-2d3fd8b638a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:47.510333 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f7f42-fd4c-452d-8259-2d3fd8b638a4 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:47.595185 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 982/1936] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:16:47 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:16:47.599145 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3eeb74-1f23-4dd4-92a2-a24035103556 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:47.618030 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3eeb74-1f23-4dd4-92a2-a24035103556 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:47.659092 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:47.741634 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a2c6c6-33d7-4fae-b830-68071f71f768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:47.742626 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2c6c6-33d7-4fae-b830-68071f71f768 admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:47.742904 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2c6c6-33d7-4fae-b830-68071f71f768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:47.743758 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2c6c6-33d7-4fae-b830-68071f71f768 admin admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:47.745601 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a2c6c6-33d7-4fae-b830-68071f71f768 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:47.748938 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a2c6c6-33d7-4fae-b830-68071f71f768 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:47.785846 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 955/1937] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:16:47 2022] POST /identity/v3/users => generated 288 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:16:47.790335 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f7f42-fd4c-452d-8259-2d3fd8b638a4 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:47.808723 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f7f42-fd4c-452d-8259-2d3fd8b638a4 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:47.827262 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f1c39-e8db-47f8-a6ca-3e62d33ff690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:47.828193 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f1c39-e8db-47f8-a6ca-3e62d33ff690 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:47.828444 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f1c39-e8db-47f8-a6ca-3e62d33ff690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:47.828785 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f1c39-e8db-47f8-a6ca-3e62d33ff690 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:47.829559 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37f1c39-e8db-47f8-a6ca-3e62d33ff690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:47.831525 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37f1c39-e8db-47f8-a6ca-3e62d33ff690 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:47.844182 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 983/1938] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:16:47.848682 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a2c6c6-33d7-4fae-b830-68071f71f768 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:47.862031 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a2c6c6-33d7-4fae-b830-68071f71f768 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:47.868881 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef17e7-a5c2-40ea-80c5-813134b9f3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:47.868881 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef17e7-a5c2-40ea-80c5-813134b9f3aa admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:47.873799 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef17e7-a5c2-40ea-80c5-813134b9f3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:47.874413 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef17e7-a5c2-40ea-80c5-813134b9f3aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:47.875768 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef17e7-a5c2-40ea-80c5-813134b9f3aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:47.878022 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef17e7-a5c2-40ea-80c5-813134b9f3aa admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:47.913792 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 956/1939] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:16:47.918066 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f1c39-e8db-47f8-a6ca-3e62d33ff690 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:47.932174 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f1c39-e8db-47f8-a6ca-3e62d33ff690 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:47.944837 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a3e89-2880-4cf7-bfb1-c1f6451e30df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:47.946453 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a3e89-2880-4cf7-bfb1-c1f6451e30df admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:47.947017 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a3e89-2880-4cf7-bfb1-c1f6451e30df admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:47.947514 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a3e89-2880-4cf7-bfb1-c1f6451e30df admin admin] PATH_INFO: `/v3/projects/aca40122d4794d9caddc592d498d33a7/users/f8cde6d82dec400f86e9293fb1e94e18/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:47.996718 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:48.006361 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5a3e89-2880-4cf7-bfb1-c1f6451e30df admin admin] RBAC: Authorizing `identity:create_grant(project_id=aca40122d4794d9caddc592d498d33a7, user_id=f8cde6d82dec400f86e9293fb1e94e18, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:48.017300 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5a3e89-2880-4cf7-bfb1-c1f6451e30df admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:48.050941 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 984/1940] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:16:47 2022] PUT /identity/v3/projects/aca40122d4794d9caddc592d498d33a7/users/f8cde6d82dec400f86e9293fb1e94e18/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:16:48.053251 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b6a47-c6a7-4e26-b103-ea749bbfbf48 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:48.053621 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b6a47-c6a7-4e26-b103-ea749bbfbf48 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:48.054037 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b6a47-c6a7-4e26-b103-ea749bbfbf48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:48.122861 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-7b3b6a47-c6a7-4e26-b103-ea749bbfbf48 None None] MFA Rules not processed for user `f8cde6d82dec400f86e9293fb1e94e18`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:48.124997 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-7b3b6a47-c6a7-4e26-b103-ea749bbfbf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:48.211078 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 957/1941] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:16:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:16:48.216494 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a3e89-2880-4cf7-bfb1-c1f6451e30df admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:48.307517 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a3e89-2880-4cf7-bfb1-c1f6451e30df admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:48.314445 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69390f1f-e343-441e-bd05-9fc2d6021c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:48.315218 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69390f1f-e343-441e-bd05-9fc2d6021c7f admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:48.315512 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69390f1f-e343-441e-bd05-9fc2d6021c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:48.316336 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69390f1f-e343-441e-bd05-9fc2d6021c7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:48.317083 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69390f1f-e343-441e-bd05-9fc2d6021c7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:48.319281 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69390f1f-e343-441e-bd05-9fc2d6021c7f admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:48.369566 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b6a47-c6a7-4e26-b103-ea749bbfbf48 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:48.380964 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 985/1942] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:16:48 2022] POST /identity/v3/projects => generated 375 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:16:48.382499 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b6a47-c6a7-4e26-b103-ea749bbfbf48 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:48.482085 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d961e-bff3-4ff8-83bd-800538448dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:48.482864 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d961e-bff3-4ff8-83bd-800538448dff admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:48.483395 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d961e-bff3-4ff8-83bd-800538448dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:48.483759 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d961e-bff3-4ff8-83bd-800538448dff admin admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:48.484515 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d961e-bff3-4ff8-83bd-800538448dff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:48.486536 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d961e-bff3-4ff8-83bd-800538448dff admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:48.520845 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69390f1f-e343-441e-bd05-9fc2d6021c7f admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:48.521046 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 958/1943] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:16:48 2022] POST /identity/v3/users => generated 294 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:16:48.532306 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69390f1f-e343-441e-bd05-9fc2d6021c7f admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:48.537183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17320405-5d18-420f-850c-28900ae398ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:48.538122 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17320405-5d18-420f-850c-28900ae398ea admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:48.538401 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17320405-5d18-420f-850c-28900ae398ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:48.538669 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17320405-5d18-420f-850c-28900ae398ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:48.539394 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17320405-5d18-420f-850c-28900ae398ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:48.541045 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17320405-5d18-420f-850c-28900ae398ea admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:48.558921 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d961e-bff3-4ff8-83bd-800538448dff admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:48.566671 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 986/1944] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:16:48.570874 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d961e-bff3-4ff8-83bd-800538448dff admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:48.577352 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718cfda2-171b-4b49-84a8-84e7a877850e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:48.578056 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718cfda2-171b-4b49-84a8-84e7a877850e admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:48.578423 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718cfda2-171b-4b49-84a8-84e7a877850e admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:48.578750 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718cfda2-171b-4b49-84a8-84e7a877850e admin admin] PATH_INFO: `/v3/projects/9f514112979e45429525ccd47c753612/users/a48b1689bfa4478e8e1341ea9b1a0417/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:48.627349 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718cfda2-171b-4b49-84a8-84e7a877850e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f514112979e45429525ccd47c753612, user_id=a48b1689bfa4478e8e1341ea9b1a0417, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:48.630589 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718cfda2-171b-4b49-84a8-84e7a877850e admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:48.644191 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:48.650638 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 959/1945] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:16:48 2022] PUT /identity/v3/projects/9f514112979e45429525ccd47c753612/users/a48b1689bfa4478e8e1341ea9b1a0417/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:16:48.655070 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17320405-5d18-420f-850c-28900ae398ea admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:48.667460 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17320405-5d18-420f-850c-28900ae398ea admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:48.750301 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da205586-9cba-473c-a171-5d4ac3856811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:48.751439 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da205586-9cba-473c-a171-5d4ac3856811 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:48.751439 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da205586-9cba-473c-a171-5d4ac3856811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:48.751659 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da205586-9cba-473c-a171-5d4ac3856811 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:48.752193 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da205586-9cba-473c-a171-5d4ac3856811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:48.754406 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da205586-9cba-473c-a171-5d4ac3856811 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:48.769739 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 987/1946] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:16:48.771015 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718cfda2-171b-4b49-84a8-84e7a877850e admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:48.787348 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718cfda2-171b-4b49-84a8-84e7a877850e admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:48.799521 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745aef0-e9d6-4d88-be73-8d5bbf39d279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:48.800040 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745aef0-e9d6-4d88-be73-8d5bbf39d279 admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:48.800393 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745aef0-e9d6-4d88-be73-8d5bbf39d279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:48.801581 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745aef0-e9d6-4d88-be73-8d5bbf39d279 admin admin] PATH_INFO: `/v3/projects/9f514112979e45429525ccd47c753612/users/a48b1689bfa4478e8e1341ea9b1a0417/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:48.805928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745aef0-e9d6-4d88-be73-8d5bbf39d279 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f514112979e45429525ccd47c753612, user_id=a48b1689bfa4478e8e1341ea9b1a0417, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:48.809300 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745aef0-e9d6-4d88-be73-8d5bbf39d279 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:48.828522 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 960/1947] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:16:48 2022] PUT /identity/v3/projects/9f514112979e45429525ccd47c753612/users/a48b1689bfa4478e8e1341ea9b1a0417/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:16:48.841470 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd7223-eef1-4ee2-b005-4869d8038b24 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:48.842045 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd7223-eef1-4ee2-b005-4869d8038b24 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:48.842045 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd7223-eef1-4ee2-b005-4869d8038b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:48.881484 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-46cd7223-eef1-4ee2-b005-4869d8038b24 None None] MFA Rules not processed for user `a48b1689bfa4478e8e1341ea9b1a0417`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:48.881484 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-46cd7223-eef1-4ee2-b005-4869d8038b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:49.001397 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:49.038956 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 988/1948] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:16:48 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:16:49.182308 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745aef0-e9d6-4d88-be73-8d5bbf39d279 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:49.184202 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-b745aef0-e9d6-4d88-be73-8d5bbf39d279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:49.309738 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745aef0-e9d6-4d88-be73-8d5bbf39d279 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:49.315796 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4953c-6df7-4cf8-aa52-9cb2058b9ae3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:49.316810 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4953c-6df7-4cf8-aa52-9cb2058b9ae3 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:49.317215 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4953c-6df7-4cf8-aa52-9cb2058b9ae3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:49.318135 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4953c-6df7-4cf8-aa52-9cb2058b9ae3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:49.353227 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4953c-6df7-4cf8-aa52-9cb2058b9ae3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:49.354925 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4953c-6df7-4cf8-aa52-9cb2058b9ae3 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:49.408876 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 961/1949] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:16:49 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:16:53.727321 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd7223-eef1-4ee2-b005-4869d8038b24 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:53.866409 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd7223-eef1-4ee2-b005-4869d8038b24 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:53.886729 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25addf1b-a58d-4770-a004-dc721bf1a6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:53.888012 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25addf1b-a58d-4770-a004-dc721bf1a6c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:53.888551 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25addf1b-a58d-4770-a004-dc721bf1a6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:53.889025 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25addf1b-a58d-4770-a004-dc721bf1a6c1 admin admin] PATH_INFO: `/v3/users/f8cde6d82dec400f86e9293fb1e94e18` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:53.893543 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25addf1b-a58d-4770-a004-dc721bf1a6c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8cde6d82dec400f86e9293fb1e94e18)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:53.895837 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25addf1b-a58d-4770-a004-dc721bf1a6c1 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:53.979474 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-25addf1b-a58d-4770-a004-dc721bf1a6c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8cde6d82dec400f86e9293fb1e94e18'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:53.989723 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-25addf1b-a58d-4770-a004-dc721bf1a6c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8cde6d82dec400f86e9293fb1e94e18'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:53.990573 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-25addf1b-a58d-4770-a004-dc721bf1a6c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8cde6d82dec400f86e9293fb1e94e18'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:54.006405 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-25addf1b-a58d-4770-a004-dc721bf1a6c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8cde6d82dec400f86e9293fb1e94e18'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:54.007121 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-25addf1b-a58d-4770-a004-dc721bf1a6c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8cde6d82dec400f86e9293fb1e94e18'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:54.030489 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 989/1950] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:16:53 2022] DELETE /identity/v3/users/f8cde6d82dec400f86e9293fb1e94e18 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:16:54.031883 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b737d6c-d8af-40aa-a3d9-bb636f6ede26 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:54.031883 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b737d6c-d8af-40aa-a3d9-bb636f6ede26 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:54.032485 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b737d6c-d8af-40aa-a3d9-bb636f6ede26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:54.060722 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-2b737d6c-d8af-40aa-a3d9-bb636f6ede26 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:54.063276 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-2b737d6c-d8af-40aa-a3d9-bb636f6ede26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:54.270568 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 962/1951] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:16:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:16:54.363516 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25addf1b-a58d-4770-a004-dc721bf1a6c1 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:54.366352 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-25addf1b-a58d-4770-a004-dc721bf1a6c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:54.447301 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25addf1b-a58d-4770-a004-dc721bf1a6c1 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:54.452270 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623012b7-ba2d-440a-9b8f-3fa235064ae8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:54.453035 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623012b7-ba2d-440a-9b8f-3fa235064ae8 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:54.453413 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623012b7-ba2d-440a-9b8f-3fa235064ae8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:54.454040 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623012b7-ba2d-440a-9b8f-3fa235064ae8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:54.466975 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623012b7-ba2d-440a-9b8f-3fa235064ae8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:54.469503 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623012b7-ba2d-440a-9b8f-3fa235064ae8 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:54.482783 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 990/1952] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:16:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:16:54.557572 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b737d6c-d8af-40aa-a3d9-bb636f6ede26 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:54.559709 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-2b737d6c-d8af-40aa-a3d9-bb636f6ede26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:54.578921 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b737d6c-d8af-40aa-a3d9-bb636f6ede26 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:54.589456 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99b584-cad9-42bf-a2ea-a0ea372c586c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:54.590203 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99b584-cad9-42bf-a2ea-a0ea372c586c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:54.590478 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99b584-cad9-42bf-a2ea-a0ea372c586c admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:54.590750 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99b584-cad9-42bf-a2ea-a0ea372c586c admin admin] PATH_INFO: `/v3/users/e00cb734489b43b6943ab435b6f15828` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:54.592255 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f99b584-cad9-42bf-a2ea-a0ea372c586c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e00cb734489b43b6943ab435b6f15828)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:54.602030 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f99b584-cad9-42bf-a2ea-a0ea372c586c admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:54.700037 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-1f99b584-cad9-42bf-a2ea-a0ea372c586c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e00cb734489b43b6943ab435b6f15828'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:54.700996 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-1f99b584-cad9-42bf-a2ea-a0ea372c586c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e00cb734489b43b6943ab435b6f15828'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:54.718388 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-1f99b584-cad9-42bf-a2ea-a0ea372c586c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e00cb734489b43b6943ab435b6f15828'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:54.735440 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-1f99b584-cad9-42bf-a2ea-a0ea372c586c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e00cb734489b43b6943ab435b6f15828'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:54.736205 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-1f99b584-cad9-42bf-a2ea-a0ea372c586c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e00cb734489b43b6943ab435b6f15828'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:54.759405 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:54.767284 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 963/1953] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:16:54 2022] DELETE /identity/v3/users/e00cb734489b43b6943ab435b6f15828 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:16:54.772225 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39968acd-2147-46a6-801b-4133272a52fc None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:54.772757 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39968acd-2147-46a6-801b-4133272a52fc None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:54.773583 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39968acd-2147-46a6-801b-4133272a52fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:54.797504 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:54.810520 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-39968acd-2147-46a6-801b-4133272a52fc None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:54.813424 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-39968acd-2147-46a6-801b-4133272a52fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:54.902863 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 991/1954] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:16:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:16:54.928927 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99b584-cad9-42bf-a2ea-a0ea372c586c admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:54.930915 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-1f99b584-cad9-42bf-a2ea-a0ea372c586c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:55.033612 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99b584-cad9-42bf-a2ea-a0ea372c586c admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:55.039455 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f72e5c-52ea-4f0a-8971-896cd1112223 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:55.040389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f72e5c-52ea-4f0a-8971-896cd1112223 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:55.041297 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f72e5c-52ea-4f0a-8971-896cd1112223 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:55.041455 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f72e5c-52ea-4f0a-8971-896cd1112223 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:55.057114 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f72e5c-52ea-4f0a-8971-896cd1112223 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:55.059151 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f72e5c-52ea-4f0a-8971-896cd1112223 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:55.070181 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 964/1955] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:16:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:16:56.078095 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39968acd-2147-46a6-801b-4133272a52fc None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:56.081262 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-39968acd-2147-46a6-801b-4133272a52fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:56.109802 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39968acd-2147-46a6-801b-4133272a52fc None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:56.116629 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb0e2d7-6f2c-489b-9ffa-6b9bcec84392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:56.117296 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0e2d7-6f2c-489b-9ffa-6b9bcec84392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:56.117619 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0e2d7-6f2c-489b-9ffa-6b9bcec84392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:56.117897 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0e2d7-6f2c-489b-9ffa-6b9bcec84392 admin admin] PATH_INFO: `/v3/projects/aca40122d4794d9caddc592d498d33a7` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:56.119215 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb0e2d7-6f2c-489b-9ffa-6b9bcec84392 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aca40122d4794d9caddc592d498d33a7)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:56.121527 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb0e2d7-6f2c-489b-9ffa-6b9bcec84392 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:56.200397 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-7eb0e2d7-6f2c-489b-9ffa-6b9bcec84392 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aca40122d4794d9caddc592d498d33a7', 'request_id': 'req-7eb0e2d7-6f2c-489b-9ffa-6b9bcec84392'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:56.206678 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-7eb0e2d7-6f2c-489b-9ffa-6b9bcec84392 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aca40122d4794d9caddc592d498d33a7', 'request_id': 'req-7eb0e2d7-6f2c-489b-9ffa-6b9bcec84392'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:56.215276 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-7eb0e2d7-6f2c-489b-9ffa-6b9bcec84392 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aca40122d4794d9caddc592d498d33a7', 'request_id': 'req-7eb0e2d7-6f2c-489b-9ffa-6b9bcec84392'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:56.236274 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-7eb0e2d7-6f2c-489b-9ffa-6b9bcec84392 admin admin] The token cache is being invalidate because project aca40122d4794d9caddc592d498d33a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:16:56.237134 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-7eb0e2d7-6f2c-489b-9ffa-6b9bcec84392 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:56.237950 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-7eb0e2d7-6f2c-489b-9ffa-6b9bcec84392 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:56.243255 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f72e5c-52ea-4f0a-8971-896cd1112223 service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:56.244974 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 992/1956] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:16:56 2022] DELETE /identity/v3/projects/aca40122d4794d9caddc592d498d33a7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:16:56.246071 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-08f72e5c-52ea-4f0a-8971-896cd1112223 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:56.251539 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb0e2d7-6f2c-489b-9ffa-6b9bcec84392 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:56.253293 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-7eb0e2d7-6f2c-489b-9ffa-6b9bcec84392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:56.284987 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f72e5c-52ea-4f0a-8971-896cd1112223 service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:56.422063 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb0e2d7-6f2c-489b-9ffa-6b9bcec84392 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:56.422269 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f295b517-0072-4eda-8e66-0fb05ee82e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:56.423184 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295b517-0072-4eda-8e66-0fb05ee82e19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:56.423723 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295b517-0072-4eda-8e66-0fb05ee82e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:56.424268 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295b517-0072-4eda-8e66-0fb05ee82e19 admin admin] PATH_INFO: `/v3/projects/e9ed1fa6d2294d20b0029fbf4928fc05` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:56.425726 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f295b517-0072-4eda-8e66-0fb05ee82e19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9ed1fa6d2294d20b0029fbf4928fc05)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:56.428724 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13124d49-12ad-4f02-ac1f-e4a9a9985bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:56.429808 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f295b517-0072-4eda-8e66-0fb05ee82e19 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:56.431186 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13124d49-12ad-4f02-ac1f-e4a9a9985bdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:56.432446 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13124d49-12ad-4f02-ac1f-e4a9a9985bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:56.432446 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13124d49-12ad-4f02-ac1f-e4a9a9985bdf admin admin] PATH_INFO: `/v3/users/a48b1689bfa4478e8e1341ea9b1a0417` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:56.434539 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13124d49-12ad-4f02-ac1f-e4a9a9985bdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a48b1689bfa4478e8e1341ea9b1a0417)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:56.437767 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13124d49-12ad-4f02-ac1f-e4a9a9985bdf admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:56.496410 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:56.525789 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-13124d49-12ad-4f02-ac1f-e4a9a9985bdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a48b1689bfa4478e8e1341ea9b1a0417'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:56.529333 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-f295b517-0072-4eda-8e66-0fb05ee82e19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9ed1fa6d2294d20b0029fbf4928fc05', 'request_id': 'req-f295b517-0072-4eda-8e66-0fb05ee82e19'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:56.539062 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-f295b517-0072-4eda-8e66-0fb05ee82e19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9ed1fa6d2294d20b0029fbf4928fc05', 'request_id': 'req-f295b517-0072-4eda-8e66-0fb05ee82e19'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:56.555131 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-13124d49-12ad-4f02-ac1f-e4a9a9985bdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a48b1689bfa4478e8e1341ea9b1a0417'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:56.556042 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-13124d49-12ad-4f02-ac1f-e4a9a9985bdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a48b1689bfa4478e8e1341ea9b1a0417'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:56.558435 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-f295b517-0072-4eda-8e66-0fb05ee82e19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9ed1fa6d2294d20b0029fbf4928fc05', 'request_id': 'req-f295b517-0072-4eda-8e66-0fb05ee82e19'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:56.583711 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-f295b517-0072-4eda-8e66-0fb05ee82e19 admin admin] The token cache is being invalidate because project e9ed1fa6d2294d20b0029fbf4928fc05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:16:56.584397 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-f295b517-0072-4eda-8e66-0fb05ee82e19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:56.586333 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-f295b517-0072-4eda-8e66-0fb05ee82e19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:56.587063 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-13124d49-12ad-4f02-ac1f-e4a9a9985bdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a48b1689bfa4478e8e1341ea9b1a0417'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:56.588734 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 965/1957] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:16:56 2022] DELETE /identity/v3/projects/e9ed1fa6d2294d20b0029fbf4928fc05 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:16:56.590138 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-13124d49-12ad-4f02-ac1f-e4a9a9985bdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a48b1689bfa4478e8e1341ea9b1a0417'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:56.593710 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ad1da-0357-4dc0-b60f-7d44d3b79458 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:56.595781 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ad1da-0357-4dc0-b60f-7d44d3b79458 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:56.597384 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ad1da-0357-4dc0-b60f-7d44d3b79458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:56.622681 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 993/1958] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:16:56 2022] DELETE /identity/v3/users/a48b1689bfa4478e8e1341ea9b1a0417 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:16:56.623418 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-8c1ad1da-0357-4dc0-b60f-7d44d3b79458 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:56.625578 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-8c1ad1da-0357-4dc0-b60f-7d44d3b79458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:56.673479 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:56.710240 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 966/1959] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:16:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:16:56.721172 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65693dc-7d9d-45a3-8590-5116162dab12 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:56.721596 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65693dc-7d9d-45a3-8590-5116162dab12 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:56.721957 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65693dc-7d9d-45a3-8590-5116162dab12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:56.743831 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-e65693dc-7d9d-45a3-8590-5116162dab12 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:56.745471 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-e65693dc-7d9d-45a3-8590-5116162dab12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:56.761742 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ad1da-0357-4dc0-b60f-7d44d3b79458 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:56.774354 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ad1da-0357-4dc0-b60f-7d44d3b79458 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:56.781062 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607372a8-eac3-4270-8b9a-9750902c304f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:56.781307 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 994/1960] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:16:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:16:56.784839 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607372a8-eac3-4270-8b9a-9750902c304f admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:56.785315 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607372a8-eac3-4270-8b9a-9750902c304f admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:56.785681 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607372a8-eac3-4270-8b9a-9750902c304f admin admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:56.786582 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607372a8-eac3-4270-8b9a-9750902c304f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:16:56.786978 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607372a8-eac3-4270-8b9a-9750902c304f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:56.789729 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607372a8-eac3-4270-8b9a-9750902c304f admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:56.805192 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 967/1961] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:16:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:16:56.809473 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65693dc-7d9d-45a3-8590-5116162dab12 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:56.825960 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65693dc-7d9d-45a3-8590-5116162dab12 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:56.837156 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea3df6-13e6-4df4-b1b3-c8b0330a5604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:56.838779 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea3df6-13e6-4df4-b1b3-c8b0330a5604 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:56.839063 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea3df6-13e6-4df4-b1b3-c8b0330a5604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:56.839341 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea3df6-13e6-4df4-b1b3-c8b0330a5604 admin admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:56.841194 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea3df6-13e6-4df4-b1b3-c8b0330a5604 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:56.843160 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea3df6-13e6-4df4-b1b3-c8b0330a5604 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:56.882704 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 995/1962] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:16:56 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:16:56.887938 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607372a8-eac3-4270-8b9a-9750902c304f admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:56.921294 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607372a8-eac3-4270-8b9a-9750902c304f admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:57.018307 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc0fcf-36ec-473e-934c-a3bb240b6ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:57.027465 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc0fcf-36ec-473e-934c-a3bb240b6ae4 admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:57.027877 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc0fcf-36ec-473e-934c-a3bb240b6ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:57.036935 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc0fcf-36ec-473e-934c-a3bb240b6ae4 admin admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:57.038315 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dc0fcf-36ec-473e-934c-a3bb240b6ae4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:57.040580 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dc0fcf-36ec-473e-934c-a3bb240b6ae4 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:57.083534 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 968/1963] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:16:56 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:16:57.087207 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea3df6-13e6-4df4-b1b3-c8b0330a5604 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:57.097732 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea3df6-13e6-4df4-b1b3-c8b0330a5604 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:57.103818 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c782027-bab0-42c7-a499-69fb0e928ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:57.104608 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c782027-bab0-42c7-a499-69fb0e928ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:57.104959 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c782027-bab0-42c7-a499-69fb0e928ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:57.105407 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c782027-bab0-42c7-a499-69fb0e928ce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:57.106218 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c782027-bab0-42c7-a499-69fb0e928ce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:57.107970 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c782027-bab0-42c7-a499-69fb0e928ce0 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:57.119527 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 996/1964] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:16:57.123825 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc0fcf-36ec-473e-934c-a3bb240b6ae4 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:57.146389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc0fcf-36ec-473e-934c-a3bb240b6ae4 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:57.152737 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647cd4e-d5f8-4f89-b5f0-2e62459ede96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:57.160518 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647cd4e-d5f8-4f89-b5f0-2e62459ede96 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:57.160978 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647cd4e-d5f8-4f89-b5f0-2e62459ede96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:57.161822 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647cd4e-d5f8-4f89-b5f0-2e62459ede96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:57.163875 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4647cd4e-d5f8-4f89-b5f0-2e62459ede96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:57.166282 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4647cd4e-d5f8-4f89-b5f0-2e62459ede96 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:57.191138 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 969/1965] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:16:57.195781 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c782027-bab0-42c7-a499-69fb0e928ce0 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:57.212379 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c782027-bab0-42c7-a499-69fb0e928ce0 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:57.218736 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb95d00-5f8f-48b9-8a33-3ef96cb3a425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:57.219442 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb95d00-5f8f-48b9-8a33-3ef96cb3a425 admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:57.219742 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb95d00-5f8f-48b9-8a33-3ef96cb3a425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:57.220072 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb95d00-5f8f-48b9-8a33-3ef96cb3a425 admin admin] PATH_INFO: `/v3/projects/15c3091a4dec4435a828b6acd89b663c/users/ac8c34833195484c90b4d7e62533a489/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:57.241391 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb95d00-5f8f-48b9-8a33-3ef96cb3a425 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15c3091a4dec4435a828b6acd89b663c, user_id=ac8c34833195484c90b4d7e62533a489, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:57.245170 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb95d00-5f8f-48b9-8a33-3ef96cb3a425 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:57.271634 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647cd4e-d5f8-4f89-b5f0-2e62459ede96 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:57.274281 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-4647cd4e-d5f8-4f89-b5f0-2e62459ede96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:57.300495 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 997/1966] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:16:57 2022] PUT /identity/v3/projects/15c3091a4dec4435a828b6acd89b663c/users/ac8c34833195484c90b4d7e62533a489/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:16:57.304398 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647cd4e-d5f8-4f89-b5f0-2e62459ede96 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:57.311659 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cda135-ec9e-4336-9d82-0814fa968e0b None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:57.311961 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cda135-ec9e-4336-9d82-0814fa968e0b None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:57.312203 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cda135-ec9e-4336-9d82-0814fa968e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:57.345047 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-65cda135-ec9e-4336-9d82-0814fa968e0b None None] MFA Rules not processed for user `ac8c34833195484c90b4d7e62533a489`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:57.347049 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-65cda135-ec9e-4336-9d82-0814fa968e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:57.451080 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9e984-def4-46e2-8ab5-a34172855285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:57.452877 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9e984-def4-46e2-8ab5-a34172855285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:57.453975 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9e984-def4-46e2-8ab5-a34172855285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:57.455010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9e984-def4-46e2-8ab5-a34172855285 admin admin] PATH_INFO: `/v3/users/c5560aa280ca41c6a04ed9347737d826` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:57.463115 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f9e984-def4-46e2-8ab5-a34172855285 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5560aa280ca41c6a04ed9347737d826)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:57.463355 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 998/1967] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:16:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:16:57.465983 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f9e984-def4-46e2-8ab5-a34172855285 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:57.525193 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:57.533105 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-95f9e984-def4-46e2-8ab5-a34172855285 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5560aa280ca41c6a04ed9347737d826'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:57.536368 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-95f9e984-def4-46e2-8ab5-a34172855285 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5560aa280ca41c6a04ed9347737d826'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:57.565443 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-95f9e984-def4-46e2-8ab5-a34172855285 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5560aa280ca41c6a04ed9347737d826'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:57.570458 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cda135-ec9e-4336-9d82-0814fa968e0b None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:57.573500 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-65cda135-ec9e-4336-9d82-0814fa968e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:57.586119 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-95f9e984-def4-46e2-8ab5-a34172855285 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5560aa280ca41c6a04ed9347737d826'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:57.586911 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-95f9e984-def4-46e2-8ab5-a34172855285 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5560aa280ca41c6a04ed9347737d826'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:57.610928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 970/1968] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:16:57 2022] DELETE /identity/v3/users/c5560aa280ca41c6a04ed9347737d826 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:16:57.615633 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c6890-2c7a-4d23-bcfc-f000a3a03768 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:57.615924 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c6890-2c7a-4d23-bcfc-f000a3a03768 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:57.616202 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c6890-2c7a-4d23-bcfc-f000a3a03768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:57.643298 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-c36c6890-2c7a-4d23-bcfc-f000a3a03768 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:57.644862 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-c36c6890-2c7a-4d23-bcfc-f000a3a03768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:57.667690 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:57.707570 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cda135-ec9e-4336-9d82-0814fa968e0b None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:57.748678 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 971/1969] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:16:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:16:57.784100 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9326e-02f9-4d1e-85b4-87a88673ae17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:57.784714 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9326e-02f9-4d1e-85b4-87a88673ae17 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:57.785134 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9326e-02f9-4d1e-85b4-87a88673ae17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:57.785411 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9326e-02f9-4d1e-85b4-87a88673ae17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:57.787518 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-02d9326e-02f9-4d1e-85b4-87a88673ae17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:57.854571 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c6890-2c7a-4d23-bcfc-f000a3a03768 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:57.857013 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-c36c6890-2c7a-4d23-bcfc-f000a3a03768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:57.873455 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c6890-2c7a-4d23-bcfc-f000a3a03768 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:57.878702 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d9326e-02f9-4d1e-85b4-87a88673ae17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:57.879313 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654c6dd-2f58-49a7-8130-9f05310d5291 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:57.880266 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654c6dd-2f58-49a7-8130-9f05310d5291 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:57.880546 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654c6dd-2f58-49a7-8130-9f05310d5291 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:57.880952 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d9326e-02f9-4d1e-85b4-87a88673ae17 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:57.881078 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654c6dd-2f58-49a7-8130-9f05310d5291 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:57.904973 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f654c6dd-2f58-49a7-8130-9f05310d5291 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:57.907605 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f654c6dd-2f58-49a7-8130-9f05310d5291 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:57.911129 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 999/1970] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:16:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:16:57.912099 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9326e-02f9-4d1e-85b4-87a88673ae17 service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:57.914363 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-02d9326e-02f9-4d1e-85b4-87a88673ae17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:57.930941 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9326e-02f9-4d1e-85b4-87a88673ae17 service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:57.934826 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 972/1971] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:16:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:16:57.936497 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621c407-717b-41de-8a62-7413959e86ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:57.937180 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621c407-717b-41de-8a62-7413959e86ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:57.937607 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621c407-717b-41de-8a62-7413959e86ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:57.937887 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621c407-717b-41de-8a62-7413959e86ea admin admin] PATH_INFO: `/v3/projects/9f514112979e45429525ccd47c753612` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:57.939140 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2621c407-717b-41de-8a62-7413959e86ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f514112979e45429525ccd47c753612)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:57.941316 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2621c407-717b-41de-8a62-7413959e86ea admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:57.994856 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-2621c407-717b-41de-8a62-7413959e86ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f514112979e45429525ccd47c753612', 'request_id': 'req-2621c407-717b-41de-8a62-7413959e86ea'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:58.001645 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-2621c407-717b-41de-8a62-7413959e86ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f514112979e45429525ccd47c753612', 'request_id': 'req-2621c407-717b-41de-8a62-7413959e86ea'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:58.009674 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-2621c407-717b-41de-8a62-7413959e86ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f514112979e45429525ccd47c753612', 'request_id': 'req-2621c407-717b-41de-8a62-7413959e86ea'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:58.028560 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-2621c407-717b-41de-8a62-7413959e86ea admin admin] The token cache is being invalidate because project 9f514112979e45429525ccd47c753612 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:16:58.029228 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-2621c407-717b-41de-8a62-7413959e86ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:58.030769 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-2621c407-717b-41de-8a62-7413959e86ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:58.037167 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1000/1972] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:16:57 2022] DELETE /identity/v3/projects/9f514112979e45429525ccd47c753612 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:16:58.042090 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fe597-b5b3-41e4-be97-48f5cf1f7cc6 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:58.042478 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fe597-b5b3-41e4-be97-48f5cf1f7cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:58.043152 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fe597-b5b3-41e4-be97-48f5cf1f7cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:58.065068 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-555fe597-b5b3-41e4-be97-48f5cf1f7cc6 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:58.066350 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-555fe597-b5b3-41e4-be97-48f5cf1f7cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:58.134870 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 973/1973] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:16:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:16:58.147390 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfc7fc-a908-45ac-83d3-10658d982718 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:58.147989 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfc7fc-a908-45ac-83d3-10658d982718 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:58.148786 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfc7fc-a908-45ac-83d3-10658d982718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:58.176405 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-12dfc7fc-a908-45ac-83d3-10658d982718 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:58.177618 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-12dfc7fc-a908-45ac-83d3-10658d982718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:58.190408 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1001/1974] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:16:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:16:58.191694 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555fe597-b5b3-41e4-be97-48f5cf1f7cc6 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:58.202096 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555fe597-b5b3-41e4-be97-48f5cf1f7cc6 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:58.216914 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e441c-1554-4dac-8246-4c09514070a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:58.217568 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e441c-1554-4dac-8246-4c09514070a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:58.217889 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e441c-1554-4dac-8246-4c09514070a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:58.221400 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e441c-1554-4dac-8246-4c09514070a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:58.221400 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761e441c-1554-4dac-8246-4c09514070a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:16:58.221400 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761e441c-1554-4dac-8246-4c09514070a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:58.222723 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761e441c-1554-4dac-8246-4c09514070a3 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:58.239536 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 974/1975] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:16:58.241341 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfc7fc-a908-45ac-83d3-10658d982718 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:58.254803 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfc7fc-a908-45ac-83d3-10658d982718 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:58.266774 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6392aec9-ce3a-4bcf-9ba6-3336c3a499b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:58.267584 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392aec9-ce3a-4bcf-9ba6-3336c3a499b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:58.267966 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392aec9-ce3a-4bcf-9ba6-3336c3a499b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:58.268334 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392aec9-ce3a-4bcf-9ba6-3336c3a499b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:58.269718 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6392aec9-ce3a-4bcf-9ba6-3336c3a499b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:58.271986 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6392aec9-ce3a-4bcf-9ba6-3336c3a499b0 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:58.314405 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:58.330669 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1002/1976] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:16:58 2022] POST /identity/v3/projects => generated 405 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:16:58.332987 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e441c-1554-4dac-8246-4c09514070a3 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:58.351054 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e441c-1554-4dac-8246-4c09514070a3 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:58.416664 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:58.471988 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a90fc50-b0ff-4e28-8040-b86a7b0551fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:58.472726 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90fc50-b0ff-4e28-8040-b86a7b0551fa admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:58.473078 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90fc50-b0ff-4e28-8040-b86a7b0551fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:58.473422 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90fc50-b0ff-4e28-8040-b86a7b0551fa admin admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:58.474175 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a90fc50-b0ff-4e28-8040-b86a7b0551fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:58.476998 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a90fc50-b0ff-4e28-8040-b86a7b0551fa admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:58.503065 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 975/1977] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:16:58 2022] POST /identity/v3/users => generated 303 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:16:58.508177 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6392aec9-ce3a-4bcf-9ba6-3336c3a499b0 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:58.521035 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6392aec9-ce3a-4bcf-9ba6-3336c3a499b0 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:58.526586 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2785643-c4ca-41fe-94a1-87e3aacb8789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:58.527765 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2785643-c4ca-41fe-94a1-87e3aacb8789 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:58.528240 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2785643-c4ca-41fe-94a1-87e3aacb8789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:58.528498 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2785643-c4ca-41fe-94a1-87e3aacb8789 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:58.529275 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2785643-c4ca-41fe-94a1-87e3aacb8789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:58.530980 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2785643-c4ca-41fe-94a1-87e3aacb8789 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:58.556381 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a90fc50-b0ff-4e28-8040-b86a7b0551fa admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:58.559924 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1003/1978] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:16:58.567800 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a90fc50-b0ff-4e28-8040-b86a7b0551fa admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:58.572604 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309a5df-02d3-48aa-80e6-0adc2ce5cd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:58.573116 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309a5df-02d3-48aa-80e6-0adc2ce5cd83 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:58.573396 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309a5df-02d3-48aa-80e6-0adc2ce5cd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:58.573723 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309a5df-02d3-48aa-80e6-0adc2ce5cd83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:58.574607 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7309a5df-02d3-48aa-80e6-0adc2ce5cd83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:58.576722 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7309a5df-02d3-48aa-80e6-0adc2ce5cd83 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:58.593848 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 976/1979] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:16:58.595171 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2785643-c4ca-41fe-94a1-87e3aacb8789 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:58.607433 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2785643-c4ca-41fe-94a1-87e3aacb8789 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:58.614618 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabf607-5980-4658-a77a-ab6387923660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:58.615646 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabf607-5980-4658-a77a-ab6387923660 admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:58.615963 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabf607-5980-4658-a77a-ab6387923660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:58.616296 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabf607-5980-4658-a77a-ab6387923660 admin admin] PATH_INFO: `/v3/projects/0badb9fb0cd54e0d8fd12a18c4cc93f6/users/dd37699a130f43e099fdfbbae5305e2d/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:58.635723 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caabf607-5980-4658-a77a-ab6387923660 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0badb9fb0cd54e0d8fd12a18c4cc93f6, user_id=dd37699a130f43e099fdfbbae5305e2d, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:58.638575 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caabf607-5980-4658-a77a-ab6387923660 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:58.655294 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1004/1980] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:16:58 2022] PUT /identity/v3/projects/0badb9fb0cd54e0d8fd12a18c4cc93f6/users/dd37699a130f43e099fdfbbae5305e2d/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:16:58.665881 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df810b-2f36-449f-adaa-2cc5f7583f27 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:58.666169 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df810b-2f36-449f-adaa-2cc5f7583f27 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:58.666446 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df810b-2f36-449f-adaa-2cc5f7583f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:58.704078 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-b9df810b-2f36-449f-adaa-2cc5f7583f27 None None] MFA Rules not processed for user `dd37699a130f43e099fdfbbae5305e2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:58.704996 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-b9df810b-2f36-449f-adaa-2cc5f7583f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:58.811684 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 977/1981] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:16:58 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:16:58.818537 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabf607-5980-4658-a77a-ab6387923660 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:58.837009 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df810b-2f36-449f-adaa-2cc5f7583f27 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:58.841563 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-b9df810b-2f36-449f-adaa-2cc5f7583f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:58.929597 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df810b-2f36-449f-adaa-2cc5f7583f27 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:58.936759 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaab798-2c4f-4914-b5b7-ab95f91ef122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:58.937659 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaab798-2c4f-4914-b5b7-ab95f91ef122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:58.938058 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaab798-2c4f-4914-b5b7-ab95f91ef122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:58.938436 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaab798-2c4f-4914-b5b7-ab95f91ef122 admin admin] PATH_INFO: `/v3/projects/51f81963b0bc42b9aa53956324bef28c` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:58.940170 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaab798-2c4f-4914-b5b7-ab95f91ef122 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51f81963b0bc42b9aa53956324bef28c)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:58.943220 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaab798-2c4f-4914-b5b7-ab95f91ef122 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:58.968431 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabf607-5980-4658-a77a-ab6387923660 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:58.980111 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980c29e-c1c0-49db-81e9-fe70afe755e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:58.980904 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980c29e-c1c0-49db-81e9-fe70afe755e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:58.982710 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980c29e-c1c0-49db-81e9-fe70afe755e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:58.982947 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980c29e-c1c0-49db-81e9-fe70afe755e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:58.983768 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a980c29e-c1c0-49db-81e9-fe70afe755e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:58.986003 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a980c29e-c1c0-49db-81e9-fe70afe755e2 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:59.036985 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1005/1982] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:16:58 2022] POST /identity/v3/projects => generated 407 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:16:59.037930 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980c29e-c1c0-49db-81e9-fe70afe755e2 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:59.039736 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-a980c29e-c1c0-49db-81e9-fe70afe755e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:59.045793 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:59.053666 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-fdaab798-2c4f-4914-b5b7-ab95f91ef122 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51f81963b0bc42b9aa53956324bef28c', 'request_id': 'req-fdaab798-2c4f-4914-b5b7-ab95f91ef122'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:59.062303 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-fdaab798-2c4f-4914-b5b7-ab95f91ef122 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51f81963b0bc42b9aa53956324bef28c', 'request_id': 'req-fdaab798-2c4f-4914-b5b7-ab95f91ef122'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:59.072188 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-fdaab798-2c4f-4914-b5b7-ab95f91ef122 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51f81963b0bc42b9aa53956324bef28c', 'request_id': 'req-fdaab798-2c4f-4914-b5b7-ab95f91ef122'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:59.100106 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-fdaab798-2c4f-4914-b5b7-ab95f91ef122 admin admin] The token cache is being invalidate because project 51f81963b0bc42b9aa53956324bef28c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:16:59.100803 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-fdaab798-2c4f-4914-b5b7-ab95f91ef122 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:59.101865 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-fdaab798-2c4f-4914-b5b7-ab95f91ef122 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:59.104345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 978/1983] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:16:58 2022] DELETE /identity/v3/projects/51f81963b0bc42b9aa53956324bef28c => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:16:59.105685 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaab798-2c4f-4914-b5b7-ab95f91ef122 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:59.107423 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-fdaab798-2c4f-4914-b5b7-ab95f91ef122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:59.121658 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980c29e-c1c0-49db-81e9-fe70afe755e2 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:59.127783 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235a4ff-05cc-4072-9da6-467de9ba800e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:59.128451 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235a4ff-05cc-4072-9da6-467de9ba800e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:59.128737 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235a4ff-05cc-4072-9da6-467de9ba800e admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:59.129316 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235a4ff-05cc-4072-9da6-467de9ba800e admin admin] PATH_INFO: `/v3/users/24ff1700ea7a4456868990c1abc6dea9` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:59.130917 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0235a4ff-05cc-4072-9da6-467de9ba800e admin admin] RBAC: Authorizing `identity:delete_user(user_id=24ff1700ea7a4456868990c1abc6dea9)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:59.133388 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0235a4ff-05cc-4072-9da6-467de9ba800e admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:59.200041 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-0235a4ff-05cc-4072-9da6-467de9ba800e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24ff1700ea7a4456868990c1abc6dea9'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:59.207400 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:59.210889 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-0235a4ff-05cc-4072-9da6-467de9ba800e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24ff1700ea7a4456868990c1abc6dea9'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:59.211876 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-0235a4ff-05cc-4072-9da6-467de9ba800e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24ff1700ea7a4456868990c1abc6dea9'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:59.228742 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-0235a4ff-05cc-4072-9da6-467de9ba800e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24ff1700ea7a4456868990c1abc6dea9'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:59.229647 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-0235a4ff-05cc-4072-9da6-467de9ba800e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24ff1700ea7a4456868990c1abc6dea9'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:59.248078 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaab798-2c4f-4914-b5b7-ab95f91ef122 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:59.257025 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1006/1984] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:16:59 2022] DELETE /identity/v3/users/24ff1700ea7a4456868990c1abc6dea9 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:16:59.258771 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126080f-657f-4ae8-a310-2cf25957779f None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:59.259155 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126080f-657f-4ae8-a310-2cf25957779f None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:59.259558 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126080f-657f-4ae8-a310-2cf25957779f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:59.262253 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377bcfb7-acd5-4ce4-81e4-be0be2c76fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:59.263268 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377bcfb7-acd5-4ce4-81e4-be0be2c76fa0 admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:59.263673 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377bcfb7-acd5-4ce4-81e4-be0be2c76fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:59.264042 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377bcfb7-acd5-4ce4-81e4-be0be2c76fa0 admin admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:59.264847 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377bcfb7-acd5-4ce4-81e4-be0be2c76fa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:59.269519 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377bcfb7-acd5-4ce4-81e4-be0be2c76fa0 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:59.301554 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-5126080f-657f-4ae8-a310-2cf25957779f None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:59.303064 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-5126080f-657f-4ae8-a310-2cf25957779f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:59.314536 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 979/1985] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:16:59 2022] POST /identity/v3/users => generated 310 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:16:59.315795 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377bcfb7-acd5-4ce4-81e4-be0be2c76fa0 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:59.319399 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-377bcfb7-acd5-4ce4-81e4-be0be2c76fa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:59.336615 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377bcfb7-acd5-4ce4-81e4-be0be2c76fa0 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:59.383640 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1007/1986] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:16:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:16:59.385335 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126080f-657f-4ae8-a310-2cf25957779f None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:59.388977 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-5126080f-657f-4ae8-a310-2cf25957779f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:59.423394 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126080f-657f-4ae8-a310-2cf25957779f None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:59.428796 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dcd35d-4179-46a9-8f0c-d6c6da07921f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:59.430580 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dcd35d-4179-46a9-8f0c-d6c6da07921f admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:59.431126 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dcd35d-4179-46a9-8f0c-d6c6da07921f admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:59.431637 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dcd35d-4179-46a9-8f0c-d6c6da07921f admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:59.432536 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dcd35d-4179-46a9-8f0c-d6c6da07921f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:59.434959 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dcd35d-4179-46a9-8f0c-d6c6da07921f admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:59.449999 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1008/1987] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:16:59.452225 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1bd991-be24-451e-b363-f7e2f96e6ada None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:59.452722 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1bd991-be24-451e-b363-f7e2f96e6ada None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:59.453137 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1bd991-be24-451e-b363-f7e2f96e6ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:59.477076 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da1d3f-d137-421e-b3bc-47437398de71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:59.477869 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da1d3f-d137-421e-b3bc-47437398de71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:59.478018 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da1d3f-d137-421e-b3bc-47437398de71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:59.478295 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da1d3f-d137-421e-b3bc-47437398de71 admin admin] PATH_INFO: `/v3/users/ac8c34833195484c90b4d7e62533a489` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:59.479731 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19da1d3f-d137-421e-b3bc-47437398de71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac8c34833195484c90b4d7e62533a489)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:59.483359 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19da1d3f-d137-421e-b3bc-47437398de71 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:59.483911 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-ad1bd991-be24-451e-b363-f7e2f96e6ada None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:59.485473 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-ad1bd991-be24-451e-b363-f7e2f96e6ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:59.497799 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1009/1988] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:16:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:16:59.499060 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1bd991-be24-451e-b363-f7e2f96e6ada None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:59.513189 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1bd991-be24-451e-b363-f7e2f96e6ada None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:59.520374 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d52581-6dcb-475a-842c-64f447dd20d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:59.521498 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d52581-6dcb-475a-842c-64f447dd20d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:59.522015 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d52581-6dcb-475a-842c-64f447dd20d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:59.522913 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d52581-6dcb-475a-842c-64f447dd20d1 admin admin] PATH_INFO: `/v3/projects/87c9f849d2984c0786af96d320629c56/users/cdfabc3d16da4b9aba999b0e96fa1c29/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:59.543214 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d52581-6dcb-475a-842c-64f447dd20d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87c9f849d2984c0786af96d320629c56, user_id=cdfabc3d16da4b9aba999b0e96fa1c29, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:59.546518 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d52581-6dcb-475a-842c-64f447dd20d1 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:59.567194 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1010/1989] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:16:59 2022] PUT /identity/v3/projects/87c9f849d2984c0786af96d320629c56/users/cdfabc3d16da4b9aba999b0e96fa1c29/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:16:59.567877 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-19da1d3f-d137-421e-b3bc-47437398de71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac8c34833195484c90b4d7e62533a489'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:59.569180 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d52581-6dcb-475a-842c-64f447dd20d1 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:59.570982 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-19da1d3f-d137-421e-b3bc-47437398de71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac8c34833195484c90b4d7e62533a489'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:59.589925 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=83,keystone:DELETE=13,keystone:INSERT=4 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:59.592315 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-19da1d3f-d137-421e-b3bc-47437398de71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac8c34833195484c90b4d7e62533a489'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:59.614297 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-19da1d3f-d137-421e-b3bc-47437398de71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac8c34833195484c90b4d7e62533a489'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:59.615375 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-19da1d3f-d137-421e-b3bc-47437398de71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac8c34833195484c90b4d7e62533a489'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:16:59.644158 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 980/1990] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:16:59 2022] DELETE /identity/v3/users/ac8c34833195484c90b4d7e62533a489 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:16:59.645203 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da1d3f-d137-421e-b3bc-47437398de71 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:59.647267 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-19da1d3f-d137-421e-b3bc-47437398de71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:59.684055 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d52581-6dcb-475a-842c-64f447dd20d1 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:59.734792 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da1d3f-d137-421e-b3bc-47437398de71 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:59.740584 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92aac1-8d16-4b13-8a8e-5de1f96225cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:59.741637 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92aac1-8d16-4b13-8a8e-5de1f96225cc admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:59.742108 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92aac1-8d16-4b13-8a8e-5de1f96225cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:59.742485 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92aac1-8d16-4b13-8a8e-5de1f96225cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:59.743437 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b92aac1-8d16-4b13-8a8e-5de1f96225cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:59.745352 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b92aac1-8d16-4b13-8a8e-5de1f96225cc admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:59.771520 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 981/1991] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:16:59.771520 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6b4d3-5a73-4b9a-993a-c71ee7307311 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:59.771520 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6b4d3-5a73-4b9a-993a-c71ee7307311 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:59.771520 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6b4d3-5a73-4b9a-993a-c71ee7307311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:59.778162 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:59.795864 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-48f6b4d3-5a73-4b9a-993a-c71ee7307311 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:59.797402 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-48f6b4d3-5a73-4b9a-993a-c71ee7307311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:59.810551 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 982/1992] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:16:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:16:59.811601 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f6b4d3-5a73-4b9a-993a-c71ee7307311 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:59.822246 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f6b4d3-5a73-4b9a-993a-c71ee7307311 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:59.831847 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26443bd8-3437-4d59-ac46-076310dc53e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:59.832672 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26443bd8-3437-4d59-ac46-076310dc53e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:59.833053 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26443bd8-3437-4d59-ac46-076310dc53e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:59.833566 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26443bd8-3437-4d59-ac46-076310dc53e3 admin admin] PATH_INFO: `/v3/projects/87c9f849d2984c0786af96d320629c56/users/cdfabc3d16da4b9aba999b0e96fa1c29/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:59.836427 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26443bd8-3437-4d59-ac46-076310dc53e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87c9f849d2984c0786af96d320629c56, user_id=cdfabc3d16da4b9aba999b0e96fa1c29, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:59.840543 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26443bd8-3437-4d59-ac46-076310dc53e3 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:59.852444 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854fc400-32b1-4b4e-a2d7-749a352ed797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:59.853101 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854fc400-32b1-4b4e-a2d7-749a352ed797 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:59.853349 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 983/1993] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:16:59 2022] PUT /identity/v3/projects/87c9f849d2984c0786af96d320629c56/users/cdfabc3d16da4b9aba999b0e96fa1c29/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:16:59.853720 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854fc400-32b1-4b4e-a2d7-749a352ed797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:59.854098 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854fc400-32b1-4b4e-a2d7-749a352ed797 admin admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:59.854825 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854fc400-32b1-4b4e-a2d7-749a352ed797 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:16:59.855314 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854fc400-32b1-4b4e-a2d7-749a352ed797 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:59.857077 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854fc400-32b1-4b4e-a2d7-749a352ed797 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:59.867364 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26443bd8-3437-4d59-ac46-076310dc53e3 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:59.869523 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-26443bd8-3437-4d59-ac46-076310dc53e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:59.881049 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1011/1994] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:16:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:16:59.882439 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbaac8-615a-4a14-a2cd-80bb04e130c4 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:59.882728 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbaac8-615a-4a14-a2cd-80bb04e130c4 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:59.883004 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbaac8-615a-4a14-a2cd-80bb04e130c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:59.920178 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-2cbbaac8-615a-4a14-a2cd-80bb04e130c4 None None] MFA Rules not processed for user `cdfabc3d16da4b9aba999b0e96fa1c29`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:59.921734 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-2cbbaac8-615a-4a14-a2cd-80bb04e130c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:59.989799 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26443bd8-3437-4d59-ac46-076310dc53e3 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:59.993681 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99cb16-6c34-4979-822f-f4f90430c229 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:59.994560 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99cb16-6c34-4979-822f-f4f90430c229 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:59.994842 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99cb16-6c34-4979-822f-f4f90430c229 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:59.995103 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99cb16-6c34-4979-822f-f4f90430c229 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:00.043538 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1012/1995] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:16:59 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:17:00.043538 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbbaac8-615a-4a14-a2cd-80bb04e130c4 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:00.043766 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-2cbbaac8-615a-4a14-a2cd-80bb04e130c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:00.108967 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c99cb16-6c34-4979-822f-f4f90430c229 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:00.113207 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c99cb16-6c34-4979-822f-f4f90430c229 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:00.125458 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 984/1996] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:16:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:17:00.125987 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99cb16-6c34-4979-822f-f4f90430c229 service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:00.138271 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99cb16-6c34-4979-822f-f4f90430c229 service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:00.146750 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d38a0-4279-4c64-84a1-8d8de772ada8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:00.147468 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d38a0-4279-4c64-84a1-8d8de772ada8 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:00.148087 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d38a0-4279-4c64-84a1-8d8de772ada8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:00.148369 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d38a0-4279-4c64-84a1-8d8de772ada8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:00.150500 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-1c8d38a0-4279-4c64-84a1-8d8de772ada8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:00.157230 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:00.159812 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbbaac8-615a-4a14-a2cd-80bb04e130c4 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:00.172367 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4157cff1-2992-4a38-a1b2-662840441616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:00.173058 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157cff1-2992-4a38-a1b2-662840441616 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:00.173576 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157cff1-2992-4a38-a1b2-662840441616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:00.173749 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157cff1-2992-4a38-a1b2-662840441616 admin admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:00.174511 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4157cff1-2992-4a38-a1b2-662840441616 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:00.176752 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4157cff1-2992-4a38-a1b2-662840441616 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:00.228433 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1013/1997] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:17:00 2022] POST /identity/v3/projects => generated 373 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:17:00.230154 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4157cff1-2992-4a38-a1b2-662840441616 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:00.233136 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-4157cff1-2992-4a38-a1b2-662840441616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:00.272421 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8d38a0-4279-4c64-84a1-8d8de772ada8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:00.275002 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8d38a0-4279-4c64-84a1-8d8de772ada8 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:00.288448 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 985/1998] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:17:00 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:17:00.289580 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d38a0-4279-4c64-84a1-8d8de772ada8 service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:00.314193 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d38a0-4279-4c64-84a1-8d8de772ada8 service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:00.343390 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:00.389595 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4157cff1-2992-4a38-a1b2-662840441616 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:00.396179 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6095334-7b9e-496b-8c4c-c4515c6a5406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:00.397258 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6095334-7b9e-496b-8c4c-c4515c6a5406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:00.397686 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6095334-7b9e-496b-8c4c-c4515c6a5406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:00.398140 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6095334-7b9e-496b-8c4c-c4515c6a5406 admin admin] PATH_INFO: `/v3/projects/86bf27c8c9de48d992e713119637ec52` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:00.399503 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6095334-7b9e-496b-8c4c-c4515c6a5406 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86bf27c8c9de48d992e713119637ec52)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:00.402062 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6095334-7b9e-496b-8c4c-c4515c6a5406 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:00.448107 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037299ea-3f4a-46b8-87b9-1d3b04cd462b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:00.448812 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037299ea-3f4a-46b8-87b9-1d3b04cd462b admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:00.449097 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037299ea-3f4a-46b8-87b9-1d3b04cd462b admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:00.449369 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037299ea-3f4a-46b8-87b9-1d3b04cd462b admin admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:00.450057 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037299ea-3f4a-46b8-87b9-1d3b04cd462b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:00.454782 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037299ea-3f4a-46b8-87b9-1d3b04cd462b admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:00.492219 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 986/1999] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:17:00 2022] POST /identity/v3/users => generated 287 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:17:00.494843 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-e6095334-7b9e-496b-8c4c-c4515c6a5406 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86bf27c8c9de48d992e713119637ec52', 'request_id': 'req-e6095334-7b9e-496b-8c4c-c4515c6a5406'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:00.495870 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037299ea-3f4a-46b8-87b9-1d3b04cd462b admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:00.503172 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-e6095334-7b9e-496b-8c4c-c4515c6a5406 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86bf27c8c9de48d992e713119637ec52', 'request_id': 'req-e6095334-7b9e-496b-8c4c-c4515c6a5406'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:00.509185 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037299ea-3f4a-46b8-87b9-1d3b04cd462b admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:00.511434 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-e6095334-7b9e-496b-8c4c-c4515c6a5406 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86bf27c8c9de48d992e713119637ec52', 'request_id': 'req-e6095334-7b9e-496b-8c4c-c4515c6a5406'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:00.530600 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-e6095334-7b9e-496b-8c4c-c4515c6a5406 admin admin] The token cache is being invalidate because project 86bf27c8c9de48d992e713119637ec52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:17:00.531346 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-e6095334-7b9e-496b-8c4c-c4515c6a5406 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:00.532428 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-e6095334-7b9e-496b-8c4c-c4515c6a5406 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:00.534431 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1014/2000] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:00 2022] DELETE /identity/v3/projects/86bf27c8c9de48d992e713119637ec52 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:17:00.535661 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6095334-7b9e-496b-8c4c-c4515c6a5406 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:00.537937 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-e6095334-7b9e-496b-8c4c-c4515c6a5406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:00.617734 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072fde14-f8f9-4324-8211-a8290096be6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:00.619045 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072fde14-f8f9-4324-8211-a8290096be6a admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:00.619617 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072fde14-f8f9-4324-8211-a8290096be6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:00.625150 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072fde14-f8f9-4324-8211-a8290096be6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:00.625150 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072fde14-f8f9-4324-8211-a8290096be6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:00.627551 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072fde14-f8f9-4324-8211-a8290096be6a admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:00.641087 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 987/2001] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:17:00 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:17:00.643258 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bf542-e932-4047-afe7-6dd8e13d2434 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:00.643258 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bf542-e932-4047-afe7-6dd8e13d2434 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:00.643991 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bf542-e932-4047-afe7-6dd8e13d2434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:00.649678 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6095334-7b9e-496b-8c4c-c4515c6a5406 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:00.656395 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed547e0f-0a80-48eb-9aa2-ddf384158e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:00.657781 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed547e0f-0a80-48eb-9aa2-ddf384158e06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:00.658379 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed547e0f-0a80-48eb-9aa2-ddf384158e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:00.659088 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed547e0f-0a80-48eb-9aa2-ddf384158e06 admin admin] PATH_INFO: `/v3/users/4b3826ceb1fe4d3b825091815c5ec400` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:00.660579 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed547e0f-0a80-48eb-9aa2-ddf384158e06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b3826ceb1fe4d3b825091815c5ec400)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:00.663718 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed547e0f-0a80-48eb-9aa2-ddf384158e06 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:00.671408 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-3e8bf542-e932-4047-afe7-6dd8e13d2434 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:00.672884 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-3e8bf542-e932-4047-afe7-6dd8e13d2434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:00.684712 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 988/2002] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:17:00.685805 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8bf542-e932-4047-afe7-6dd8e13d2434 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:00.694778 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-3e8bf542-e932-4047-afe7-6dd8e13d2434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:00.711239 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8bf542-e932-4047-afe7-6dd8e13d2434 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:00.718884 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b68a62-6d57-4d76-acca-83c6c869a83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:00.719427 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b68a62-6d57-4d76-acca-83c6c869a83c admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:00.719991 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b68a62-6d57-4d76-acca-83c6c869a83c admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:00.720196 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b68a62-6d57-4d76-acca-83c6c869a83c admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:00.721011 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b68a62-6d57-4d76-acca-83c6c869a83c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:00.722857 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b68a62-6d57-4d76-acca-83c6c869a83c admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:00.735067 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 989/2003] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:17:00 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:17:00.736811 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a782e7-7da6-4c50-a5c3-5686c083d120 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:00.737187 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a782e7-7da6-4c50-a5c3-5686c083d120 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:00.737570 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a782e7-7da6-4c50-a5c3-5686c083d120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:00.747937 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-ed547e0f-0a80-48eb-9aa2-ddf384158e06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b3826ceb1fe4d3b825091815c5ec400'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:00.760859 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-10a782e7-7da6-4c50-a5c3-5686c083d120 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:00.763097 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-10a782e7-7da6-4c50-a5c3-5686c083d120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:00.765991 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-ed547e0f-0a80-48eb-9aa2-ddf384158e06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b3826ceb1fe4d3b825091815c5ec400'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:00.766676 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-ed547e0f-0a80-48eb-9aa2-ddf384158e06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b3826ceb1fe4d3b825091815c5ec400'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:00.773343 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 990/2004] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:17:00.775858 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a782e7-7da6-4c50-a5c3-5686c083d120 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:00.780492 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:00.781912 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-ed547e0f-0a80-48eb-9aa2-ddf384158e06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b3826ceb1fe4d3b825091815c5ec400'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:00.782628 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-ed547e0f-0a80-48eb-9aa2-ddf384158e06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b3826ceb1fe4d3b825091815c5ec400'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:00.801785 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a782e7-7da6-4c50-a5c3-5686c083d120 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:00.805574 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1015/2005] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:17:00 2022] DELETE /identity/v3/users/4b3826ceb1fe4d3b825091815c5ec400 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:17:00.807414 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed547e0f-0a80-48eb-9aa2-ddf384158e06 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:00.811851 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-ed547e0f-0a80-48eb-9aa2-ddf384158e06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:00.815921 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0da0d5-faf1-4d03-a495-697b8461087a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:00.816743 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0da0d5-faf1-4d03-a495-697b8461087a admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:00.817044 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0da0d5-faf1-4d03-a495-697b8461087a admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:00.817325 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0da0d5-faf1-4d03-a495-697b8461087a admin admin] PATH_INFO: `/v3/projects/2986245edc324624aa51f5b48037b266/users/4e735433b3b04919baa808690ece0e1f/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:00.820819 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:00.842384 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0da0d5-faf1-4d03-a495-697b8461087a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2986245edc324624aa51f5b48037b266, user_id=4e735433b3b04919baa808690ece0e1f, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:00.846713 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0da0d5-faf1-4d03-a495-697b8461087a admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:00.873785 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 991/2006] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:17:00 2022] PUT /identity/v3/projects/2986245edc324624aa51f5b48037b266/users/4e735433b3b04919baa808690ece0e1f/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:17:00.873785 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c62dfa-5d99-45bf-9db9-d6128911ef7b None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:00.873785 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c62dfa-5d99-45bf-9db9-d6128911ef7b None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:00.873785 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c62dfa-5d99-45bf-9db9-d6128911ef7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:00.900296 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-55c62dfa-5d99-45bf-9db9-d6128911ef7b None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:00.902191 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-55c62dfa-5d99-45bf-9db9-d6128911ef7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:00.932479 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed547e0f-0a80-48eb-9aa2-ddf384158e06 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:01.022478 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54e578-cd91-4853-bf96-2fb6e7396353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:01.022633 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 992/2007] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:17:01.023425 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54e578-cd91-4853-bf96-2fb6e7396353 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:01.024320 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b041791-18bd-426f-a291-f777ab04006c None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:01.024550 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b041791-18bd-426f-a291-f777ab04006c None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:01.024833 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b041791-18bd-426f-a291-f777ab04006c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:01.026042 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54e578-cd91-4853-bf96-2fb6e7396353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:01.026481 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54e578-cd91-4853-bf96-2fb6e7396353 admin admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:01.030100 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c54e578-cd91-4853-bf96-2fb6e7396353 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:17:01.030690 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c54e578-cd91-4853-bf96-2fb6e7396353 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:01.033382 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c54e578-cd91-4853-bf96-2fb6e7396353 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:01.063608 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-6b041791-18bd-426f-a291-f777ab04006c None None] MFA Rules not processed for user `4e735433b3b04919baa808690ece0e1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:01.064905 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-6b041791-18bd-426f-a291-f777ab04006c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:01.073472 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1016/2008] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:17:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:17:01.074623 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54e578-cd91-4853-bf96-2fb6e7396353 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:01.076441 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-0c54e578-cd91-4853-bf96-2fb6e7396353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:01.153809 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 993/2009] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:17:01.153809 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b041791-18bd-426f-a291-f777ab04006c None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:01.155716 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-6b041791-18bd-426f-a291-f777ab04006c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:01.167009 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54e578-cd91-4853-bf96-2fb6e7396353 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:01.170337 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b041791-18bd-426f-a291-f777ab04006c None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:01.173459 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6309fe-82de-42d8-852d-1bb9d17403ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:01.174179 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6309fe-82de-42d8-852d-1bb9d17403ba service nova] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:01.174531 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6309fe-82de-42d8-852d-1bb9d17403ba service nova] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:01.174875 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6309fe-82de-42d8-852d-1bb9d17403ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:01.176122 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027efda-9997-49c5-8ea4-e5bb16c2f07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:01.176773 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027efda-9997-49c5-8ea4-e5bb16c2f07d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:01.177050 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027efda-9997-49c5-8ea4-e5bb16c2f07d admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:01.177319 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027efda-9997-49c5-8ea4-e5bb16c2f07d admin admin] PATH_INFO: `/v3/projects/15c3091a4dec4435a828b6acd89b663c` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:01.178758 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-ab6309fe-82de-42d8-852d-1bb9d17403ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:01.178905 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027efda-9997-49c5-8ea4-e5bb16c2f07d admin admin] RBAC: Authorizing `identity:delete_project(project_id=15c3091a4dec4435a828b6acd89b663c)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:01.180491 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027efda-9997-49c5-8ea4-e5bb16c2f07d admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:01.212939 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:01.241424 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-3027efda-9997-49c5-8ea4-e5bb16c2f07d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15c3091a4dec4435a828b6acd89b663c', 'request_id': 'req-3027efda-9997-49c5-8ea4-e5bb16c2f07d'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:01.251023 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-3027efda-9997-49c5-8ea4-e5bb16c2f07d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15c3091a4dec4435a828b6acd89b663c', 'request_id': 'req-3027efda-9997-49c5-8ea4-e5bb16c2f07d'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:01.258226 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-3027efda-9997-49c5-8ea4-e5bb16c2f07d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15c3091a4dec4435a828b6acd89b663c', 'request_id': 'req-3027efda-9997-49c5-8ea4-e5bb16c2f07d'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:01.263005 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6309fe-82de-42d8-852d-1bb9d17403ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:01.263868 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:01.265164 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6309fe-82de-42d8-852d-1bb9d17403ba service nova] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:01.276994 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1017/2010] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:17:01 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:17:01.277649 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6309fe-82de-42d8-852d-1bb9d17403ba service nova] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:01.279214 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-ab6309fe-82de-42d8-852d-1bb9d17403ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:01.290374 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-3027efda-9997-49c5-8ea4-e5bb16c2f07d admin admin] The token cache is being invalidate because project 15c3091a4dec4435a828b6acd89b663c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:17:01.290374 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-3027efda-9997-49c5-8ea4-e5bb16c2f07d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:01.290981 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-3027efda-9997-49c5-8ea4-e5bb16c2f07d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:01.296493 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 994/2011] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:01 2022] DELETE /identity/v3/projects/15c3091a4dec4435a828b6acd89b663c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:17:01.297245 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027efda-9997-49c5-8ea4-e5bb16c2f07d admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:01.298596 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-3027efda-9997-49c5-8ea4-e5bb16c2f07d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:01.363153 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6309fe-82de-42d8-852d-1bb9d17403ba service nova] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:01.380045 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027efda-9997-49c5-8ea4-e5bb16c2f07d admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:01.385528 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae18a75-e8eb-4788-9896-7c393ddd2b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:01.386162 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae18a75-e8eb-4788-9896-7c393ddd2b2f admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:01.386486 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae18a75-e8eb-4788-9896-7c393ddd2b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:01.387231 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae18a75-e8eb-4788-9896-7c393ddd2b2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:01.388283 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae18a75-e8eb-4788-9896-7c393ddd2b2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:01.390404 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae18a75-e8eb-4788-9896-7c393ddd2b2f admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:01.425515 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a111a05-be78-496a-8988-8f84e6882540 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:01.426153 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a111a05-be78-496a-8988-8f84e6882540 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:01.426434 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a111a05-be78-496a-8988-8f84e6882540 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:01.426904 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a111a05-be78-496a-8988-8f84e6882540 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:01.427023 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 995/2012] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:17:01 2022] POST /identity/v3/projects => generated 409 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:17:01.428106 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae18a75-e8eb-4788-9896-7c393ddd2b2f admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:01.431630 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-eae18a75-e8eb-4788-9896-7c393ddd2b2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:01.431972 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-1a111a05-be78-496a-8988-8f84e6882540 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:01.445022 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a111a05-be78-496a-8988-8f84e6882540 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:01.446484 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a111a05-be78-496a-8988-8f84e6882540 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:01.459336 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1018/2013] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:17:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:17:01.460794 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4c4d2-0d5f-44cb-b696-c48100575e40 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:01.461206 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4c4d2-0d5f-44cb-b696-c48100575e40 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:01.461646 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4c4d2-0d5f-44cb-b696-c48100575e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:01.484933 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-4ae4c4d2-0d5f-44cb-b696-c48100575e40 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:01.486336 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-4ae4c4d2-0d5f-44cb-b696-c48100575e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:01.501011 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae18a75-e8eb-4788-9896-7c393ddd2b2f admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:01.506244 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab900d23-1bac-47a2-8968-02c1988f159b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:01.506887 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab900d23-1bac-47a2-8968-02c1988f159b service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:01.507161 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab900d23-1bac-47a2-8968-02c1988f159b service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:01.507577 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab900d23-1bac-47a2-8968-02c1988f159b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:01.510521 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-ab900d23-1bac-47a2-8968-02c1988f159b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:01.566145 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1019/2014] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:17:01.575772 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4c4d2-0d5f-44cb-b696-c48100575e40 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:01.588957 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4c4d2-0d5f-44cb-b696-c48100575e40 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:01.596016 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae339d4b-15b3-43aa-b14b-7f48ed2b8c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:01.596713 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae339d4b-15b3-43aa-b14b-7f48ed2b8c8a admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:01.597051 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae339d4b-15b3-43aa-b14b-7f48ed2b8c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:01.597329 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae339d4b-15b3-43aa-b14b-7f48ed2b8c8a admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:01.598023 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae339d4b-15b3-43aa-b14b-7f48ed2b8c8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:01.600222 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae339d4b-15b3-43aa-b14b-7f48ed2b8c8a admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:01.610739 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab900d23-1bac-47a2-8968-02c1988f159b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:01.613181 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab900d23-1bac-47a2-8968-02c1988f159b service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:01.626550 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 996/2015] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:17:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:17:01.628427 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc293d38-652a-4290-89a4-b6f2a61499bf None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:01.628703 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc293d38-652a-4290-89a4-b6f2a61499bf None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:01.628972 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc293d38-652a-4290-89a4-b6f2a61499bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:01.635067 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1020/2016] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:17:01 2022] POST /identity/v3/users => generated 305 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:17:01.639763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae339d4b-15b3-43aa-b14b-7f48ed2b8c8a admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:01.648513 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:01.653069 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-dc293d38-652a-4290-89a4-b6f2a61499bf None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:01.654365 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-dc293d38-652a-4290-89a4-b6f2a61499bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:01.655307 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae339d4b-15b3-43aa-b14b-7f48ed2b8c8a admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:01.662543 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265dc7fd-0241-46f9-9b69-5f1d6ae4c71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:01.663768 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265dc7fd-0241-46f9-9b69-5f1d6ae4c71b admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:01.664284 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265dc7fd-0241-46f9-9b69-5f1d6ae4c71b admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:01.667950 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 997/2017] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:17:01.670149 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265dc7fd-0241-46f9-9b69-5f1d6ae4c71b admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:01.671704 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc293d38-652a-4290-89a4-b6f2a61499bf None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:01.673536 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265dc7fd-0241-46f9-9b69-5f1d6ae4c71b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:01.675679 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265dc7fd-0241-46f9-9b69-5f1d6ae4c71b admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:01.697686 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc293d38-652a-4290-89a4-b6f2a61499bf None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:01.699126 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1021/2018] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:17:01.701462 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265dc7fd-0241-46f9-9b69-5f1d6ae4c71b admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:01.707165 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea4ce9d-1ca8-4995-afe8-14e4b0e112a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:01.708750 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4ce9d-1ca8-4995-afe8-14e4b0e112a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:01.710225 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4ce9d-1ca8-4995-afe8-14e4b0e112a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:01.710677 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4ce9d-1ca8-4995-afe8-14e4b0e112a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:01.711739 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea4ce9d-1ca8-4995-afe8-14e4b0e112a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:17:01.712151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265dc7fd-0241-46f9-9b69-5f1d6ae4c71b admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:01.712377 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea4ce9d-1ca8-4995-afe8-14e4b0e112a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:01.714327 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea4ce9d-1ca8-4995-afe8-14e4b0e112a2 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:01.717064 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0ccec-691e-4cf3-8502-e3bd66a0518b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:01.717709 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0ccec-691e-4cf3-8502-e3bd66a0518b admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:01.717987 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0ccec-691e-4cf3-8502-e3bd66a0518b admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:01.718431 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0ccec-691e-4cf3-8502-e3bd66a0518b admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:01.719202 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0ccec-691e-4cf3-8502-e3bd66a0518b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:01.721079 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0ccec-691e-4cf3-8502-e3bd66a0518b admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:01.736395 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1022/2020] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:17:01.737395 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0ccec-691e-4cf3-8502-e3bd66a0518b admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:01.737568 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 998/2019] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:17:01.738999 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea4ce9d-1ca8-4995-afe8-14e4b0e112a2 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:01.749976 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0ccec-691e-4cf3-8502-e3bd66a0518b admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:01.752896 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea4ce9d-1ca8-4995-afe8-14e4b0e112a2 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:01.755598 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbfe06-e03f-4f8c-87fd-9171eb4660ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:01.756295 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbfe06-e03f-4f8c-87fd-9171eb4660ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:01.756568 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbfe06-e03f-4f8c-87fd-9171eb4660ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:01.756839 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbfe06-e03f-4f8c-87fd-9171eb4660ce admin admin] PATH_INFO: `/v3/projects/dbb513843a2748eaa6701814383a90fe/users/1edce55c37974cd7adf550949909a744/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:01.760406 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e9809-e692-40f8-aeb0-babf612990ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:01.762557 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e9809-e692-40f8-aeb0-babf612990ee admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:01.762835 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e9809-e692-40f8-aeb0-babf612990ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:01.763100 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e9809-e692-40f8-aeb0-babf612990ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:01.763837 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e9809-e692-40f8-aeb0-babf612990ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:01.765792 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e9809-e692-40f8-aeb0-babf612990ee admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:01.776095 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dbfe06-e03f-4f8c-87fd-9171eb4660ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbb513843a2748eaa6701814383a90fe, user_id=1edce55c37974cd7adf550949909a744, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:01.779131 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dbfe06-e03f-4f8c-87fd-9171eb4660ce admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:01.788431 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:01.802432 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1023/2021] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:17:01 2022] PUT /identity/v3/projects/dbb513843a2748eaa6701814383a90fe/users/1edce55c37974cd7adf550949909a744/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:17:01.812161 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 999/2022] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:17:01 2022] POST /identity/v3/projects => generated 359 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:17:01.817144 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0f352-601f-430e-b222-5eb4b74e39d4 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:01.817426 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0f352-601f-430e-b222-5eb4b74e39d4 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:01.817703 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0f352-601f-430e-b222-5eb4b74e39d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:01.818053 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbfe06-e03f-4f8c-87fd-9171eb4660ce admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:01.856114 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-bbf0f352-601f-430e-b222-5eb4b74e39d4 None None] MFA Rules not processed for user `1edce55c37974cd7adf550949909a744`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:01.857491 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-bbf0f352-601f-430e-b222-5eb4b74e39d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:01.935125 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbfe06-e03f-4f8c-87fd-9171eb4660ce admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:01.952439 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1000/2023] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:01 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:17:01.952439 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0f352-601f-430e-b222-5eb4b74e39d4 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:01.954694 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-bbf0f352-601f-430e-b222-5eb4b74e39d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:02.003121 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1dcf6-329d-4d35-a71d-3cdb2bec1024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:02.003121 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1dcf6-329d-4d35-a71d-3cdb2bec1024 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:02.003121 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1dcf6-329d-4d35-a71d-3cdb2bec1024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:02.003121 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1dcf6-329d-4d35-a71d-3cdb2bec1024 admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:02.003627 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e1dcf6-329d-4d35-a71d-3cdb2bec1024 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:02.005838 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e1dcf6-329d-4d35-a71d-3cdb2bec1024 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:02.034057 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0f352-601f-430e-b222-5eb4b74e39d4 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:02.035019 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1024/2024] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:17:01 2022] POST /identity/v3/users => generated 280 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:17:02.036067 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1dcf6-329d-4d35-a71d-3cdb2bec1024 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:02.040060 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356dc336-20a7-4764-92f8-4652b8e08424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:02.040951 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356dc336-20a7-4764-92f8-4652b8e08424 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:02.041067 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356dc336-20a7-4764-92f8-4652b8e08424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:02.041317 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356dc336-20a7-4764-92f8-4652b8e08424 admin admin] PATH_INFO: `/v3/projects/20d4f10a2f9d405493ebd0f95dc322fb` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:02.043521 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356dc336-20a7-4764-92f8-4652b8e08424 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20d4f10a2f9d405493ebd0f95dc322fb)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:02.044795 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356dc336-20a7-4764-92f8-4652b8e08424 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:02.047270 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1dcf6-329d-4d35-a71d-3cdb2bec1024 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:02.053796 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c6f12-249a-4c42-a74a-aea8e6844f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:02.054542 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c6f12-249a-4c42-a74a-aea8e6844f2e admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:02.055121 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c6f12-249a-4c42-a74a-aea8e6844f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:02.055121 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c6f12-249a-4c42-a74a-aea8e6844f2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:02.055944 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c6f12-249a-4c42-a74a-aea8e6844f2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:02.058089 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c6f12-249a-4c42-a74a-aea8e6844f2e admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:02.091247 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1025/2025] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:17:02 2022] POST /identity/v3/projects => generated 409 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:17:02.091247 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c6f12-249a-4c42-a74a-aea8e6844f2e admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:02.112138 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-356dc336-20a7-4764-92f8-4652b8e08424 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20d4f10a2f9d405493ebd0f95dc322fb', 'request_id': 'req-356dc336-20a7-4764-92f8-4652b8e08424'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:02.121610 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-356dc336-20a7-4764-92f8-4652b8e08424 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20d4f10a2f9d405493ebd0f95dc322fb', 'request_id': 'req-356dc336-20a7-4764-92f8-4652b8e08424'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:02.131973 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-356dc336-20a7-4764-92f8-4652b8e08424 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20d4f10a2f9d405493ebd0f95dc322fb', 'request_id': 'req-356dc336-20a7-4764-92f8-4652b8e08424'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:02.143028 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:02.153440 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-356dc336-20a7-4764-92f8-4652b8e08424 admin admin] The token cache is being invalidate because project 20d4f10a2f9d405493ebd0f95dc322fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:17:02.153745 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-356dc336-20a7-4764-92f8-4652b8e08424 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:02.154928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-356dc336-20a7-4764-92f8-4652b8e08424 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:02.159655 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1001/2026] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:01 2022] DELETE /identity/v3/projects/20d4f10a2f9d405493ebd0f95dc322fb => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:17:02.161466 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356dc336-20a7-4764-92f8-4652b8e08424 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:02.165418 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-356dc336-20a7-4764-92f8-4652b8e08424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:02.191725 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:02.191973 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c6f12-249a-4c42-a74a-aea8e6844f2e admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:02.197526 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85c1bf-03dc-4355-a74d-71a56ef4fb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:02.198773 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85c1bf-03dc-4355-a74d-71a56ef4fb6a admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:02.199450 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85c1bf-03dc-4355-a74d-71a56ef4fb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:02.199450 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85c1bf-03dc-4355-a74d-71a56ef4fb6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:02.200253 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85c1bf-03dc-4355-a74d-71a56ef4fb6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:02.202116 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85c1bf-03dc-4355-a74d-71a56ef4fb6a admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:02.213772 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1026/2027] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:17:02.214723 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85c1bf-03dc-4355-a74d-71a56ef4fb6a admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:02.216595 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-9d85c1bf-03dc-4355-a74d-71a56ef4fb6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:02.229744 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85c1bf-03dc-4355-a74d-71a56ef4fb6a admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:02.235056 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f0d01-5e81-43f4-ad95-349aec2a458c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:02.235663 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f0d01-5e81-43f4-ad95-349aec2a458c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:02.235937 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f0d01-5e81-43f4-ad95-349aec2a458c admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:02.236209 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f0d01-5e81-43f4-ad95-349aec2a458c admin admin] PATH_INFO: `/v3/users/8e1d527ed1704bfda69ffba8cc31764b` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:02.239214 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f0d01-5e81-43f4-ad95-349aec2a458c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e1d527ed1704bfda69ffba8cc31764b)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:02.242953 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f0d01-5e81-43f4-ad95-349aec2a458c admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:02.269441 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356dc336-20a7-4764-92f8-4652b8e08424 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:02.275335 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7399585-c508-49ed-aca7-4cae77e5bbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:02.276303 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7399585-c508-49ed-aca7-4cae77e5bbfa admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:02.276586 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7399585-c508-49ed-aca7-4cae77e5bbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:02.276924 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7399585-c508-49ed-aca7-4cae77e5bbfa admin admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:02.277622 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7399585-c508-49ed-aca7-4cae77e5bbfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:02.279764 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7399585-c508-49ed-aca7-4cae77e5bbfa admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:02.317801 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1002/2028] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:17:02 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:17:02.317801 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7399585-c508-49ed-aca7-4cae77e5bbfa admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:02.318048 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-3f9f0d01-5e81-43f4-ad95-349aec2a458c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e1d527ed1704bfda69ffba8cc31764b'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:02.321687 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-e7399585-c508-49ed-aca7-4cae77e5bbfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:02.325481 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-3f9f0d01-5e81-43f4-ad95-349aec2a458c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e1d527ed1704bfda69ffba8cc31764b'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:02.326187 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-3f9f0d01-5e81-43f4-ad95-349aec2a458c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e1d527ed1704bfda69ffba8cc31764b'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:02.336210 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7399585-c508-49ed-aca7-4cae77e5bbfa admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:02.339855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-3f9f0d01-5e81-43f4-ad95-349aec2a458c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e1d527ed1704bfda69ffba8cc31764b'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:02.340947 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-3f9f0d01-5e81-43f4-ad95-349aec2a458c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e1d527ed1704bfda69ffba8cc31764b'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:02.341122 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e562eb5c-95f7-43ea-b593-2c39cb08e86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:02.341860 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562eb5c-95f7-43ea-b593-2c39cb08e86b admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:02.342169 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562eb5c-95f7-43ea-b593-2c39cb08e86b admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:02.342461 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562eb5c-95f7-43ea-b593-2c39cb08e86b admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:02.343162 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e562eb5c-95f7-43ea-b593-2c39cb08e86b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:02.344908 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e562eb5c-95f7-43ea-b593-2c39cb08e86b admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:02.364022 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1003/2029] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:17:02.364803 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e562eb5c-95f7-43ea-b593-2c39cb08e86b admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:02.366802 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-e562eb5c-95f7-43ea-b593-2c39cb08e86b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:02.373142 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1027/2030] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:17:02 2022] DELETE /identity/v3/users/8e1d527ed1704bfda69ffba8cc31764b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:17:02.374183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f0d01-5e81-43f4-ad95-349aec2a458c admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:02.379867 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-3f9f0d01-5e81-43f4-ad95-349aec2a458c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:02.382424 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e562eb5c-95f7-43ea-b593-2c39cb08e86b admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:02.462934 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f0d01-5e81-43f4-ad95-349aec2a458c admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:02.469569 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443098f3-725a-4740-885e-ddfe86726ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:02.470384 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b90692-e7dc-4421-b739-c35dce9a39c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:02.470510 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443098f3-725a-4740-885e-ddfe86726ff5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:02.470833 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443098f3-725a-4740-885e-ddfe86726ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:02.471262 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b90692-e7dc-4421-b739-c35dce9a39c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:02.471732 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b90692-e7dc-4421-b739-c35dce9a39c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:02.472057 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b90692-e7dc-4421-b739-c35dce9a39c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:02.473064 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b90692-e7dc-4421-b739-c35dce9a39c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:02.474268 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443098f3-725a-4740-885e-ddfe86726ff5 admin admin] PATH_INFO: `/v3/projects/881a99aede6c47c9b628816904c8157e/users/cbc45b80a4a9458b8fa648228425c226/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:02.475568 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b90692-e7dc-4421-b739-c35dce9a39c4 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:02.491540 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1004/2031] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:17:02.493375 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b90692-e7dc-4421-b739-c35dce9a39c4 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:02.493483 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443098f3-725a-4740-885e-ddfe86726ff5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=881a99aede6c47c9b628816904c8157e, user_id=cbc45b80a4a9458b8fa648228425c226, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:02.497394 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443098f3-725a-4740-885e-ddfe86726ff5 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:02.513838 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b90692-e7dc-4421-b739-c35dce9a39c4 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:02.516686 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1028/2032] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:17:02 2022] PUT /identity/v3/projects/881a99aede6c47c9b628816904c8157e/users/cbc45b80a4a9458b8fa648228425c226/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:17:02.528594 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960a91d-ec4b-4269-8f02-171edc94c1cf None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:02.528898 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960a91d-ec4b-4269-8f02-171edc94c1cf None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:02.529150 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960a91d-ec4b-4269-8f02-171edc94c1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:02.569520 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-c960a91d-ec4b-4269-8f02-171edc94c1cf None None] MFA Rules not processed for user `cbc45b80a4a9458b8fa648228425c226`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:02.570743 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-c960a91d-ec4b-4269-8f02-171edc94c1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:02.584043 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:02.612333 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03f536-d8c7-4a6a-92dc-60988f18c25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:02.613805 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03f536-d8c7-4a6a-92dc-60988f18c25b admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:02.614298 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03f536-d8c7-4a6a-92dc-60988f18c25b admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:02.615013 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03f536-d8c7-4a6a-92dc-60988f18c25b admin admin] PATH_INFO: `/v3/projects/4254a12f4e584459bf36ef30c1a8b780/users/94356f84c4704c299717d398317cd3f0/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:02.642850 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03f536-d8c7-4a6a-92dc-60988f18c25b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4254a12f4e584459bf36ef30c1a8b780, user_id=94356f84c4704c299717d398317cd3f0, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:02.647001 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03f536-d8c7-4a6a-92dc-60988f18c25b admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:02.672023 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1005/2033] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:17:02 2022] PUT /identity/v3/projects/4254a12f4e584459bf36ef30c1a8b780/users/94356f84c4704c299717d398317cd3f0/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:17:02.673422 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1029/2034] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:02 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:17:02.673635 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03f536-d8c7-4a6a-92dc-60988f18c25b admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:02.688730 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:02.693718 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960a91d-ec4b-4269-8f02-171edc94c1cf None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:02.696990 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-c960a91d-ec4b-4269-8f02-171edc94c1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:02.769811 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03f536-d8c7-4a6a-92dc-60988f18c25b admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:02.777841 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c58e80-8409-4d75-8784-00b1542de7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:02.778509 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c58e80-8409-4d75-8784-00b1542de7fd admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:02.778835 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c58e80-8409-4d75-8784-00b1542de7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:02.779271 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c58e80-8409-4d75-8784-00b1542de7fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:02.780390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c58e80-8409-4d75-8784-00b1542de7fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:02.782431 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c58e80-8409-4d75-8784-00b1542de7fd admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:02.795634 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960a91d-ec4b-4269-8f02-171edc94c1cf None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:02.799970 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1006/2035] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:17:02.805019 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c58e80-8409-4d75-8784-00b1542de7fd admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:02.817519 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c58e80-8409-4d75-8784-00b1542de7fd admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:02.825923 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac09fe2-f4c7-4eca-8070-d4bcec98bf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:02.826777 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac09fe2-f4c7-4eca-8070-d4bcec98bf00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:02.827107 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac09fe2-f4c7-4eca-8070-d4bcec98bf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:02.827518 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac09fe2-f4c7-4eca-8070-d4bcec98bf00 admin admin] PATH_INFO: `/v3/projects/4254a12f4e584459bf36ef30c1a8b780/users/94356f84c4704c299717d398317cd3f0/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:02.830788 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac09fe2-f4c7-4eca-8070-d4bcec98bf00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4254a12f4e584459bf36ef30c1a8b780, user_id=94356f84c4704c299717d398317cd3f0, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:02.838529 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac09fe2-f4c7-4eca-8070-d4bcec98bf00 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:02.861458 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a2ad5-3fb1-476b-bc94-71500be1eb7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:02.862103 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a2ad5-3fb1-476b-bc94-71500be1eb7f service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:02.862379 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a2ad5-3fb1-476b-bc94-71500be1eb7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:02.862797 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a2ad5-3fb1-476b-bc94-71500be1eb7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:02.863894 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1007/2036] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:17:02 2022] PUT /identity/v3/projects/4254a12f4e584459bf36ef30c1a8b780/users/94356f84c4704c299717d398317cd3f0/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:17:02.878307 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b3edf-763f-4cce-8f35-3c801635ae62 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:02.878626 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b3edf-763f-4cce-8f35-3c801635ae62 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:02.878888 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b3edf-763f-4cce-8f35-3c801635ae62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:02.924546 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-8a3b3edf-763f-4cce-8f35-3c801635ae62 None None] MFA Rules not processed for user `94356f84c4704c299717d398317cd3f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:02.926466 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-8a3b3edf-763f-4cce-8f35-3c801635ae62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:02.983981 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a2ad5-3fb1-476b-bc94-71500be1eb7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:02.985714 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a2ad5-3fb1-476b-bc94-71500be1eb7f service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:03.013015 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1030/2037] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:17:02 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:17:03.047029 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1008/2038] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:02 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:17:03.060592 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a2ad5-3fb1-476b-bc94-71500be1eb7f service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:03.062069 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-862a2ad5-3fb1-476b-bc94-71500be1eb7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:03.075826 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a2ad5-3fb1-476b-bc94-71500be1eb7f service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:03.104127 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:03.145700 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5bdcb-542d-4d11-9bf1-81ab74db9607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:03.146432 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5bdcb-542d-4d11-9bf1-81ab74db9607 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:03.146968 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5bdcb-542d-4d11-9bf1-81ab74db9607 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:03.147437 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5bdcb-542d-4d11-9bf1-81ab74db9607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:03.158035 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee5bdcb-542d-4d11-9bf1-81ab74db9607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:03.159175 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee5bdcb-542d-4d11-9bf1-81ab74db9607 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:03.169643 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1031/2039] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:17:03 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:17:03.264630 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b3edf-763f-4cce-8f35-3c801635ae62 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:03.265965 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-8a3b3edf-763f-4cce-8f35-3c801635ae62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:03.357040 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b3edf-763f-4cce-8f35-3c801635ae62 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:03.367843 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ce3a8-9ba0-4121-b3b6-1e5ae479ecfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:03.369440 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ce3a8-9ba0-4121-b3b6-1e5ae479ecfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:03.369440 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ce3a8-9ba0-4121-b3b6-1e5ae479ecfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:03.369440 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ce3a8-9ba0-4121-b3b6-1e5ae479ecfe admin admin] PATH_INFO: `/v3/projects/cb4da6a8dea84fa3ad4a0cf637615781` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:03.371003 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ce3a8-9ba0-4121-b3b6-1e5ae479ecfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb4da6a8dea84fa3ad4a0cf637615781)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:03.373433 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ce3a8-9ba0-4121-b3b6-1e5ae479ecfe admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:03.400148 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:03.432357 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-ca3ce3a8-9ba0-4121-b3b6-1e5ae479ecfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb4da6a8dea84fa3ad4a0cf637615781', 'request_id': 'req-ca3ce3a8-9ba0-4121-b3b6-1e5ae479ecfe'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:03.438938 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-ca3ce3a8-9ba0-4121-b3b6-1e5ae479ecfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb4da6a8dea84fa3ad4a0cf637615781', 'request_id': 'req-ca3ce3a8-9ba0-4121-b3b6-1e5ae479ecfe'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:03.446515 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-ca3ce3a8-9ba0-4121-b3b6-1e5ae479ecfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb4da6a8dea84fa3ad4a0cf637615781', 'request_id': 'req-ca3ce3a8-9ba0-4121-b3b6-1e5ae479ecfe'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:03.468308 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-ca3ce3a8-9ba0-4121-b3b6-1e5ae479ecfe admin admin] The token cache is being invalidate because project cb4da6a8dea84fa3ad4a0cf637615781 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:17:03.469334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-ca3ce3a8-9ba0-4121-b3b6-1e5ae479ecfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:03.470356 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-ca3ce3a8-9ba0-4121-b3b6-1e5ae479ecfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:03.472323 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1009/2040] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:03 2022] DELETE /identity/v3/projects/cb4da6a8dea84fa3ad4a0cf637615781 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:17:03.477412 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea0096-3048-4d87-8674-0873229f54e4 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:03.477906 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea0096-3048-4d87-8674-0873229f54e4 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:03.478168 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea0096-3048-4d87-8674-0873229f54e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:03.504645 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-39ea0096-3048-4d87-8674-0873229f54e4 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:03.505853 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-39ea0096-3048-4d87-8674-0873229f54e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:03.592120 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1032/2041] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:17:03.595935 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06e2e9-9f45-402c-9a16-72abb968fc90 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:03.596880 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06e2e9-9f45-402c-9a16-72abb968fc90 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:03.598099 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06e2e9-9f45-402c-9a16-72abb968fc90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:03.625774 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-cd06e2e9-9f45-402c-9a16-72abb968fc90 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:03.627140 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-cd06e2e9-9f45-402c-9a16-72abb968fc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:03.641171 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1010/2042] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:17:03.642851 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea0096-3048-4d87-8674-0873229f54e4 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:03.656832 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea0096-3048-4d87-8674-0873229f54e4 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:03.663573 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e352c-f42f-430f-bcbf-97e331fb380e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:03.664500 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e352c-f42f-430f-bcbf-97e331fb380e admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:03.664679 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e352c-f42f-430f-bcbf-97e331fb380e admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:03.665160 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e352c-f42f-430f-bcbf-97e331fb380e admin admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:03.666434 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e352c-f42f-430f-bcbf-97e331fb380e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:17:03.666434 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e352c-f42f-430f-bcbf-97e331fb380e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:03.669489 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e352c-f42f-430f-bcbf-97e331fb380e admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:03.690993 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1033/2043] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:17:03.692238 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd06e2e9-9f45-402c-9a16-72abb968fc90 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:03.702448 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd06e2e9-9f45-402c-9a16-72abb968fc90 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:03.711198 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e432f-961b-42f7-bd53-57b6fce91c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:03.711994 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e432f-961b-42f7-bd53-57b6fce91c8f admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:03.712432 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e432f-961b-42f7-bd53-57b6fce91c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:03.713062 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e432f-961b-42f7-bd53-57b6fce91c8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:03.713755 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7e432f-961b-42f7-bd53-57b6fce91c8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:03.715895 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7e432f-961b-42f7-bd53-57b6fce91c8f admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:03.758310 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1011/2044] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:17:03 2022] POST /identity/v3/projects => generated 371 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:17:03.758867 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e352c-f42f-430f-bcbf-97e331fb380e admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:03.776382 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e352c-f42f-430f-bcbf-97e331fb380e admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:03.870927 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f6028-1033-446c-86a6-5a6d05629463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:03.872397 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f6028-1033-446c-86a6-5a6d05629463 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:03.872936 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f6028-1033-446c-86a6-5a6d05629463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:03.873585 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f6028-1033-446c-86a6-5a6d05629463 admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:03.875617 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f6028-1033-446c-86a6-5a6d05629463 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:03.877998 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f6028-1033-446c-86a6-5a6d05629463 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:03.919678 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e432f-961b-42f7-bd53-57b6fce91c8f admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:03.926360 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1034/2045] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:17:03 2022] POST /identity/v3/users => generated 286 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:17:03.933653 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e432f-961b-42f7-bd53-57b6fce91c8f admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:03.940985 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca8ad0-891c-4b8f-a755-6bab75aae953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:03.942240 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca8ad0-891c-4b8f-a755-6bab75aae953 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:03.942784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca8ad0-891c-4b8f-a755-6bab75aae953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:03.943327 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca8ad0-891c-4b8f-a755-6bab75aae953 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:03.944801 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca8ad0-891c-4b8f-a755-6bab75aae953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:03.955114 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca8ad0-891c-4b8f-a755-6bab75aae953 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:04.000262 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f6028-1033-446c-86a6-5a6d05629463 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:04.014956 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1012/2046] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:17:04.016958 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f6028-1033-446c-86a6-5a6d05629463 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:04.025763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec37bf9-ce2b-4d84-9898-02236dfac132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:04.026550 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec37bf9-ce2b-4d84-9898-02236dfac132 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:04.026944 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec37bf9-ce2b-4d84-9898-02236dfac132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:04.027348 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec37bf9-ce2b-4d84-9898-02236dfac132 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:04.028318 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec37bf9-ce2b-4d84-9898-02236dfac132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:04.030486 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec37bf9-ce2b-4d84-9898-02236dfac132 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:04.049272 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1035/2047] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:17:04.053285 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca8ad0-891c-4b8f-a755-6bab75aae953 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:04.069363 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca8ad0-891c-4b8f-a755-6bab75aae953 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:04.078967 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55fb83-130a-4a2c-b9b9-3d8d59f98d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:04.080313 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55fb83-130a-4a2c-b9b9-3d8d59f98d18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:04.080487 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55fb83-130a-4a2c-b9b9-3d8d59f98d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:04.080671 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55fb83-130a-4a2c-b9b9-3d8d59f98d18 admin admin] PATH_INFO: `/v3/projects/076fdcdec4664182a36a6baff7c25ed4/users/99aa39acd1af476783b48c76a36fb13e/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:04.104131 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae55fb83-130a-4a2c-b9b9-3d8d59f98d18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=076fdcdec4664182a36a6baff7c25ed4, user_id=99aa39acd1af476783b48c76a36fb13e, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:04.108027 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae55fb83-130a-4a2c-b9b9-3d8d59f98d18 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:04.135848 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1013/2048] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:17:04 2022] PUT /identity/v3/projects/076fdcdec4664182a36a6baff7c25ed4/users/99aa39acd1af476783b48c76a36fb13e/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:17:04.147107 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e8283-c57d-4093-8b33-9983b4952ed7 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:04.147107 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e8283-c57d-4093-8b33-9983b4952ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:04.147107 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e8283-c57d-4093-8b33-9983b4952ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:04.188382 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-d67e8283-c57d-4093-8b33-9983b4952ed7 None None] MFA Rules not processed for user `99aa39acd1af476783b48c76a36fb13e`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:04.191595 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-d67e8283-c57d-4093-8b33-9983b4952ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:04.220701 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:04.285258 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1036/2049] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:17:04.319789 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55fb83-130a-4a2c-b9b9-3d8d59f98d18 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:04.323053 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-ae55fb83-130a-4a2c-b9b9-3d8d59f98d18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:04.414256 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55fb83-130a-4a2c-b9b9-3d8d59f98d18 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:04.422199 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea47d3-5a0a-4eb7-86ca-89686b89128a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:04.422199 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea47d3-5a0a-4eb7-86ca-89686b89128a service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:04.422199 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea47d3-5a0a-4eb7-86ca-89686b89128a service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:04.422199 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea47d3-5a0a-4eb7-86ca-89686b89128a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:04.434199 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea47d3-5a0a-4eb7-86ca-89686b89128a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:04.436287 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea47d3-5a0a-4eb7-86ca-89686b89128a service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:04.450810 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1014/2050] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:17:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:17:07.985975 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e8283-c57d-4093-8b33-9983b4952ed7 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:07.988464 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-d67e8283-c57d-4093-8b33-9983b4952ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:08.107325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e8283-c57d-4093-8b33-9983b4952ed7 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:08.112068 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e59dae-6568-4f1c-bbea-02c71e2470d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:08.112721 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e59dae-6568-4f1c-bbea-02c71e2470d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:08.112993 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e59dae-6568-4f1c-bbea-02c71e2470d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:08.113262 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e59dae-6568-4f1c-bbea-02c71e2470d7 admin admin] PATH_INFO: `/v3/users/1edce55c37974cd7adf550949909a744` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:08.114428 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e59dae-6568-4f1c-bbea-02c71e2470d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1edce55c37974cd7adf550949909a744)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:08.117402 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e59dae-6568-4f1c-bbea-02c71e2470d7 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:08.192555 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-b1e59dae-6568-4f1c-bbea-02c71e2470d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1edce55c37974cd7adf550949909a744'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:08.201769 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-b1e59dae-6568-4f1c-bbea-02c71e2470d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1edce55c37974cd7adf550949909a744'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:08.203063 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-b1e59dae-6568-4f1c-bbea-02c71e2470d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1edce55c37974cd7adf550949909a744'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:08.221808 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-b1e59dae-6568-4f1c-bbea-02c71e2470d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1edce55c37974cd7adf550949909a744'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:08.223562 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-b1e59dae-6568-4f1c-bbea-02c71e2470d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1edce55c37974cd7adf550949909a744'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:08.257301 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1037/2051] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:17:07 2022] DELETE /identity/v3/users/1edce55c37974cd7adf550949909a744 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:17:08.261969 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151c1f2-fabf-4c0b-ac09-4443c80f7e4f None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:08.262505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151c1f2-fabf-4c0b-ac09-4443c80f7e4f None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:08.262505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151c1f2-fabf-4c0b-ac09-4443c80f7e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:08.286665 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-d151c1f2-fabf-4c0b-ac09-4443c80f7e4f None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:08.288931 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-d151c1f2-fabf-4c0b-ac09-4443c80f7e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:08.396358 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:08.427708 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1015/2052] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:17:08.492101 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e59dae-6568-4f1c-bbea-02c71e2470d7 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:08.494287 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-b1e59dae-6568-4f1c-bbea-02c71e2470d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:08.606582 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:08.645505 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e59dae-6568-4f1c-bbea-02c71e2470d7 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:08.656225 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7be6eb-78c5-4e43-8c15-847d5a6d25c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:08.657419 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7be6eb-78c5-4e43-8c15-847d5a6d25c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:08.657756 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7be6eb-78c5-4e43-8c15-847d5a6d25c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:08.658036 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7be6eb-78c5-4e43-8c15-847d5a6d25c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:08.682605 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7be6eb-78c5-4e43-8c15-847d5a6d25c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:08.685151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7be6eb-78c5-4e43-8c15-847d5a6d25c9 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:08.721751 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1038/2053] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:17:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:17:10.314367 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151c1f2-fabf-4c0b-ac09-4443c80f7e4f None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:10.317881 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-d151c1f2-fabf-4c0b-ac09-4443c80f7e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:10.338298 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151c1f2-fabf-4c0b-ac09-4443c80f7e4f None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:10.348994 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea86ecc-f97e-4186-8ba8-235d1d3ea638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:10.349687 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea86ecc-f97e-4186-8ba8-235d1d3ea638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:10.350599 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea86ecc-f97e-4186-8ba8-235d1d3ea638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:10.350874 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea86ecc-f97e-4186-8ba8-235d1d3ea638 admin admin] PATH_INFO: `/v3/projects/dbb513843a2748eaa6701814383a90fe` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:10.352454 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea86ecc-f97e-4186-8ba8-235d1d3ea638 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbb513843a2748eaa6701814383a90fe)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:10.356692 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea86ecc-f97e-4186-8ba8-235d1d3ea638 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:10.478339 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-4ea86ecc-f97e-4186-8ba8-235d1d3ea638 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbb513843a2748eaa6701814383a90fe', 'request_id': 'req-4ea86ecc-f97e-4186-8ba8-235d1d3ea638'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:10.490240 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-4ea86ecc-f97e-4186-8ba8-235d1d3ea638 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbb513843a2748eaa6701814383a90fe', 'request_id': 'req-4ea86ecc-f97e-4186-8ba8-235d1d3ea638'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:10.498630 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-4ea86ecc-f97e-4186-8ba8-235d1d3ea638 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbb513843a2748eaa6701814383a90fe', 'request_id': 'req-4ea86ecc-f97e-4186-8ba8-235d1d3ea638'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:10.523334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-4ea86ecc-f97e-4186-8ba8-235d1d3ea638 admin admin] The token cache is being invalidate because project dbb513843a2748eaa6701814383a90fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:17:10.523656 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-4ea86ecc-f97e-4186-8ba8-235d1d3ea638 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:10.524362 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-4ea86ecc-f97e-4186-8ba8-235d1d3ea638 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:10.528199 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1016/2054] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:10 2022] DELETE /identity/v3/projects/dbb513843a2748eaa6701814383a90fe => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:17:10.532076 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7be6eb-78c5-4e43-8c15-847d5a6d25c9 service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:10.552955 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7be6eb-78c5-4e43-8c15-847d5a6d25c9 service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:10.692417 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5c845-d0cf-4b62-ad20-77a9ac6af76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:10.693790 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5c845-d0cf-4b62-ad20-77a9ac6af76e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:10.694350 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5c845-d0cf-4b62-ad20-77a9ac6af76e admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:10.694834 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5c845-d0cf-4b62-ad20-77a9ac6af76e admin admin] PATH_INFO: `/v3/users/94356f84c4704c299717d398317cd3f0` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:10.698093 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b5c845-d0cf-4b62-ad20-77a9ac6af76e admin admin] RBAC: Authorizing `identity:delete_user(user_id=94356f84c4704c299717d398317cd3f0)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:10.704698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b5c845-d0cf-4b62-ad20-77a9ac6af76e admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:10.855243 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-88b5c845-d0cf-4b62-ad20-77a9ac6af76e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94356f84c4704c299717d398317cd3f0'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:10.894898 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-88b5c845-d0cf-4b62-ad20-77a9ac6af76e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94356f84c4704c299717d398317cd3f0'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:10.897805 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-88b5c845-d0cf-4b62-ad20-77a9ac6af76e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94356f84c4704c299717d398317cd3f0'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:10.952778 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-88b5c845-d0cf-4b62-ad20-77a9ac6af76e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94356f84c4704c299717d398317cd3f0'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:10.954614 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-88b5c845-d0cf-4b62-ad20-77a9ac6af76e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94356f84c4704c299717d398317cd3f0'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:10.979248 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1039/2055] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:17:10 2022] DELETE /identity/v3/users/94356f84c4704c299717d398317cd3f0 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:17:12.720291 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea86ecc-f97e-4186-8ba8-235d1d3ea638 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:12.722317 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-4ea86ecc-f97e-4186-8ba8-235d1d3ea638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:12.785517 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea86ecc-f97e-4186-8ba8-235d1d3ea638 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:13.009308 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc22ce84-1223-4f61-b2a6-4f96844a9cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:13.011904 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22ce84-1223-4f61-b2a6-4f96844a9cec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:13.019064 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22ce84-1223-4f61-b2a6-4f96844a9cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:13.022792 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22ce84-1223-4f61-b2a6-4f96844a9cec admin admin] PATH_INFO: `/v3/projects/4254a12f4e584459bf36ef30c1a8b780` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:13.026917 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc22ce84-1223-4f61-b2a6-4f96844a9cec admin admin] RBAC: Authorizing `identity:delete_project(project_id=4254a12f4e584459bf36ef30c1a8b780)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:13.030424 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc22ce84-1223-4f61-b2a6-4f96844a9cec admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:13.182992 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-bc22ce84-1223-4f61-b2a6-4f96844a9cec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4254a12f4e584459bf36ef30c1a8b780', 'request_id': 'req-bc22ce84-1223-4f61-b2a6-4f96844a9cec'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:13.190853 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-bc22ce84-1223-4f61-b2a6-4f96844a9cec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4254a12f4e584459bf36ef30c1a8b780', 'request_id': 'req-bc22ce84-1223-4f61-b2a6-4f96844a9cec'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:13.217668 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-bc22ce84-1223-4f61-b2a6-4f96844a9cec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4254a12f4e584459bf36ef30c1a8b780', 'request_id': 'req-bc22ce84-1223-4f61-b2a6-4f96844a9cec'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:13.239970 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-bc22ce84-1223-4f61-b2a6-4f96844a9cec admin admin] The token cache is being invalidate because project 4254a12f4e584459bf36ef30c1a8b780 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:17:13.240947 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-bc22ce84-1223-4f61-b2a6-4f96844a9cec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:13.242847 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-bc22ce84-1223-4f61-b2a6-4f96844a9cec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:13.249954 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1017/2056] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:12 2022] DELETE /identity/v3/projects/4254a12f4e584459bf36ef30c1a8b780 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:17:13.251477 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021171b-0863-4690-9a5c-dc9096391a50 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:13.251972 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021171b-0863-4690-9a5c-dc9096391a50 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:13.252050 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021171b-0863-4690-9a5c-dc9096391a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:13.294575 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-3021171b-0863-4690-9a5c-dc9096391a50 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:13.297060 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-3021171b-0863-4690-9a5c-dc9096391a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:13.417749 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1040/2057] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:17:13.426358 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5fc6a-191a-4d2a-a072-c2613d5288fd None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:13.427727 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5fc6a-191a-4d2a-a072-c2613d5288fd None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:13.428116 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5fc6a-191a-4d2a-a072-c2613d5288fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:13.440750 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:13.458846 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-3aa5fc6a-191a-4d2a-a072-c2613d5288fd None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:13.461408 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-3aa5fc6a-191a-4d2a-a072-c2613d5288fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:13.483221 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021171b-0863-4690-9a5c-dc9096391a50 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:13.490277 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1018/2058] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:17:13.493506 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:13.499463 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021171b-0863-4690-9a5c-dc9096391a50 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:13.514161 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20582fcc-9196-4206-b5e1-a1e33cb793f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:13.514934 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20582fcc-9196-4206-b5e1-a1e33cb793f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:13.515561 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20582fcc-9196-4206-b5e1-a1e33cb793f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:13.515928 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20582fcc-9196-4206-b5e1-a1e33cb793f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:13.517168 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20582fcc-9196-4206-b5e1-a1e33cb793f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:17:13.517701 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20582fcc-9196-4206-b5e1-a1e33cb793f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:13.519527 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20582fcc-9196-4206-b5e1-a1e33cb793f6 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:13.542736 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5fc6a-191a-4d2a-a072-c2613d5288fd None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:13.548129 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1041/2059] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:17:13.554643 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5fc6a-191a-4d2a-a072-c2613d5288fd None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:13.575447 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48986e0a-cb94-4b0d-be36-08584a641405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:13.577343 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48986e0a-cb94-4b0d-be36-08584a641405 admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:13.577832 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48986e0a-cb94-4b0d-be36-08584a641405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:13.578306 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48986e0a-cb94-4b0d-be36-08584a641405 admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:13.579942 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48986e0a-cb94-4b0d-be36-08584a641405 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:13.593171 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48986e0a-cb94-4b0d-be36-08584a641405 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:13.661930 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20582fcc-9196-4206-b5e1-a1e33cb793f6 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:13.673111 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1019/2060] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:17:13 2022] POST /identity/v3/projects => generated 377 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:17:13.680453 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20582fcc-9196-4206-b5e1-a1e33cb793f6 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:13.873491 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38009f1e-1798-4e94-a80f-5b212f9070a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:13.874144 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38009f1e-1798-4e94-a80f-5b212f9070a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:13.874419 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38009f1e-1798-4e94-a80f-5b212f9070a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:13.875049 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38009f1e-1798-4e94-a80f-5b212f9070a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:13.875749 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38009f1e-1798-4e94-a80f-5b212f9070a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:13.877687 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38009f1e-1798-4e94-a80f-5b212f9070a3 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:13.968318 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1042/2061] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:17:13 2022] POST /identity/v3/users => generated 289 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:17:13.972835 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48986e0a-cb94-4b0d-be36-08584a641405 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:13.991254 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48986e0a-cb94-4b0d-be36-08584a641405 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:14.012723 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d72cb8-5b40-4d04-93a1-fd0cefab57ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:14.013636 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d72cb8-5b40-4d04-93a1-fd0cefab57ba admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:14.019994 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d72cb8-5b40-4d04-93a1-fd0cefab57ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:14.022856 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d72cb8-5b40-4d04-93a1-fd0cefab57ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:14.025716 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d72cb8-5b40-4d04-93a1-fd0cefab57ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:14.033147 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d72cb8-5b40-4d04-93a1-fd0cefab57ba admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:14.066824 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38009f1e-1798-4e94-a80f-5b212f9070a3 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:14.070947 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1020/2062] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:17:14.081742 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38009f1e-1798-4e94-a80f-5b212f9070a3 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:14.097663 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c504c-23d0-4816-b72e-bced9ef8f67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:14.098672 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c504c-23d0-4816-b72e-bced9ef8f67c admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:14.098949 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c504c-23d0-4816-b72e-bced9ef8f67c admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:14.099219 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c504c-23d0-4816-b72e-bced9ef8f67c admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:14.100282 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c504c-23d0-4816-b72e-bced9ef8f67c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:14.101935 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c504c-23d0-4816-b72e-bced9ef8f67c admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:14.131198 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1043/2063] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:17:14.135637 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d72cb8-5b40-4d04-93a1-fd0cefab57ba admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:14.158679 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d72cb8-5b40-4d04-93a1-fd0cefab57ba admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:14.186944 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a266c-fb3e-4e3d-bcda-25cc49024dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:14.189006 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a266c-fb3e-4e3d-bcda-25cc49024dbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:14.191096 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a266c-fb3e-4e3d-bcda-25cc49024dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:14.192174 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a266c-fb3e-4e3d-bcda-25cc49024dbb admin admin] PATH_INFO: `/v3/projects/8636171250234d728758747edd1a71d2/users/de628153165445cf91e3dfdb5cc97f06/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:14.247859 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a266c-fb3e-4e3d-bcda-25cc49024dbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8636171250234d728758747edd1a71d2, user_id=de628153165445cf91e3dfdb5cc97f06, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:14.253362 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a266c-fb3e-4e3d-bcda-25cc49024dbb admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:14.310153 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1021/2064] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:17:14 2022] PUT /identity/v3/projects/8636171250234d728758747edd1a71d2/users/de628153165445cf91e3dfdb5cc97f06/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:17:14.311031 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0704ec-c91e-47ea-856a-d4df998b8c2c None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:14.311623 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0704ec-c91e-47ea-856a-d4df998b8c2c None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:14.311715 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0704ec-c91e-47ea-856a-d4df998b8c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:14.378437 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-ab0704ec-c91e-47ea-856a-d4df998b8c2c None None] MFA Rules not processed for user `de628153165445cf91e3dfdb5cc97f06`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:14.379904 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-ab0704ec-c91e-47ea-856a-d4df998b8c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:14.471031 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1044/2065] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:17:14.500228 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a266c-fb3e-4e3d-bcda-25cc49024dbb admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:14.502332 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-682a266c-fb3e-4e3d-bcda-25cc49024dbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:14.606918 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a266c-fb3e-4e3d-bcda-25cc49024dbb admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:14.612003 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8cdeed-4654-4ce9-983e-b6cb79bebb10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:14.612901 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cdeed-4654-4ce9-983e-b6cb79bebb10 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:14.613379 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cdeed-4654-4ce9-983e-b6cb79bebb10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:14.613848 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cdeed-4654-4ce9-983e-b6cb79bebb10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:14.624345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8cdeed-4654-4ce9-983e-b6cb79bebb10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:14.626696 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8cdeed-4654-4ce9-983e-b6cb79bebb10 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:14.657879 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1022/2066] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:17:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:17:17.071136 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0704ec-c91e-47ea-856a-d4df998b8c2c None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:17.072824 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-ab0704ec-c91e-47ea-856a-d4df998b8c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:17.166281 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0704ec-c91e-47ea-856a-d4df998b8c2c None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:17.171984 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086d9f0-d311-4a58-ad09-0f7ab29c2b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:17.172935 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086d9f0-d311-4a58-ad09-0f7ab29c2b4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:17.173419 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086d9f0-d311-4a58-ad09-0f7ab29c2b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:17.173879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086d9f0-d311-4a58-ad09-0f7ab29c2b4c admin admin] PATH_INFO: `/v3/users/dd37699a130f43e099fdfbbae5305e2d` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:17.175661 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b086d9f0-d311-4a58-ad09-0f7ab29c2b4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd37699a130f43e099fdfbbae5305e2d)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:17.177843 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b086d9f0-d311-4a58-ad09-0f7ab29c2b4c admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:17.180459 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:17.241704 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-b086d9f0-d311-4a58-ad09-0f7ab29c2b4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd37699a130f43e099fdfbbae5305e2d'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:17.249320 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-b086d9f0-d311-4a58-ad09-0f7ab29c2b4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd37699a130f43e099fdfbbae5305e2d'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:17.250558 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-b086d9f0-d311-4a58-ad09-0f7ab29c2b4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd37699a130f43e099fdfbbae5305e2d'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:17.265102 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-b086d9f0-d311-4a58-ad09-0f7ab29c2b4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd37699a130f43e099fdfbbae5305e2d'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:17.265832 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-b086d9f0-d311-4a58-ad09-0f7ab29c2b4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd37699a130f43e099fdfbbae5305e2d'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:17.291527 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1045/2067] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:17:17 2022] DELETE /identity/v3/users/dd37699a130f43e099fdfbbae5305e2d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:17:17.293853 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765818e-300a-4024-b532-882e36b18fd2 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:17.294355 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765818e-300a-4024-b532-882e36b18fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:17.294442 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765818e-300a-4024-b532-882e36b18fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:17.315320 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-1765818e-300a-4024-b532-882e36b18fd2 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:17.316939 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-1765818e-300a-4024-b532-882e36b18fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:17.409263 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1023/2068] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:17:17.428350 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086d9f0-d311-4a58-ad09-0f7ab29c2b4c admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:17.429858 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-b086d9f0-d311-4a58-ad09-0f7ab29c2b4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:17.494738 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086d9f0-d311-4a58-ad09-0f7ab29c2b4c admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:17.499313 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf0349-aaee-4b7b-85f0-12bf5980a045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:17.500513 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf0349-aaee-4b7b-85f0-12bf5980a045 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:17.500887 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf0349-aaee-4b7b-85f0-12bf5980a045 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:17.501248 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf0349-aaee-4b7b-85f0-12bf5980a045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:17.512449 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaf0349-aaee-4b7b-85f0-12bf5980a045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:17.514399 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaf0349-aaee-4b7b-85f0-12bf5980a045 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:17.529795 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1046/2069] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:17:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:17:18.200119 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765818e-300a-4024-b532-882e36b18fd2 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:18.201687 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-1765818e-300a-4024-b532-882e36b18fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:18.233036 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765818e-300a-4024-b532-882e36b18fd2 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:18.253797 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e9307-80f6-4c67-80f9-f76c5cb11ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:18.254639 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e9307-80f6-4c67-80f9-f76c5cb11ab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:18.255315 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e9307-80f6-4c67-80f9-f76c5cb11ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:18.255683 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e9307-80f6-4c67-80f9-f76c5cb11ab6 admin admin] PATH_INFO: `/v3/projects/0badb9fb0cd54e0d8fd12a18c4cc93f6` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:18.266964 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5e9307-80f6-4c67-80f9-f76c5cb11ab6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0badb9fb0cd54e0d8fd12a18c4cc93f6)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:18.271283 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5e9307-80f6-4c67-80f9-f76c5cb11ab6 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:18.327241 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:18.343478 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-5c5e9307-80f6-4c67-80f9-f76c5cb11ab6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0badb9fb0cd54e0d8fd12a18c4cc93f6', 'request_id': 'req-5c5e9307-80f6-4c67-80f9-f76c5cb11ab6'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:18.350215 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-5c5e9307-80f6-4c67-80f9-f76c5cb11ab6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0badb9fb0cd54e0d8fd12a18c4cc93f6', 'request_id': 'req-5c5e9307-80f6-4c67-80f9-f76c5cb11ab6'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:18.373589 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-5c5e9307-80f6-4c67-80f9-f76c5cb11ab6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0badb9fb0cd54e0d8fd12a18c4cc93f6', 'request_id': 'req-5c5e9307-80f6-4c67-80f9-f76c5cb11ab6'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:18.390368 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-5c5e9307-80f6-4c67-80f9-f76c5cb11ab6 admin admin] The token cache is being invalidate because project 0badb9fb0cd54e0d8fd12a18c4cc93f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:17:18.390660 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-5c5e9307-80f6-4c67-80f9-f76c5cb11ab6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:18.391500 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-5c5e9307-80f6-4c67-80f9-f76c5cb11ab6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:18.396217 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1024/2070] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:18 2022] DELETE /identity/v3/projects/0badb9fb0cd54e0d8fd12a18c4cc93f6 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:17:18.398281 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf0349-aaee-4b7b-85f0-12bf5980a045 service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:18.411559 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf0349-aaee-4b7b-85f0-12bf5980a045 service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:18.495512 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f8bf7-d80b-4790-80e9-0e657d0d948d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:18.496458 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f8bf7-d80b-4790-80e9-0e657d0d948d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:18.497415 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f8bf7-d80b-4790-80e9-0e657d0d948d admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:18.497881 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f8bf7-d80b-4790-80e9-0e657d0d948d admin admin] PATH_INFO: `/v3/users/cdfabc3d16da4b9aba999b0e96fa1c29` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:18.500369 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4f8bf7-d80b-4790-80e9-0e657d0d948d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdfabc3d16da4b9aba999b0e96fa1c29)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:18.502647 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4f8bf7-d80b-4790-80e9-0e657d0d948d admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:18.534191 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:18.619236 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-ac4f8bf7-d80b-4790-80e9-0e657d0d948d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdfabc3d16da4b9aba999b0e96fa1c29'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:18.645507 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-ac4f8bf7-d80b-4790-80e9-0e657d0d948d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdfabc3d16da4b9aba999b0e96fa1c29'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:18.646579 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-ac4f8bf7-d80b-4790-80e9-0e657d0d948d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdfabc3d16da4b9aba999b0e96fa1c29'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:18.695348 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-ac4f8bf7-d80b-4790-80e9-0e657d0d948d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdfabc3d16da4b9aba999b0e96fa1c29'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:18.696303 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-ac4f8bf7-d80b-4790-80e9-0e657d0d948d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdfabc3d16da4b9aba999b0e96fa1c29'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:18.738370 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1047/2071] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:17:18 2022] DELETE /identity/v3/users/cdfabc3d16da4b9aba999b0e96fa1c29 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:17:19.378042 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e9307-80f6-4c67-80f9-f76c5cb11ab6 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:19.380329 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-5c5e9307-80f6-4c67-80f9-f76c5cb11ab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:19.394300 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e9307-80f6-4c67-80f9-f76c5cb11ab6 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:19.483780 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2ecd13-83c1-4db2-bcfa-fbbd6692f576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:19.484472 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ecd13-83c1-4db2-bcfa-fbbd6692f576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:19.484748 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ecd13-83c1-4db2-bcfa-fbbd6692f576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:19.485024 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ecd13-83c1-4db2-bcfa-fbbd6692f576 admin admin] PATH_INFO: `/v3/projects/87c9f849d2984c0786af96d320629c56` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:19.487143 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2ecd13-83c1-4db2-bcfa-fbbd6692f576 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87c9f849d2984c0786af96d320629c56)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:19.489655 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2ecd13-83c1-4db2-bcfa-fbbd6692f576 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:19.586523 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-6e2ecd13-83c1-4db2-bcfa-fbbd6692f576 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87c9f849d2984c0786af96d320629c56', 'request_id': 'req-6e2ecd13-83c1-4db2-bcfa-fbbd6692f576'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:19.594239 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-6e2ecd13-83c1-4db2-bcfa-fbbd6692f576 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87c9f849d2984c0786af96d320629c56', 'request_id': 'req-6e2ecd13-83c1-4db2-bcfa-fbbd6692f576'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:19.602518 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-6e2ecd13-83c1-4db2-bcfa-fbbd6692f576 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87c9f849d2984c0786af96d320629c56', 'request_id': 'req-6e2ecd13-83c1-4db2-bcfa-fbbd6692f576'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:19.625560 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-6e2ecd13-83c1-4db2-bcfa-fbbd6692f576 admin admin] The token cache is being invalidate because project 87c9f849d2984c0786af96d320629c56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:17:19.626243 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-6e2ecd13-83c1-4db2-bcfa-fbbd6692f576 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:19.627232 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-6e2ecd13-83c1-4db2-bcfa-fbbd6692f576 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:19.630245 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1025/2072] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:19 2022] DELETE /identity/v3/projects/87c9f849d2984c0786af96d320629c56 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:17:19.635383 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c7e03-490c-4913-9dd6-7ccf388f516c None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:19.636113 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c7e03-490c-4913-9dd6-7ccf388f516c None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:19.636356 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c7e03-490c-4913-9dd6-7ccf388f516c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:19.672646 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-393c7e03-490c-4913-9dd6-7ccf388f516c None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:19.672986 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-393c7e03-490c-4913-9dd6-7ccf388f516c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:19.793860 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1048/2073] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:17:19.801315 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829f7cf-fc14-43ac-83b5-68cdd38f30f3 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:19.801604 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829f7cf-fc14-43ac-83b5-68cdd38f30f3 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:19.801880 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829f7cf-fc14-43ac-83b5-68cdd38f30f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:19.839044 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-8829f7cf-fc14-43ac-83b5-68cdd38f30f3 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:19.842415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-8829f7cf-fc14-43ac-83b5-68cdd38f30f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:19.859749 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1026/2074] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:17:19.863648 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c7e03-490c-4913-9dd6-7ccf388f516c None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:19.875269 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c7e03-490c-4913-9dd6-7ccf388f516c None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:19.880843 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe38ee-5805-4204-8b73-3e3282055e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:19.881648 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe38ee-5805-4204-8b73-3e3282055e66 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:19.882236 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe38ee-5805-4204-8b73-3e3282055e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:19.882560 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe38ee-5805-4204-8b73-3e3282055e66 admin admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:19.883392 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe38ee-5805-4204-8b73-3e3282055e66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:17:19.883839 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe38ee-5805-4204-8b73-3e3282055e66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:19.886433 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe38ee-5805-4204-8b73-3e3282055e66 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:19.902240 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1049/2075] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:17:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:17:19.906592 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829f7cf-fc14-43ac-83b5-68cdd38f30f3 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:19.918087 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829f7cf-fc14-43ac-83b5-68cdd38f30f3 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:19.923532 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48afb1b2-2707-4ffe-9145-5f28c24cef59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:19.923972 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48afb1b2-2707-4ffe-9145-5f28c24cef59 admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:19.924251 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48afb1b2-2707-4ffe-9145-5f28c24cef59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:19.924516 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48afb1b2-2707-4ffe-9145-5f28c24cef59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:19.925205 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48afb1b2-2707-4ffe-9145-5f28c24cef59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:19.927257 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48afb1b2-2707-4ffe-9145-5f28c24cef59 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:19.961078 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1027/2076] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:17:19 2022] POST /identity/v3/projects => generated 391 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:17:19.965076 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe38ee-5805-4204-8b73-3e3282055e66 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:19.979347 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe38ee-5805-4204-8b73-3e3282055e66 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:20.061658 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5cfa25-4bb8-4774-8fbd-da13465c7fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:20.061989 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cfa25-4bb8-4774-8fbd-da13465c7fb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:20.062335 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cfa25-4bb8-4774-8fbd-da13465c7fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:20.062974 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cfa25-4bb8-4774-8fbd-da13465c7fb0 admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:20.063724 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5cfa25-4bb8-4774-8fbd-da13465c7fb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:20.066483 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5cfa25-4bb8-4774-8fbd-da13465c7fb0 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:20.103784 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1050/2077] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:17:19 2022] POST /identity/v3/users => generated 296 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:17:20.106318 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48afb1b2-2707-4ffe-9145-5f28c24cef59 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:20.117988 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48afb1b2-2707-4ffe-9145-5f28c24cef59 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:20.125542 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf8664-41a2-42a2-a009-f88f74d70b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:20.126286 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf8664-41a2-42a2-a009-f88f74d70b82 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:20.126732 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf8664-41a2-42a2-a009-f88f74d70b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:20.126967 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf8664-41a2-42a2-a009-f88f74d70b82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:20.127838 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf8664-41a2-42a2-a009-f88f74d70b82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:20.130226 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf8664-41a2-42a2-a009-f88f74d70b82 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:20.146799 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1028/2078] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:17:20 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:17:20.148472 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5cfa25-4bb8-4774-8fbd-da13465c7fb0 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:20.162819 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5cfa25-4bb8-4774-8fbd-da13465c7fb0 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:20.170766 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9adc4-a783-4a4c-9b6b-0e8e991e2033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:20.172310 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9adc4-a783-4a4c-9b6b-0e8e991e2033 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:20.173482 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9adc4-a783-4a4c-9b6b-0e8e991e2033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:20.173851 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9adc4-a783-4a4c-9b6b-0e8e991e2033 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:20.175873 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f9adc4-a783-4a4c-9b6b-0e8e991e2033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:20.177608 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f9adc4-a783-4a4c-9b6b-0e8e991e2033 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:20.199073 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1051/2079] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:17:20 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:17:20.200422 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf8664-41a2-42a2-a009-f88f74d70b82 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:20.218433 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf8664-41a2-42a2-a009-f88f74d70b82 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:20.225518 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2d22a-dcaa-494a-9b2c-cd060cb493ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:20.226409 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2d22a-dcaa-494a-9b2c-cd060cb493ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:20.227448 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2d22a-dcaa-494a-9b2c-cd060cb493ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:20.227448 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2d22a-dcaa-494a-9b2c-cd060cb493ac admin admin] PATH_INFO: `/v3/projects/21338c68b4c8413eb59628b78deb47b5/users/12435feb6df84f0c880f513972b3fb77/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:20.253465 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:20.258190 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded2d22a-dcaa-494a-9b2c-cd060cb493ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=21338c68b4c8413eb59628b78deb47b5, user_id=12435feb6df84f0c880f513972b3fb77, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:20.263669 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded2d22a-dcaa-494a-9b2c-cd060cb493ac admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:20.305344 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1029/2080] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:17:20 2022] PUT /identity/v3/projects/21338c68b4c8413eb59628b78deb47b5/users/12435feb6df84f0c880f513972b3fb77/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:17:20.308278 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226e8ce-2ead-41f9-ac03-fc0a75c43b02 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:20.308738 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226e8ce-2ead-41f9-ac03-fc0a75c43b02 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:20.309206 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226e8ce-2ead-41f9-ac03-fc0a75c43b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:20.329825 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:20.368828 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-9226e8ce-2ead-41f9-ac03-fc0a75c43b02 None None] MFA Rules not processed for user `12435feb6df84f0c880f513972b3fb77`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:20.372358 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-9226e8ce-2ead-41f9-ac03-fc0a75c43b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:20.509450 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1052/2081] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:17:20.509631 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2d22a-dcaa-494a-9b2c-cd060cb493ac admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:20.612527 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2d22a-dcaa-494a-9b2c-cd060cb493ac admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:20.636600 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4817522-3730-4d38-9aff-2a36d2349c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:20.637894 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4817522-3730-4d38-9aff-2a36d2349c95 admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:20.638441 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4817522-3730-4d38-9aff-2a36d2349c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:20.638649 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4817522-3730-4d38-9aff-2a36d2349c95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:20.640054 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4817522-3730-4d38-9aff-2a36d2349c95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:20.646205 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4817522-3730-4d38-9aff-2a36d2349c95 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:20.714025 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1030/2082] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:17:20 2022] POST /identity/v3/projects => generated 393 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:17:20.715415 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226e8ce-2ead-41f9-ac03-fc0a75c43b02 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:20.728975 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226e8ce-2ead-41f9-ac03-fc0a75c43b02 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:20.825009 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ebaa4-6490-4fc3-9928-1ef6f76a5fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:20.825799 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ebaa4-6490-4fc3-9928-1ef6f76a5fa7 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:20.826309 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ebaa4-6490-4fc3-9928-1ef6f76a5fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:20.826725 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ebaa4-6490-4fc3-9928-1ef6f76a5fa7 admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:20.827557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6ebaa4-6490-4fc3-9928-1ef6f76a5fa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:20.829819 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6ebaa4-6490-4fc3-9928-1ef6f76a5fa7 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:20.859705 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1053/2083] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:17:20 2022] POST /identity/v3/users => generated 303 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:17:20.861901 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4817522-3730-4d38-9aff-2a36d2349c95 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:20.890226 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4817522-3730-4d38-9aff-2a36d2349c95 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:20.905516 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7bd7f-1ad7-4078-8dd7-4a77540ad4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:20.906176 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7bd7f-1ad7-4078-8dd7-4a77540ad4ee admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:20.906480 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7bd7f-1ad7-4078-8dd7-4a77540ad4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:20.906759 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7bd7f-1ad7-4078-8dd7-4a77540ad4ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:20.907565 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c7bd7f-1ad7-4078-8dd7-4a77540ad4ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:20.909319 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c7bd7f-1ad7-4078-8dd7-4a77540ad4ee admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:20.936245 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1031/2084] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:17:20 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:17:20.937947 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ebaa4-6490-4fc3-9928-1ef6f76a5fa7 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:20.958466 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ebaa4-6490-4fc3-9928-1ef6f76a5fa7 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:20.974145 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d3674-0c00-4af9-a6fc-d1ba27345ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:20.975030 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d3674-0c00-4af9-a6fc-d1ba27345ac6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:20.976808 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d3674-0c00-4af9-a6fc-d1ba27345ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:20.977099 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d3674-0c00-4af9-a6fc-d1ba27345ac6 admin admin] PATH_INFO: `/v3/projects/ebcbb8adeadb46329fa837c213d7e28b/users/fa74ec42d5c5444d9fc47f067004aec3/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:21.022569 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d3674-0c00-4af9-a6fc-d1ba27345ac6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebcbb8adeadb46329fa837c213d7e28b, user_id=fa74ec42d5c5444d9fc47f067004aec3, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:21.026420 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d3674-0c00-4af9-a6fc-d1ba27345ac6 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:21.043587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1054/2085] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:17:20 2022] PUT /identity/v3/projects/ebcbb8adeadb46329fa837c213d7e28b/users/fa74ec42d5c5444d9fc47f067004aec3/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:17:21.047535 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7bd7f-1ad7-4078-8dd7-4a77540ad4ee admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:21.065957 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7bd7f-1ad7-4078-8dd7-4a77540ad4ee admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:21.152346 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1bea7-0c1a-4122-8578-c4c84397db21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:21.153298 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1bea7-0c1a-4122-8578-c4c84397db21 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:21.153650 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1bea7-0c1a-4122-8578-c4c84397db21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:21.153993 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1bea7-0c1a-4122-8578-c4c84397db21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:21.154781 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1bea7-0c1a-4122-8578-c4c84397db21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:21.156571 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1bea7-0c1a-4122-8578-c4c84397db21 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:21.174894 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1032/2086] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:17:21.179412 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d3674-0c00-4af9-a6fc-d1ba27345ac6 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:21.192284 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d3674-0c00-4af9-a6fc-d1ba27345ac6 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:21.203233 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7106445-26da-41e9-ae7e-3afd6ca47ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:21.204008 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7106445-26da-41e9-ae7e-3afd6ca47ba2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:21.204285 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7106445-26da-41e9-ae7e-3afd6ca47ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:21.204598 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7106445-26da-41e9-ae7e-3afd6ca47ba2 admin admin] PATH_INFO: `/v3/projects/ebcbb8adeadb46329fa837c213d7e28b/users/fa74ec42d5c5444d9fc47f067004aec3/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:21.207351 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7106445-26da-41e9-ae7e-3afd6ca47ba2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebcbb8adeadb46329fa837c213d7e28b, user_id=fa74ec42d5c5444d9fc47f067004aec3, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:21.210326 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7106445-26da-41e9-ae7e-3afd6ca47ba2 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:21.237109 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1055/2087] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:17:21 2022] PUT /identity/v3/projects/ebcbb8adeadb46329fa837c213d7e28b/users/fa74ec42d5c5444d9fc47f067004aec3/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:17:21.250247 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32711224-b658-45b4-bf9b-3a1121a3ab9c None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:21.250622 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32711224-b658-45b4-bf9b-3a1121a3ab9c None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:21.250966 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32711224-b658-45b4-bf9b-3a1121a3ab9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:21.295733 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-32711224-b658-45b4-bf9b-3a1121a3ab9c None None] MFA Rules not processed for user `fa74ec42d5c5444d9fc47f067004aec3`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:21.298176 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-32711224-b658-45b4-bf9b-3a1121a3ab9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:21.370885 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:21.407537 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1033/2088] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:21 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:17:21.417453 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7106445-26da-41e9-ae7e-3afd6ca47ba2 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:21.419450 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-a7106445-26da-41e9-ae7e-3afd6ca47ba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:21.529595 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:21.539460 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7106445-26da-41e9-ae7e-3afd6ca47ba2 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:21.547251 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d592f-240f-419b-88d9-4f41e3bdcd4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:21.548526 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d592f-240f-419b-88d9-4f41e3bdcd4f service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:21.548526 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d592f-240f-419b-88d9-4f41e3bdcd4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:21.548526 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d592f-240f-419b-88d9-4f41e3bdcd4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:21.568245 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084d592f-240f-419b-88d9-4f41e3bdcd4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:21.570355 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084d592f-240f-419b-88d9-4f41e3bdcd4f service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:21.589391 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1056/2089] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:17:21 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:17:28.274613 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32711224-b658-45b4-bf9b-3a1121a3ab9c None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:28.278305 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-32711224-b658-45b4-bf9b-3a1121a3ab9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:28.436183 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32711224-b658-45b4-bf9b-3a1121a3ab9c None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:28.444087 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4adf31-cd50-4d46-b191-1d2f1a0f187f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:28.445365 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4adf31-cd50-4d46-b191-1d2f1a0f187f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:28.445913 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4adf31-cd50-4d46-b191-1d2f1a0f187f admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:28.446381 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4adf31-cd50-4d46-b191-1d2f1a0f187f admin admin] PATH_INFO: `/v3/users/611e5737b5334a228f9cd659b6295927` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:28.448610 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4adf31-cd50-4d46-b191-1d2f1a0f187f admin admin] RBAC: Authorizing `identity:delete_user(user_id=611e5737b5334a228f9cd659b6295927)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:28.451387 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4adf31-cd50-4d46-b191-1d2f1a0f187f admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:28.553911 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-1e4adf31-cd50-4d46-b191-1d2f1a0f187f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '611e5737b5334a228f9cd659b6295927'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:28.555309 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-1e4adf31-cd50-4d46-b191-1d2f1a0f187f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '611e5737b5334a228f9cd659b6295927'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:28.598894 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-1e4adf31-cd50-4d46-b191-1d2f1a0f187f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '611e5737b5334a228f9cd659b6295927'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:28.630097 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-1e4adf31-cd50-4d46-b191-1d2f1a0f187f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '611e5737b5334a228f9cd659b6295927'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:28.631668 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-1e4adf31-cd50-4d46-b191-1d2f1a0f187f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '611e5737b5334a228f9cd659b6295927'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:28.649802 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1034/2090] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:17:28 2022] DELETE /identity/v3/users/611e5737b5334a228f9cd659b6295927 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:17:28.654367 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868f0ac-17c3-4965-a831-37b2aad03b87 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:28.654916 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868f0ac-17c3-4965-a831-37b2aad03b87 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:28.655022 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868f0ac-17c3-4965-a831-37b2aad03b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:28.688769 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-d868f0ac-17c3-4965-a831-37b2aad03b87 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:28.690116 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-d868f0ac-17c3-4965-a831-37b2aad03b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:28.794723 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1057/2091] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:17:28.836504 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4adf31-cd50-4d46-b191-1d2f1a0f187f admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:28.838822 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-1e4adf31-cd50-4d46-b191-1d2f1a0f187f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:28.933135 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4adf31-cd50-4d46-b191-1d2f1a0f187f admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:28.938974 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6970fb-f7af-478d-bb9a-423700bd2c13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:28.939884 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6970fb-f7af-478d-bb9a-423700bd2c13 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:28.940170 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6970fb-f7af-478d-bb9a-423700bd2c13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:28.940445 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6970fb-f7af-478d-bb9a-423700bd2c13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:28.958241 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6970fb-f7af-478d-bb9a-423700bd2c13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:28.959929 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6970fb-f7af-478d-bb9a-423700bd2c13 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:29.005570 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1035/2092] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:17:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:17:30.820590 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d868f0ac-17c3-4965-a831-37b2aad03b87 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:30.822138 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-d868f0ac-17c3-4965-a831-37b2aad03b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:30.836224 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d868f0ac-17c3-4965-a831-37b2aad03b87 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:30.841784 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0881619-5c8d-4f11-a524-d326249092bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:30.842494 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0881619-5c8d-4f11-a524-d326249092bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:30.842833 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0881619-5c8d-4f11-a524-d326249092bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:30.843090 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0881619-5c8d-4f11-a524-d326249092bd admin admin] PATH_INFO: `/v3/projects/fb150317dd1f42789fc9e53d75885442` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:30.844528 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0881619-5c8d-4f11-a524-d326249092bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb150317dd1f42789fc9e53d75885442)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:30.846657 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0881619-5c8d-4f11-a524-d326249092bd admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:30.907470 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-f0881619-5c8d-4f11-a524-d326249092bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb150317dd1f42789fc9e53d75885442', 'request_id': 'req-f0881619-5c8d-4f11-a524-d326249092bd'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:30.914541 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-f0881619-5c8d-4f11-a524-d326249092bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb150317dd1f42789fc9e53d75885442', 'request_id': 'req-f0881619-5c8d-4f11-a524-d326249092bd'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:30.922150 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-f0881619-5c8d-4f11-a524-d326249092bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb150317dd1f42789fc9e53d75885442', 'request_id': 'req-f0881619-5c8d-4f11-a524-d326249092bd'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:30.953360 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-f0881619-5c8d-4f11-a524-d326249092bd admin admin] The token cache is being invalidate because project fb150317dd1f42789fc9e53d75885442 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:17:30.954019 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-f0881619-5c8d-4f11-a524-d326249092bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:30.955424 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-f0881619-5c8d-4f11-a524-d326249092bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:30.958226 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1058/2093] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:30 2022] DELETE /identity/v3/projects/fb150317dd1f42789fc9e53d75885442 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:17:30.961901 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6970fb-f7af-478d-bb9a-423700bd2c13 service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:30.975831 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6970fb-f7af-478d-bb9a-423700bd2c13 service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:30.985434 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:31.079652 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c68f1c-3123-4291-8e9a-9078057f546e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:31.080427 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c68f1c-3123-4291-8e9a-9078057f546e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:31.080749 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c68f1c-3123-4291-8e9a-9078057f546e admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:31.081027 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c68f1c-3123-4291-8e9a-9078057f546e admin admin] PATH_INFO: `/v3/users/4ae7b58ba506480e8b646a428e833d7b` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:31.082570 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c68f1c-3123-4291-8e9a-9078057f546e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ae7b58ba506480e8b646a428e833d7b)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:31.085943 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c68f1c-3123-4291-8e9a-9078057f546e admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:31.169638 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-41c68f1c-3123-4291-8e9a-9078057f546e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ae7b58ba506480e8b646a428e833d7b'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:31.170813 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-41c68f1c-3123-4291-8e9a-9078057f546e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ae7b58ba506480e8b646a428e833d7b'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:31.190838 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-41c68f1c-3123-4291-8e9a-9078057f546e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ae7b58ba506480e8b646a428e833d7b'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:31.202331 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-41c68f1c-3123-4291-8e9a-9078057f546e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ae7b58ba506480e8b646a428e833d7b'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:31.203459 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-41c68f1c-3123-4291-8e9a-9078057f546e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ae7b58ba506480e8b646a428e833d7b'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:31.226953 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1036/2094] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:17:30 2022] DELETE /identity/v3/users/4ae7b58ba506480e8b646a428e833d7b => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:17:32.037661 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0881619-5c8d-4f11-a524-d326249092bd admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:32.040941 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-f0881619-5c8d-4f11-a524-d326249092bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:32.063867 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0881619-5c8d-4f11-a524-d326249092bd admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:32.183615 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c68f1c-3123-4291-8e9a-9078057f546e admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:32.187023 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-41c68f1c-3123-4291-8e9a-9078057f546e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:32.205735 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa2d2e8-1f28-4a30-8d63-7881312010e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:32.208209 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2d2e8-1f28-4a30-8d63-7881312010e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:32.208489 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2d2e8-1f28-4a30-8d63-7881312010e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:32.208761 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2d2e8-1f28-4a30-8d63-7881312010e0 admin admin] PATH_INFO: `/v3/users/12435feb6df84f0c880f513972b3fb77` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:32.222533 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa2d2e8-1f28-4a30-8d63-7881312010e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12435feb6df84f0c880f513972b3fb77)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:32.226411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c68f1c-3123-4291-8e9a-9078057f546e admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:32.227265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa2d2e8-1f28-4a30-8d63-7881312010e0 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:32.260725 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0ead2-7210-4071-9992-2d23570c3e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:32.261610 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0ead2-7210-4071-9992-2d23570c3e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:32.261714 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0ead2-7210-4071-9992-2d23570c3e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:32.261989 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0ead2-7210-4071-9992-2d23570c3e81 admin admin] PATH_INFO: `/v3/projects/aa65a433ac40470dbd195639561da426` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:32.275463 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0ead2-7210-4071-9992-2d23570c3e81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa65a433ac40470dbd195639561da426)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:32.279973 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0ead2-7210-4071-9992-2d23570c3e81 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:32.290418 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:32.372626 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-8fa2d2e8-1f28-4a30-8d63-7881312010e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12435feb6df84f0c880f513972b3fb77'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:32.385063 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-b7f0ead2-7210-4071-9992-2d23570c3e81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa65a433ac40470dbd195639561da426', 'request_id': 'req-b7f0ead2-7210-4071-9992-2d23570c3e81'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:32.387191 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-8fa2d2e8-1f28-4a30-8d63-7881312010e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12435feb6df84f0c880f513972b3fb77'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:32.388297 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-8fa2d2e8-1f28-4a30-8d63-7881312010e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12435feb6df84f0c880f513972b3fb77'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:32.399846 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-b7f0ead2-7210-4071-9992-2d23570c3e81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa65a433ac40470dbd195639561da426', 'request_id': 'req-b7f0ead2-7210-4071-9992-2d23570c3e81'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:32.409390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-b7f0ead2-7210-4071-9992-2d23570c3e81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa65a433ac40470dbd195639561da426', 'request_id': 'req-b7f0ead2-7210-4071-9992-2d23570c3e81'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:32.414760 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-8fa2d2e8-1f28-4a30-8d63-7881312010e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12435feb6df84f0c880f513972b3fb77'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:32.415856 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-8fa2d2e8-1f28-4a30-8d63-7881312010e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12435feb6df84f0c880f513972b3fb77'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:32.433411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-b7f0ead2-7210-4071-9992-2d23570c3e81 admin admin] The token cache is being invalidate because project aa65a433ac40470dbd195639561da426 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:17:32.433756 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-b7f0ead2-7210-4071-9992-2d23570c3e81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:32.434454 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-b7f0ead2-7210-4071-9992-2d23570c3e81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:32.439717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1037/2095] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:32 2022] DELETE /identity/v3/projects/aa65a433ac40470dbd195639561da426 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:17:32.441194 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cb529-b0d3-40ac-ab95-867a7f3e7734 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:32.441482 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cb529-b0d3-40ac-ab95-867a7f3e7734 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:32.441620 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1059/2096] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:17:32 2022] DELETE /identity/v3/users/12435feb6df84f0c880f513972b3fb77 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:17:32.441835 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cb529-b0d3-40ac-ab95-867a7f3e7734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:32.448652 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c48091-9bb1-476b-b45e-d60f39cd11dd None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:32.449079 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c48091-9bb1-476b-b45e-d60f39cd11dd None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:32.449453 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c48091-9bb1-476b-b45e-d60f39cd11dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:32.472181 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-87c48091-9bb1-476b-b45e-d60f39cd11dd None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:32.472980 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-538cb529-b0d3-40ac-ab95-867a7f3e7734 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:32.473926 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-87c48091-9bb1-476b-b45e-d60f39cd11dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:32.475383 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-538cb529-b0d3-40ac-ab95-867a7f3e7734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:32.483789 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:32.578030 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1060/2097] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:17:32.586950 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1038/2098] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:17:32.595867 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac758384-68d1-46c9-880c-1a0c506e0858 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:32.596168 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac758384-68d1-46c9-880c-1a0c506e0858 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:32.596418 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac758384-68d1-46c9-880c-1a0c506e0858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:32.599171 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cb529-b0d3-40ac-ab95-867a7f3e7734 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:32.601746 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-538cb529-b0d3-40ac-ab95-867a7f3e7734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:32.644095 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-ac758384-68d1-46c9-880c-1a0c506e0858 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:32.645451 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-ac758384-68d1-46c9-880c-1a0c506e0858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:32.658770 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1061/2099] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:17:32.660604 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac758384-68d1-46c9-880c-1a0c506e0858 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:32.693337 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cb529-b0d3-40ac-ab95-867a7f3e7734 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:32.698873 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15ea58-3890-4dc7-8b8c-754dc8054cdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:32.699860 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15ea58-3890-4dc7-8b8c-754dc8054cdb service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:32.700774 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15ea58-3890-4dc7-8b8c-754dc8054cdb service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:32.701959 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15ea58-3890-4dc7-8b8c-754dc8054cdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:32.705409 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac758384-68d1-46c9-880c-1a0c506e0858 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:32.714376 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9f6a8-bc62-4e11-8e4a-05956177f5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:32.715019 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9f6a8-bc62-4e11-8e4a-05956177f5e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:32.715298 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9f6a8-bc62-4e11-8e4a-05956177f5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:32.715593 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9f6a8-bc62-4e11-8e4a-05956177f5e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:32.716301 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc9f6a8-bc62-4e11-8e4a-05956177f5e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:17:32.716637 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc9f6a8-bc62-4e11-8e4a-05956177f5e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:32.717595 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d15ea58-3890-4dc7-8b8c-754dc8054cdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:32.718230 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc9f6a8-bc62-4e11-8e4a-05956177f5e0 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:32.719956 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d15ea58-3890-4dc7-8b8c-754dc8054cdb service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:32.748270 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1039/2100] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:17:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:17:32.765865 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15ea58-3890-4dc7-8b8c-754dc8054cdb service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:32.770077 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1062/2101] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:17:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:17:32.782316 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15ea58-3890-4dc7-8b8c-754dc8054cdb service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:32.788102 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50aaea8-1aea-4afe-aaea-3f8e6aed8123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:32.789055 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50aaea8-1aea-4afe-aaea-3f8e6aed8123 admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:32.789438 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50aaea8-1aea-4afe-aaea-3f8e6aed8123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:32.789830 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50aaea8-1aea-4afe-aaea-3f8e6aed8123 admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:32.790662 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50aaea8-1aea-4afe-aaea-3f8e6aed8123 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:32.792951 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50aaea8-1aea-4afe-aaea-3f8e6aed8123 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:32.839522 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9f6a8-bc62-4e11-8e4a-05956177f5e0 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:32.847393 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1040/2102] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:17:32 2022] POST /identity/v3/projects => generated 373 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:17:32.852198 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9f6a8-bc62-4e11-8e4a-05956177f5e0 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:32.963221 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e882f80-f252-45a3-b33f-1af47713d429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:32.964374 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e882f80-f252-45a3-b33f-1af47713d429 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:32.964834 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e882f80-f252-45a3-b33f-1af47713d429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:32.965206 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e882f80-f252-45a3-b33f-1af47713d429 admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:32.966186 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e882f80-f252-45a3-b33f-1af47713d429 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:32.968881 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e882f80-f252-45a3-b33f-1af47713d429 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:33.022804 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50aaea8-1aea-4afe-aaea-3f8e6aed8123 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:33.039235 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1063/2103] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:17:32 2022] POST /identity/v3/users => generated 287 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:17:33.042809 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50aaea8-1aea-4afe-aaea-3f8e6aed8123 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:33.048898 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f27754-3486-4382-8d18-144977afaa51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:33.049697 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f27754-3486-4382-8d18-144977afaa51 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:33.050072 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f27754-3486-4382-8d18-144977afaa51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:33.050446 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f27754-3486-4382-8d18-144977afaa51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:33.051442 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f27754-3486-4382-8d18-144977afaa51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:33.053361 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f27754-3486-4382-8d18-144977afaa51 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:33.077274 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e882f80-f252-45a3-b33f-1af47713d429 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:33.095369 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:33.099969 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1041/2104] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:17:33.105782 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e882f80-f252-45a3-b33f-1af47713d429 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:33.114538 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e6cdf-ca8c-415b-9754-19f57d4bd87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:33.116611 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e6cdf-ca8c-415b-9754-19f57d4bd87c admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:33.117087 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e6cdf-ca8c-415b-9754-19f57d4bd87c admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:33.118459 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e6cdf-ca8c-415b-9754-19f57d4bd87c admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:33.119665 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e6cdf-ca8c-415b-9754-19f57d4bd87c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:33.123017 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e6cdf-ca8c-415b-9754-19f57d4bd87c admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:33.150554 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f27754-3486-4382-8d18-144977afaa51 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:33.164835 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1064/2105] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:17:33.168389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f27754-3486-4382-8d18-144977afaa51 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:33.174989 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1e67f-db0b-4e6b-a01a-dfaf30e5e38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:33.175788 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1e67f-db0b-4e6b-a01a-dfaf30e5e38f admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:33.176028 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1e67f-db0b-4e6b-a01a-dfaf30e5e38f admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:33.176928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1e67f-db0b-4e6b-a01a-dfaf30e5e38f admin admin] PATH_INFO: `/v3/projects/2e5868b4f4b1410cb24d96c15c2f4bd9/users/dc57c8dade97415496fe1d3ea32f9fd8/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:33.201054 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a1e67f-db0b-4e6b-a01a-dfaf30e5e38f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e5868b4f4b1410cb24d96c15c2f4bd9, user_id=dc57c8dade97415496fe1d3ea32f9fd8, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:33.205274 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a1e67f-db0b-4e6b-a01a-dfaf30e5e38f admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:33.263576 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d5fa7-457b-498d-a4c6-d79bd2a5e5d2 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:33.263871 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d5fa7-457b-498d-a4c6-d79bd2a5e5d2 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:33.264152 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d5fa7-457b-498d-a4c6-d79bd2a5e5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:33.270343 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1042/2106] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:17:33 2022] PUT /identity/v3/projects/2e5868b4f4b1410cb24d96c15c2f4bd9/users/dc57c8dade97415496fe1d3ea32f9fd8/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:17:33.319104 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-5c8d5fa7-457b-498d-a4c6-d79bd2a5e5d2 None None] MFA Rules not processed for user `dc57c8dade97415496fe1d3ea32f9fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:33.320465 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-5c8d5fa7-457b-498d-a4c6-d79bd2a5e5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:33.359077 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1e67f-db0b-4e6b-a01a-dfaf30e5e38f admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:33.359077 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-44a1e67f-db0b-4e6b-a01a-dfaf30e5e38f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:33.517656 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1065/2107] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:17:33.537243 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d5fa7-457b-498d-a4c6-d79bd2a5e5d2 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:33.540045 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:33.557959 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1e67f-db0b-4e6b-a01a-dfaf30e5e38f admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:33.566359 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95475615-1649-4791-9a01-453416b0435d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:33.567414 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95475615-1649-4791-9a01-453416b0435d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:33.568024 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95475615-1649-4791-9a01-453416b0435d admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:33.568471 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95475615-1649-4791-9a01-453416b0435d admin admin] PATH_INFO: `/v3/users/99aa39acd1af476783b48c76a36fb13e` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:33.573479 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95475615-1649-4791-9a01-453416b0435d admin admin] RBAC: Authorizing `identity:delete_user(user_id=99aa39acd1af476783b48c76a36fb13e)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:33.577023 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95475615-1649-4791-9a01-453416b0435d admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:33.696404 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d5fa7-457b-498d-a4c6-d79bd2a5e5d2 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:33.707023 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-95475615-1649-4791-9a01-453416b0435d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99aa39acd1af476783b48c76a36fb13e'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:33.709154 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c76d8-f245-466e-bb3a-58780d94f18c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:33.709686 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-95475615-1649-4791-9a01-453416b0435d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99aa39acd1af476783b48c76a36fb13e'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:33.711880 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c76d8-f245-466e-bb3a-58780d94f18c service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:33.712614 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c76d8-f245-466e-bb3a-58780d94f18c service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:33.713229 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c76d8-f245-466e-bb3a-58780d94f18c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:33.727001 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282c76d8-f245-466e-bb3a-58780d94f18c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:33.728850 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282c76d8-f245-466e-bb3a-58780d94f18c service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:33.743618 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-95475615-1649-4791-9a01-453416b0435d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99aa39acd1af476783b48c76a36fb13e'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:33.753075 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1066/2108] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:17:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:17:33.758428 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-95475615-1649-4791-9a01-453416b0435d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99aa39acd1af476783b48c76a36fb13e'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:33.759357 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-95475615-1649-4791-9a01-453416b0435d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99aa39acd1af476783b48c76a36fb13e'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:33.779390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1043/2109] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:17:33 2022] DELETE /identity/v3/users/99aa39acd1af476783b48c76a36fb13e => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:17:33.781066 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88e2eb-296c-40cf-a66a-21b6c45c45fd None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:33.781332 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88e2eb-296c-40cf-a66a-21b6c45c45fd None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:33.781610 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88e2eb-296c-40cf-a66a-21b6c45c45fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:33.817852 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-fe88e2eb-296c-40cf-a66a-21b6c45c45fd None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:33.818827 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-fe88e2eb-296c-40cf-a66a-21b6c45c45fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:33.946720 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1067/2110] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:17:33.952942 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95475615-1649-4791-9a01-453416b0435d admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:33.955268 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-95475615-1649-4791-9a01-453416b0435d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:33.980975 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95475615-1649-4791-9a01-453416b0435d admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:33.992692 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a29ac-1854-4803-8304-6fdd5cb30d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:33.996096 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a29ac-1854-4803-8304-6fdd5cb30d0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:33.996615 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a29ac-1854-4803-8304-6fdd5cb30d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:33.996974 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a29ac-1854-4803-8304-6fdd5cb30d0e admin admin] PATH_INFO: `/v3/projects/21338c68b4c8413eb59628b78deb47b5` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:33.999332 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a29ac-1854-4803-8304-6fdd5cb30d0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=21338c68b4c8413eb59628b78deb47b5)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:34.006048 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a29ac-1854-4803-8304-6fdd5cb30d0e admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:34.026134 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88e2eb-296c-40cf-a66a-21b6c45c45fd None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:34.027797 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-fe88e2eb-296c-40cf-a66a-21b6c45c45fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:34.098100 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:34.126269 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-047a29ac-1854-4803-8304-6fdd5cb30d0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21338c68b4c8413eb59628b78deb47b5', 'request_id': 'req-047a29ac-1854-4803-8304-6fdd5cb30d0e'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:34.144280 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-047a29ac-1854-4803-8304-6fdd5cb30d0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21338c68b4c8413eb59628b78deb47b5', 'request_id': 'req-047a29ac-1854-4803-8304-6fdd5cb30d0e'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:34.163022 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-047a29ac-1854-4803-8304-6fdd5cb30d0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21338c68b4c8413eb59628b78deb47b5', 'request_id': 'req-047a29ac-1854-4803-8304-6fdd5cb30d0e'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:34.164342 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88e2eb-296c-40cf-a66a-21b6c45c45fd None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:34.206516 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-047a29ac-1854-4803-8304-6fdd5cb30d0e admin admin] The token cache is being invalidate because project 21338c68b4c8413eb59628b78deb47b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:17:34.207126 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-047a29ac-1854-4803-8304-6fdd5cb30d0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:34.208162 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-047a29ac-1854-4803-8304-6fdd5cb30d0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:34.216368 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1044/2111] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:33 2022] DELETE /identity/v3/projects/21338c68b4c8413eb59628b78deb47b5 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:17:34.217348 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a29ac-1854-4803-8304-6fdd5cb30d0e admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:34.221061 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-047a29ac-1854-4803-8304-6fdd5cb30d0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:34.294859 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68019c7-2bab-4bfe-aeb5-30f2aa35b641 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:34.295679 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68019c7-2bab-4bfe-aeb5-30f2aa35b641 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:34.296063 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68019c7-2bab-4bfe-aeb5-30f2aa35b641 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:34.296542 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68019c7-2bab-4bfe-aeb5-30f2aa35b641 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:34.298588 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-a68019c7-2bab-4bfe-aeb5-30f2aa35b641 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:34.330890 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a29ac-1854-4803-8304-6fdd5cb30d0e admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:34.336143 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb9a7b-872a-4c2d-9e78-885e064b641d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:34.336987 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb9a7b-872a-4c2d-9e78-885e064b641d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:34.337122 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb9a7b-872a-4c2d-9e78-885e064b641d admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:34.337397 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb9a7b-872a-4c2d-9e78-885e064b641d admin admin] PATH_INFO: `/v3/users/fa74ec42d5c5444d9fc47f067004aec3` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:34.339553 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eb9a7b-872a-4c2d-9e78-885e064b641d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa74ec42d5c5444d9fc47f067004aec3)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:34.341542 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eb9a7b-872a-4c2d-9e78-885e064b641d admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:34.343371 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:34.416211 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-74eb9a7b-872a-4c2d-9e78-885e064b641d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa74ec42d5c5444d9fc47f067004aec3'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:34.417034 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-74eb9a7b-872a-4c2d-9e78-885e064b641d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa74ec42d5c5444d9fc47f067004aec3'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:34.443427 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-74eb9a7b-872a-4c2d-9e78-885e064b641d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa74ec42d5c5444d9fc47f067004aec3'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:34.445386 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68019c7-2bab-4bfe-aeb5-30f2aa35b641 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:34.448607 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68019c7-2bab-4bfe-aeb5-30f2aa35b641 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:34.466863 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-74eb9a7b-872a-4c2d-9e78-885e064b641d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa74ec42d5c5444d9fc47f067004aec3'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:34.467293 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-74eb9a7b-872a-4c2d-9e78-885e064b641d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa74ec42d5c5444d9fc47f067004aec3'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:34.478847 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1068/2112] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:17:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:17:34.493299 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1045/2113] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:17:34 2022] DELETE /identity/v3/users/fa74ec42d5c5444d9fc47f067004aec3 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:17:35.290556 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68019c7-2bab-4bfe-aeb5-30f2aa35b641 service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:35.303597 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68019c7-2bab-4bfe-aeb5-30f2aa35b641 service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:35.402137 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03824d2-bec9-43b1-b416-a34b31bd8dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:35.403304 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03824d2-bec9-43b1-b416-a34b31bd8dc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:35.403784 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03824d2-bec9-43b1-b416-a34b31bd8dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:35.404576 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03824d2-bec9-43b1-b416-a34b31bd8dc4 admin admin] PATH_INFO: `/v3/projects/ebcbb8adeadb46329fa837c213d7e28b` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:35.407274 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03824d2-bec9-43b1-b416-a34b31bd8dc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebcbb8adeadb46329fa837c213d7e28b)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:35.410465 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03824d2-bec9-43b1-b416-a34b31bd8dc4 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:35.467818 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:35.490094 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-c03824d2-bec9-43b1-b416-a34b31bd8dc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebcbb8adeadb46329fa837c213d7e28b', 'request_id': 'req-c03824d2-bec9-43b1-b416-a34b31bd8dc4'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:35.500154 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-c03824d2-bec9-43b1-b416-a34b31bd8dc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebcbb8adeadb46329fa837c213d7e28b', 'request_id': 'req-c03824d2-bec9-43b1-b416-a34b31bd8dc4'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:35.510542 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-c03824d2-bec9-43b1-b416-a34b31bd8dc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebcbb8adeadb46329fa837c213d7e28b', 'request_id': 'req-c03824d2-bec9-43b1-b416-a34b31bd8dc4'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:35.533146 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-c03824d2-bec9-43b1-b416-a34b31bd8dc4 admin admin] The token cache is being invalidate because project ebcbb8adeadb46329fa837c213d7e28b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:17:35.533736 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-c03824d2-bec9-43b1-b416-a34b31bd8dc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:35.534550 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-c03824d2-bec9-43b1-b416-a34b31bd8dc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:35.537238 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1069/2114] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:35 2022] DELETE /identity/v3/projects/ebcbb8adeadb46329fa837c213d7e28b => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:17:35.542167 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7027ebf-0224-4a12-85d4-cd4109a5cf0d None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:35.542651 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7027ebf-0224-4a12-85d4-cd4109a5cf0d None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:35.542735 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7027ebf-0224-4a12-85d4-cd4109a5cf0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:35.563230 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-a7027ebf-0224-4a12-85d4-cd4109a5cf0d None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:35.564673 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-a7027ebf-0224-4a12-85d4-cd4109a5cf0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:35.643150 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1046/2115] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:17:35.650956 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22d4cd-1c93-4e35-be94-121963301d07 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:35.651576 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22d4cd-1c93-4e35-be94-121963301d07 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:35.651937 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22d4cd-1c93-4e35-be94-121963301d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:35.670870 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7027ebf-0224-4a12-85d4-cd4109a5cf0d None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:35.672865 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-a7027ebf-0224-4a12-85d4-cd4109a5cf0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:35.680586 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-1a22d4cd-1c93-4e35-be94-121963301d07 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:35.682213 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-1a22d4cd-1c93-4e35-be94-121963301d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:35.692450 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1070/2116] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:17:35.696742 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22d4cd-1c93-4e35-be94-121963301d07 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:35.698409 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7027ebf-0224-4a12-85d4-cd4109a5cf0d None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:35.724304 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22d4cd-1c93-4e35-be94-121963301d07 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:35.731780 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7415fb82-265a-499f-a1ba-4088ce11ad39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:35.732603 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415fb82-265a-499f-a1ba-4088ce11ad39 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:35.733034 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415fb82-265a-499f-a1ba-4088ce11ad39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:35.733443 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415fb82-265a-499f-a1ba-4088ce11ad39 admin admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:35.734318 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7415fb82-265a-499f-a1ba-4088ce11ad39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:17:35.734756 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7415fb82-265a-499f-a1ba-4088ce11ad39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:35.737475 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7415fb82-265a-499f-a1ba-4088ce11ad39 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:35.742938 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc9710f-7f25-4324-a41e-df4003a72499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:35.744688 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9710f-7f25-4324-a41e-df4003a72499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:35.745931 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9710f-7f25-4324-a41e-df4003a72499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:35.747215 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9710f-7f25-4324-a41e-df4003a72499 admin admin] PATH_INFO: `/v3/projects/076fdcdec4664182a36a6baff7c25ed4` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:35.751157 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc9710f-7f25-4324-a41e-df4003a72499 admin admin] RBAC: Authorizing `identity:delete_project(project_id=076fdcdec4664182a36a6baff7c25ed4)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:35.757313 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc9710f-7f25-4324-a41e-df4003a72499 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:35.764317 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1071/2117] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:17:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:17:35.768545 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7415fb82-265a-499f-a1ba-4088ce11ad39 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:35.786226 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7415fb82-265a-499f-a1ba-4088ce11ad39 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:35.798598 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e3841-c655-4dcf-9cc8-95613e5ca413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:35.800068 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e3841-c655-4dcf-9cc8-95613e5ca413 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:35.801755 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e3841-c655-4dcf-9cc8-95613e5ca413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:35.802071 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e3841-c655-4dcf-9cc8-95613e5ca413 admin admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:35.803310 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e3841-c655-4dcf-9cc8-95613e5ca413 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:35.804929 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e3841-c655-4dcf-9cc8-95613e5ca413 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:35.836218 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-0cc9710f-7f25-4324-a41e-df4003a72499 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '076fdcdec4664182a36a6baff7c25ed4', 'request_id': 'req-0cc9710f-7f25-4324-a41e-df4003a72499'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:35.845077 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-0cc9710f-7f25-4324-a41e-df4003a72499 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '076fdcdec4664182a36a6baff7c25ed4', 'request_id': 'req-0cc9710f-7f25-4324-a41e-df4003a72499'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:35.858557 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-0cc9710f-7f25-4324-a41e-df4003a72499 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '076fdcdec4664182a36a6baff7c25ed4', 'request_id': 'req-0cc9710f-7f25-4324-a41e-df4003a72499'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:35.886855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1072/2118] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:17:35 2022] POST /identity/v3/projects => generated 371 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:17:35.889123 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-0cc9710f-7f25-4324-a41e-df4003a72499 admin admin] The token cache is being invalidate because project 076fdcdec4664182a36a6baff7c25ed4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:17:35.889831 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-0cc9710f-7f25-4324-a41e-df4003a72499 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:35.890854 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-0cc9710f-7f25-4324-a41e-df4003a72499 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:35.896051 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1047/2119] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:35 2022] DELETE /identity/v3/projects/076fdcdec4664182a36a6baff7c25ed4 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:17:35.898073 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd1fe9-cbe2-4004-ba57-ca397569098c None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:35.898466 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd1fe9-cbe2-4004-ba57-ca397569098c None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:35.898814 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e3841-c655-4dcf-9cc8-95613e5ca413 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:35.898956 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd1fe9-cbe2-4004-ba57-ca397569098c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:35.905553 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-a89e3841-c655-4dcf-9cc8-95613e5ca413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:35.920198 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:35.952967 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-02fd1fe9-cbe2-4004-ba57-ca397569098c None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:35.958626 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-02fd1fe9-cbe2-4004-ba57-ca397569098c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:36.060544 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e3841-c655-4dcf-9cc8-95613e5ca413 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:36.067792 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f14e4b-89ae-4721-89d3-9e060c3622ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:36.069006 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f14e4b-89ae-4721-89d3-9e060c3622ed admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:36.069441 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f14e4b-89ae-4721-89d3-9e060c3622ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:36.069894 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f14e4b-89ae-4721-89d3-9e060c3622ed admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:36.072071 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f14e4b-89ae-4721-89d3-9e060c3622ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:36.075297 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f14e4b-89ae-4721-89d3-9e060c3622ed admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:36.090375 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1048/2120] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:17:36.090375 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd1fe9-cbe2-4004-ba57-ca397569098c None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:36.090375 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-02fd1fe9-cbe2-4004-ba57-ca397569098c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:36.108089 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd1fe9-cbe2-4004-ba57-ca397569098c None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:36.114129 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d4c9e-3cc9-411d-a836-36329aadff96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:36.115427 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d4c9e-3cc9-411d-a836-36329aadff96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:36.123788 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1073/2121] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:17:35 2022] POST /identity/v3/users => generated 286 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:17:36.125881 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac99716-94d8-4b53-a1af-3f2f0d68c432 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:36.126192 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac99716-94d8-4b53-a1af-3f2f0d68c432 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:36.126557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac99716-94d8-4b53-a1af-3f2f0d68c432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:36.130543 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d4c9e-3cc9-411d-a836-36329aadff96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:36.131576 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d4c9e-3cc9-411d-a836-36329aadff96 admin admin] PATH_INFO: `/v3/users/dc57c8dade97415496fe1d3ea32f9fd8` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:36.133950 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d4c9e-3cc9-411d-a836-36329aadff96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc57c8dade97415496fe1d3ea32f9fd8)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:36.139730 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d4c9e-3cc9-411d-a836-36329aadff96 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:36.180141 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-aac99716-94d8-4b53-a1af-3f2f0d68c432 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:36.181412 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-aac99716-94d8-4b53-a1af-3f2f0d68c432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:36.191857 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1074/2122] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:17:36.193185 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac99716-94d8-4b53-a1af-3f2f0d68c432 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:36.205916 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac99716-94d8-4b53-a1af-3f2f0d68c432 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:36.214434 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51190c-4e07-4e08-bdae-c601c359fa90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:36.215290 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51190c-4e07-4e08-bdae-c601c359fa90 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:36.215824 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51190c-4e07-4e08-bdae-c601c359fa90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:36.216311 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51190c-4e07-4e08-bdae-c601c359fa90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:36.217316 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c51190c-4e07-4e08-bdae-c601c359fa90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:36.219480 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c51190c-4e07-4e08-bdae-c601c359fa90 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:36.234089 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-1c3d4c9e-3cc9-411d-a836-36329aadff96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc57c8dade97415496fe1d3ea32f9fd8'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:36.235806 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-1c3d4c9e-3cc9-411d-a836-36329aadff96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc57c8dade97415496fe1d3ea32f9fd8'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:36.240909 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1075/2123] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:17:36.242504 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51190c-4e07-4e08-bdae-c601c359fa90 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:36.254778 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51190c-4e07-4e08-bdae-c601c359fa90 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:36.256296 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-1c3d4c9e-3cc9-411d-a836-36329aadff96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc57c8dade97415496fe1d3ea32f9fd8'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:36.259714 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb5636a-db4b-4dac-b503-28099003a30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:36.260454 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5636a-db4b-4dac-b503-28099003a30c admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:36.260730 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5636a-db4b-4dac-b503-28099003a30c admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:36.261002 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5636a-db4b-4dac-b503-28099003a30c admin admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:36.262547 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb5636a-db4b-4dac-b503-28099003a30c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:17:36.262784 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb5636a-db4b-4dac-b503-28099003a30c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:36.264551 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb5636a-db4b-4dac-b503-28099003a30c admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:36.270377 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-1c3d4c9e-3cc9-411d-a836-36329aadff96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc57c8dade97415496fe1d3ea32f9fd8'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:36.272491 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-1c3d4c9e-3cc9-411d-a836-36329aadff96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc57c8dade97415496fe1d3ea32f9fd8'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:36.289637 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1076/2124] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:17:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:17:36.291433 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb5636a-db4b-4dac-b503-28099003a30c admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:36.294445 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-4fb5636a-db4b-4dac-b503-28099003a30c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:36.295379 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1049/2125] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:17:36 2022] DELETE /identity/v3/users/dc57c8dade97415496fe1d3ea32f9fd8 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:17:36.298304 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d4c9e-3cc9-411d-a836-36329aadff96 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:36.298304 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-1c3d4c9e-3cc9-411d-a836-36329aadff96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:36.323684 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb5636a-db4b-4dac-b503-28099003a30c admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:36.387058 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d4c9e-3cc9-411d-a836-36329aadff96 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:36.393838 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4723234-34cc-4b9e-8e84-d16133eb72c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:36.394938 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4723234-34cc-4b9e-8e84-d16133eb72c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:36.395226 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4723234-34cc-4b9e-8e84-d16133eb72c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:36.395648 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4723234-34cc-4b9e-8e84-d16133eb72c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:36.396762 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4723234-34cc-4b9e-8e84-d16133eb72c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:36.399042 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4723234-34cc-4b9e-8e84-d16133eb72c6 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:36.411868 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:36.434440 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:36.448221 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b9a10-4b80-4851-802d-32d49d617a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:36.448963 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b9a10-4b80-4851-802d-32d49d617a29 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:36.449241 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b9a10-4b80-4851-802d-32d49d617a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:36.451640 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b9a10-4b80-4851-802d-32d49d617a29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:36.452430 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151b9a10-4b80-4851-802d-32d49d617a29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:36.457025 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151b9a10-4b80-4851-802d-32d49d617a29 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:36.461171 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1050/2126] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:17:36 2022] POST /identity/v3/projects => generated 369 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:17:36.463686 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5664ad-f103-49e1-aeef-6eae179440c7 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:36.464025 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5664ad-f103-49e1-aeef-6eae179440c7 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:36.465294 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5664ad-f103-49e1-aeef-6eae179440c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:36.484718 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1077/2127] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:17:36.488772 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b9a10-4b80-4851-802d-32d49d617a29 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:36.504008 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-2c5664ad-f103-49e1-aeef-6eae179440c7 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:36.505325 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-2c5664ad-f103-49e1-aeef-6eae179440c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:36.510108 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b9a10-4b80-4851-802d-32d49d617a29 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:36.613761 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d6adb9-30f0-4bc4-a6e7-341dda55e125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:36.614391 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6adb9-30f0-4bc4-a6e7-341dda55e125 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:36.614666 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6adb9-30f0-4bc4-a6e7-341dda55e125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:36.614771 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1051/2128] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:17:36.615207 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6adb9-30f0-4bc4-a6e7-341dda55e125 admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:36.615687 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d6adb9-30f0-4bc4-a6e7-341dda55e125 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:36.615883 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5664ad-f103-49e1-aeef-6eae179440c7 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:36.617757 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d6adb9-30f0-4bc4-a6e7-341dda55e125 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:36.631971 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5664ad-f103-49e1-aeef-6eae179440c7 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:36.642684 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b78c2-0fd2-4648-a0dd-acd51ac0c699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:36.645169 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b78c2-0fd2-4648-a0dd-acd51ac0c699 admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:36.646570 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b78c2-0fd2-4648-a0dd-acd51ac0c699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:36.647887 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b78c2-0fd2-4648-a0dd-acd51ac0c699 admin admin] PATH_INFO: `/v3/projects/26547d75e1d24e2e98066da07d59a169/users/3bb57c19619d45cc8424511f4c5f1a7b/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:36.654987 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1078/2129] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:17:36 2022] POST /identity/v3/users => generated 285 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:17:36.659585 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d6adb9-30f0-4bc4-a6e7-341dda55e125 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:36.695702 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d6adb9-30f0-4bc4-a6e7-341dda55e125 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:36.705525 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b78c2-0fd2-4648-a0dd-acd51ac0c699 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26547d75e1d24e2e98066da07d59a169, user_id=3bb57c19619d45cc8424511f4c5f1a7b, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:36.715408 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b78c2-0fd2-4648-a0dd-acd51ac0c699 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:36.719881 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e626761-8148-4242-a0a0-6dcdfdee9906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:36.720679 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e626761-8148-4242-a0a0-6dcdfdee9906 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:36.722213 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e626761-8148-4242-a0a0-6dcdfdee9906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:36.722487 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e626761-8148-4242-a0a0-6dcdfdee9906 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:36.725958 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e626761-8148-4242-a0a0-6dcdfdee9906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:36.733698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e626761-8148-4242-a0a0-6dcdfdee9906 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:36.760716 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1052/2130] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:17:36 2022] PUT /identity/v3/projects/26547d75e1d24e2e98066da07d59a169/users/3bb57c19619d45cc8424511f4c5f1a7b/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:17:36.771026 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b78c2-0fd2-4648-a0dd-acd51ac0c699 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:36.773502 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1079/2131] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:17:36.774967 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-a91b78c2-0fd2-4648-a0dd-acd51ac0c699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:36.778099 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493976d2-8962-446e-999f-9d53a7910490 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:36.778712 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493976d2-8962-446e-999f-9d53a7910490 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:36.779204 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493976d2-8962-446e-999f-9d53a7910490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:36.857411 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-493976d2-8962-446e-999f-9d53a7910490 None None] MFA Rules not processed for user `3bb57c19619d45cc8424511f4c5f1a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:36.859103 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-493976d2-8962-446e-999f-9d53a7910490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:36.922061 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b78c2-0fd2-4648-a0dd-acd51ac0c699 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:36.930918 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127fb67-2358-4dc4-8379-5440a5037d4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:36.933316 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127fb67-2358-4dc4-8379-5440a5037d4f service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:36.934591 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127fb67-2358-4dc4-8379-5440a5037d4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:36.935058 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127fb67-2358-4dc4-8379-5440a5037d4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:36.996467 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1080/2132] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:17:36.996467 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493976d2-8962-446e-999f-9d53a7910490 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:37.054387 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f127fb67-2358-4dc4-8379-5440a5037d4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:37.055992 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f127fb67-2358-4dc4-8379-5440a5037d4f service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:37.075317 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1053/2133] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:17:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:17:37.077752 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127fb67-2358-4dc4-8379-5440a5037d4f service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:37.080936 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-f127fb67-2358-4dc4-8379-5440a5037d4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:37.081144 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:37.107022 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127fb67-2358-4dc4-8379-5440a5037d4f service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:37.110850 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493976d2-8962-446e-999f-9d53a7910490 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:37.116582 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e5627-f0f7-4dd3-b847-7bd71f2b80e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:37.117376 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e5627-f0f7-4dd3-b847-7bd71f2b80e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:37.118021 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e5627-f0f7-4dd3-b847-7bd71f2b80e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:37.118837 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e5627-f0f7-4dd3-b847-7bd71f2b80e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:37.121176 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d45e10-f840-4fbb-9e63-468a2e79b3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:37.123166 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d45e10-f840-4fbb-9e63-468a2e79b3e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:37.124027 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d45e10-f840-4fbb-9e63-468a2e79b3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:37.124791 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d45e10-f840-4fbb-9e63-468a2e79b3e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:37.128852 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d45e10-f840-4fbb-9e63-468a2e79b3e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:37.130696 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d45e10-f840-4fbb-9e63-468a2e79b3e3 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:37.139742 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e5627-f0f7-4dd3-b847-7bd71f2b80e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:37.141903 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e5627-f0f7-4dd3-b847-7bd71f2b80e5 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:37.151787 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1081/2134] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:17:37.156102 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d45e10-f840-4fbb-9e63-468a2e79b3e3 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:37.163733 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1054/2135] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:17:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:17:37.170614 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d45e10-f840-4fbb-9e63-468a2e79b3e3 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:37.174758 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6cf1d-6b2b-48b3-92fa-f3299baf0b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:37.175602 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6cf1d-6b2b-48b3-92fa-f3299baf0b60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:37.175978 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6cf1d-6b2b-48b3-92fa-f3299baf0b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:37.176358 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6cf1d-6b2b-48b3-92fa-f3299baf0b60 admin admin] PATH_INFO: `/v3/projects/bcc439f89c18437497a414aeaa1a059b/users/dcd13218fbca4d4d95ca344beb881586/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:37.192450 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d6cf1d-6b2b-48b3-92fa-f3299baf0b60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcc439f89c18437497a414aeaa1a059b, user_id=dcd13218fbca4d4d95ca344beb881586, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:37.195548 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d6cf1d-6b2b-48b3-92fa-f3299baf0b60 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:37.220308 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1082/2136] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:17:37 2022] PUT /identity/v3/projects/bcc439f89c18437497a414aeaa1a059b/users/dcd13218fbca4d4d95ca344beb881586/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:17:37.231222 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc8596-f382-4b43-8c2a-802a890b9f1c None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:37.231736 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc8596-f382-4b43-8c2a-802a890b9f1c None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:37.232103 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc8596-f382-4b43-8c2a-802a890b9f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:37.277893 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:37.282276 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-e6bc8596-f382-4b43-8c2a-802a890b9f1c None None] MFA Rules not processed for user `dcd13218fbca4d4d95ca344beb881586`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:37.283720 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-e6bc8596-f382-4b43-8c2a-802a890b9f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:37.414716 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1055/2137] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:37 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:17:37.438457 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6cf1d-6b2b-48b3-92fa-f3299baf0b60 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:37.532163 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6cf1d-6b2b-48b3-92fa-f3299baf0b60 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:37.538173 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ba781-6c70-4ff6-b0c0-b22abbc20b1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:37.539356 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ba781-6c70-4ff6-b0c0-b22abbc20b1a service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:37.539815 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ba781-6c70-4ff6-b0c0-b22abbc20b1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:37.540677 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ba781-6c70-4ff6-b0c0-b22abbc20b1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:37.570551 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827ba781-6c70-4ff6-b0c0-b22abbc20b1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:37.572927 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827ba781-6c70-4ff6-b0c0-b22abbc20b1a service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:37.589069 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1083/2138] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:17:37 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:17:39.028203 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc8596-f382-4b43-8c2a-802a890b9f1c None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:39.029676 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-e6bc8596-f382-4b43-8c2a-802a890b9f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:39.229299 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc8596-f382-4b43-8c2a-802a890b9f1c None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:39.245648 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76378efe-cbed-4e9e-8325-051abf1289af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:39.245963 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76378efe-cbed-4e9e-8325-051abf1289af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:39.246341 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76378efe-cbed-4e9e-8325-051abf1289af admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:39.246501 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76378efe-cbed-4e9e-8325-051abf1289af admin admin] PATH_INFO: `/v3/projects/2e5868b4f4b1410cb24d96c15c2f4bd9` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:39.255228 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76378efe-cbed-4e9e-8325-051abf1289af admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e5868b4f4b1410cb24d96c15c2f4bd9)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:39.258706 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76378efe-cbed-4e9e-8325-051abf1289af admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:39.351228 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-76378efe-cbed-4e9e-8325-051abf1289af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e5868b4f4b1410cb24d96c15c2f4bd9', 'request_id': 'req-76378efe-cbed-4e9e-8325-051abf1289af'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:39.361037 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-76378efe-cbed-4e9e-8325-051abf1289af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e5868b4f4b1410cb24d96c15c2f4bd9', 'request_id': 'req-76378efe-cbed-4e9e-8325-051abf1289af'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:39.369412 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-76378efe-cbed-4e9e-8325-051abf1289af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e5868b4f4b1410cb24d96c15c2f4bd9', 'request_id': 'req-76378efe-cbed-4e9e-8325-051abf1289af'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:39.397438 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-76378efe-cbed-4e9e-8325-051abf1289af admin admin] The token cache is being invalidate because project 2e5868b4f4b1410cb24d96c15c2f4bd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:17:39.397900 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-76378efe-cbed-4e9e-8325-051abf1289af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:39.398738 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-76378efe-cbed-4e9e-8325-051abf1289af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:39.409629 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011b3a9-22c5-4c6d-abdf-1ebe1336d555 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:39.410177 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011b3a9-22c5-4c6d-abdf-1ebe1336d555 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:39.410268 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1056/2139] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:39 2022] DELETE /identity/v3/projects/2e5868b4f4b1410cb24d96c15c2f4bd9 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:17:39.410494 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011b3a9-22c5-4c6d-abdf-1ebe1336d555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:39.448044 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-9011b3a9-22c5-4c6d-abdf-1ebe1336d555 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:39.449471 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-9011b3a9-22c5-4c6d-abdf-1ebe1336d555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:39.582107 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1084/2140] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:17:39.596799 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80263db1-840e-430d-a522-7f47431d0ad3 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:39.597259 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80263db1-840e-430d-a522-7f47431d0ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:39.598002 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80263db1-840e-430d-a522-7f47431d0ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:39.650208 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-80263db1-840e-430d-a522-7f47431d0ad3 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:39.651557 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-80263db1-840e-430d-a522-7f47431d0ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:39.668834 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1057/2141] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:17:39.672818 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011b3a9-22c5-4c6d-abdf-1ebe1336d555 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:39.686803 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011b3a9-22c5-4c6d-abdf-1ebe1336d555 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:39.699840 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbb21e-d796-494e-ae54-92267608f496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:39.700387 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbb21e-d796-494e-ae54-92267608f496 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:39.700674 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbb21e-d796-494e-ae54-92267608f496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:39.700949 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbb21e-d796-494e-ae54-92267608f496 admin admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:39.701661 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bbb21e-d796-494e-ae54-92267608f496 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:17:39.701960 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bbb21e-d796-494e-ae54-92267608f496 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:39.706191 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bbb21e-d796-494e-ae54-92267608f496 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:39.730197 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1085/2142] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:17:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:17:39.731332 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80263db1-840e-430d-a522-7f47431d0ad3 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:39.750284 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80263db1-840e-430d-a522-7f47431d0ad3 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:39.763288 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc6a5c6-39e8-4a84-8b83-f1cabb72e047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:39.764089 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6a5c6-39e8-4a84-8b83-f1cabb72e047 admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:39.764385 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6a5c6-39e8-4a84-8b83-f1cabb72e047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:39.764655 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6a5c6-39e8-4a84-8b83-f1cabb72e047 admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:39.765317 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc6a5c6-39e8-4a84-8b83-f1cabb72e047 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:39.767299 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc6a5c6-39e8-4a84-8b83-f1cabb72e047 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:39.826074 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1058/2143] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:17:39 2022] POST /identity/v3/projects => generated 367 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:17:39.830237 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbb21e-d796-494e-ae54-92267608f496 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:39.846152 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbb21e-d796-494e-ae54-92267608f496 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:39.920993 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:39.945984 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9482d-0931-48b9-b9e7-59fab0a0e1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:39.949040 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9482d-0931-48b9-b9e7-59fab0a0e1ef admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:39.949585 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9482d-0931-48b9-b9e7-59fab0a0e1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:39.950068 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9482d-0931-48b9-b9e7-59fab0a0e1ef admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:39.951918 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b9482d-0931-48b9-b9e7-59fab0a0e1ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:39.956332 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b9482d-0931-48b9-b9e7-59fab0a0e1ef admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:40.025854 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1086/2144] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:17:39 2022] POST /identity/v3/users => generated 284 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:17:40.028672 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc6a5c6-39e8-4a84-8b83-f1cabb72e047 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:40.037686 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:40.043668 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc6a5c6-39e8-4a84-8b83-f1cabb72e047 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:40.062441 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e3ae48-f64d-4926-bf27-3fc66bcedce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:40.064206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3ae48-f64d-4926-bf27-3fc66bcedce4 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:40.065900 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3ae48-f64d-4926-bf27-3fc66bcedce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:40.066427 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3ae48-f64d-4926-bf27-3fc66bcedce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:40.067771 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e3ae48-f64d-4926-bf27-3fc66bcedce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:40.072236 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e3ae48-f64d-4926-bf27-3fc66bcedce4 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:40.104238 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1059/2145] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:17:40.107018 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9482d-0931-48b9-b9e7-59fab0a0e1ef admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:40.122011 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9482d-0931-48b9-b9e7-59fab0a0e1ef admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:40.138359 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec153ad-95b1-4b20-a594-591ac677f0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:40.153013 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec153ad-95b1-4b20-a594-591ac677f0e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:40.154193 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec153ad-95b1-4b20-a594-591ac677f0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:40.159216 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec153ad-95b1-4b20-a594-591ac677f0e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:40.163516 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec153ad-95b1-4b20-a594-591ac677f0e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:40.171325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec153ad-95b1-4b20-a594-591ac677f0e1 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:40.206425 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1087/2146] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:17:40.210484 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e3ae48-f64d-4926-bf27-3fc66bcedce4 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:40.231632 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e3ae48-f64d-4926-bf27-3fc66bcedce4 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:40.245764 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdc15f-fb6f-4255-bf17-cbbd9c52bd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:40.246947 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdc15f-fb6f-4255-bf17-cbbd9c52bd33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:40.248098 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdc15f-fb6f-4255-bf17-cbbd9c52bd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:40.249164 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdc15f-fb6f-4255-bf17-cbbd9c52bd33 admin admin] PATH_INFO: `/v3/projects/0c5f2e9e59e34c15bfc099812fd8fc90/users/c9ee21d2fb3f426687ae741ee87ce527/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:40.302520 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fdc15f-fb6f-4255-bf17-cbbd9c52bd33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c5f2e9e59e34c15bfc099812fd8fc90, user_id=c9ee21d2fb3f426687ae741ee87ce527, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:40.308894 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fdc15f-fb6f-4255-bf17-cbbd9c52bd33 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:40.332922 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1060/2147] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:17:40 2022] PUT /identity/v3/projects/0c5f2e9e59e34c15bfc099812fd8fc90/users/c9ee21d2fb3f426687ae741ee87ce527/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:17:40.343896 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c441ee-7610-4eb7-ab6f-88db415c917f None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:40.344559 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c441ee-7610-4eb7-ab6f-88db415c917f None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:40.344851 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c441ee-7610-4eb7-ab6f-88db415c917f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:40.381652 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-f5c441ee-7610-4eb7-ab6f-88db415c917f None None] MFA Rules not processed for user `c9ee21d2fb3f426687ae741ee87ce527`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:40.383308 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-f5c441ee-7610-4eb7-ab6f-88db415c917f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:40.509163 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1088/2148] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:40 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:17:40.535216 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdc15f-fb6f-4255-bf17-cbbd9c52bd33 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:40.537350 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-91fdc15f-fb6f-4255-bf17-cbbd9c52bd33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:40.669709 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdc15f-fb6f-4255-bf17-cbbd9c52bd33 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:40.681309 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1932adf-224a-4a7e-9403-2c96625bde47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:40.682887 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1932adf-224a-4a7e-9403-2c96625bde47 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:40.683177 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1932adf-224a-4a7e-9403-2c96625bde47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:40.685870 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1932adf-224a-4a7e-9403-2c96625bde47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:40.708401 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1932adf-224a-4a7e-9403-2c96625bde47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:40.709878 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1932adf-224a-4a7e-9403-2c96625bde47 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:40.737686 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1061/2149] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:17:40 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:17:48.582272 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c441ee-7610-4eb7-ab6f-88db415c917f None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:48.586717 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-f5c441ee-7610-4eb7-ab6f-88db415c917f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:48.712036 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c441ee-7610-4eb7-ab6f-88db415c917f None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:48.725499 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c00c13-29b0-429d-9734-d35d715aefbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:48.726970 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c00c13-29b0-429d-9734-d35d715aefbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:48.727255 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c00c13-29b0-429d-9734-d35d715aefbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:48.727564 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c00c13-29b0-429d-9734-d35d715aefbf admin admin] PATH_INFO: `/v3/users/4e735433b3b04919baa808690ece0e1f` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:48.732823 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c00c13-29b0-429d-9734-d35d715aefbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e735433b3b04919baa808690ece0e1f)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:48.741029 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c00c13-29b0-429d-9734-d35d715aefbf admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:48.886647 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-24c00c13-29b0-429d-9734-d35d715aefbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e735433b3b04919baa808690ece0e1f'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:48.899362 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-24c00c13-29b0-429d-9734-d35d715aefbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e735433b3b04919baa808690ece0e1f'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:48.902778 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-24c00c13-29b0-429d-9734-d35d715aefbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e735433b3b04919baa808690ece0e1f'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:48.907088 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:48.929666 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-24c00c13-29b0-429d-9734-d35d715aefbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e735433b3b04919baa808690ece0e1f'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:48.930827 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-24c00c13-29b0-429d-9734-d35d715aefbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e735433b3b04919baa808690ece0e1f'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:49.028983 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1089/2150] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:17:48 2022] DELETE /identity/v3/users/4e735433b3b04919baa808690ece0e1f => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:17:49.033489 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9b06d-b45d-4a84-9f98-c18c17f3bcef None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:49.034010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9b06d-b45d-4a84-9f98-c18c17f3bcef None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:49.034010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9b06d-b45d-4a84-9f98-c18c17f3bcef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:49.071918 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-e2d9b06d-b45d-4a84-9f98-c18c17f3bcef None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:49.073516 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-e2d9b06d-b45d-4a84-9f98-c18c17f3bcef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:49.179925 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1062/2151] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:17:49.227008 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c00c13-29b0-429d-9734-d35d715aefbf admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:49.228502 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-24c00c13-29b0-429d-9734-d35d715aefbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:49.403959 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c00c13-29b0-429d-9734-d35d715aefbf admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:49.409525 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52244e-b185-4691-8985-fdecedf87f81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:49.411806 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52244e-b185-4691-8985-fdecedf87f81 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:49.412331 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52244e-b185-4691-8985-fdecedf87f81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:49.412331 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52244e-b185-4691-8985-fdecedf87f81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:49.425971 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a52244e-b185-4691-8985-fdecedf87f81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:49.427903 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a52244e-b185-4691-8985-fdecedf87f81 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:49.466437 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1090/2152] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:17:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:17:50.364779 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9b06d-b45d-4a84-9f98-c18c17f3bcef None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:50.372951 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-e2d9b06d-b45d-4a84-9f98-c18c17f3bcef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:50.392975 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9b06d-b45d-4a84-9f98-c18c17f3bcef None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:50.402044 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8037c0-417b-4d8b-803e-b746b1a8253d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:50.403042 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8037c0-417b-4d8b-803e-b746b1a8253d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:50.403524 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8037c0-417b-4d8b-803e-b746b1a8253d admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:50.404073 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8037c0-417b-4d8b-803e-b746b1a8253d admin admin] PATH_INFO: `/v3/projects/2986245edc324624aa51f5b48037b266` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:50.406436 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8037c0-417b-4d8b-803e-b746b1a8253d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2986245edc324624aa51f5b48037b266)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:50.411195 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8037c0-417b-4d8b-803e-b746b1a8253d admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:50.607195 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-0b8037c0-417b-4d8b-803e-b746b1a8253d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2986245edc324624aa51f5b48037b266', 'request_id': 'req-0b8037c0-417b-4d8b-803e-b746b1a8253d'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:50.622662 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-0b8037c0-417b-4d8b-803e-b746b1a8253d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2986245edc324624aa51f5b48037b266', 'request_id': 'req-0b8037c0-417b-4d8b-803e-b746b1a8253d'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:50.634060 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-0b8037c0-417b-4d8b-803e-b746b1a8253d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2986245edc324624aa51f5b48037b266', 'request_id': 'req-0b8037c0-417b-4d8b-803e-b746b1a8253d'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:50.640464 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:50.672032 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-0b8037c0-417b-4d8b-803e-b746b1a8253d admin admin] The token cache is being invalidate because project 2986245edc324624aa51f5b48037b266 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:17:50.672875 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-0b8037c0-417b-4d8b-803e-b746b1a8253d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:50.674150 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-0b8037c0-417b-4d8b-803e-b746b1a8253d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:50.676817 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1063/2153] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:50 2022] DELETE /identity/v3/projects/2986245edc324624aa51f5b48037b266 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:17:50.682688 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b01955-1a6b-4397-979a-961ccf1d20e3 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:50.683937 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b01955-1a6b-4397-979a-961ccf1d20e3 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:50.684475 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b01955-1a6b-4397-979a-961ccf1d20e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:50.712661 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-26b01955-1a6b-4397-979a-961ccf1d20e3 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:50.714353 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-26b01955-1a6b-4397-979a-961ccf1d20e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:50.812334 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1091/2154] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:17:50.821161 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe0fb1-353c-4295-a68b-f38045c7bfd2 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:50.821712 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe0fb1-353c-4295-a68b-f38045c7bfd2 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:50.822002 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe0fb1-353c-4295-a68b-f38045c7bfd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:50.864817 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-19fe0fb1-353c-4295-a68b-f38045c7bfd2 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:50.866437 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-19fe0fb1-353c-4295-a68b-f38045c7bfd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:50.880714 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1064/2155] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:17:50.885031 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b01955-1a6b-4397-979a-961ccf1d20e3 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:50.897558 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b01955-1a6b-4397-979a-961ccf1d20e3 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:50.903109 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b4c2a-2fcb-4e80-bc3c-0a7495bb6721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:50.905103 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b4c2a-2fcb-4e80-bc3c-0a7495bb6721 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:50.905600 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b4c2a-2fcb-4e80-bc3c-0a7495bb6721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:50.906049 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b4c2a-2fcb-4e80-bc3c-0a7495bb6721 admin admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:50.906972 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b4c2a-2fcb-4e80-bc3c-0a7495bb6721 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:17:50.907499 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b4c2a-2fcb-4e80-bc3c-0a7495bb6721 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:50.909413 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b4c2a-2fcb-4e80-bc3c-0a7495bb6721 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:50.926278 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1092/2156] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:17:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:17:50.930683 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe0fb1-353c-4295-a68b-f38045c7bfd2 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:50.956502 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe0fb1-353c-4295-a68b-f38045c7bfd2 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:50.973087 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3a01c-3790-4609-9bd1-c27c7f26f570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:50.974001 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3a01c-3790-4609-9bd1-c27c7f26f570 admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:50.974455 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3a01c-3790-4609-9bd1-c27c7f26f570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:50.975170 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3a01c-3790-4609-9bd1-c27c7f26f570 admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:50.976055 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa3a01c-3790-4609-9bd1-c27c7f26f570 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:50.978273 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa3a01c-3790-4609-9bd1-c27c7f26f570 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:51.033076 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b4c2a-2fcb-4e80-bc3c-0a7495bb6721 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:51.041535 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1065/2157] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:17:50 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:17:51.047107 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b4c2a-2fcb-4e80-bc3c-0a7495bb6721 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:51.126256 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437236d-c9b7-4b80-979c-78b4a7d57377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:51.127155 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437236d-c9b7-4b80-979c-78b4a7d57377 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:51.128141 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437236d-c9b7-4b80-979c-78b4a7d57377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:51.128578 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437236d-c9b7-4b80-979c-78b4a7d57377 admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:51.129441 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7437236d-c9b7-4b80-979c-78b4a7d57377 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:51.131679 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7437236d-c9b7-4b80-979c-78b4a7d57377 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:51.145205 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:51.191022 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3a01c-3790-4609-9bd1-c27c7f26f570 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:51.202397 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1093/2158] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:17:51 2022] POST /identity/v3/users => generated 288 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:17:51.207361 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3a01c-3790-4609-9bd1-c27c7f26f570 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:51.213968 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c579da3-3341-468d-b115-f05f31663735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:51.214862 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c579da3-3341-468d-b115-f05f31663735 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:51.215306 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c579da3-3341-468d-b115-f05f31663735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:51.215760 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c579da3-3341-468d-b115-f05f31663735 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:51.216623 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c579da3-3341-468d-b115-f05f31663735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:51.221045 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c579da3-3341-468d-b115-f05f31663735 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:51.240429 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437236d-c9b7-4b80-979c-78b4a7d57377 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:51.256658 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1066/2159] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:17:51.266680 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437236d-c9b7-4b80-979c-78b4a7d57377 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:51.284454 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbda2ebe-617e-40ff-86a2-2af39138229f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:51.285258 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda2ebe-617e-40ff-86a2-2af39138229f admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:51.285545 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda2ebe-617e-40ff-86a2-2af39138229f admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:51.286037 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda2ebe-617e-40ff-86a2-2af39138229f admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:51.286573 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbda2ebe-617e-40ff-86a2-2af39138229f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:51.290428 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbda2ebe-617e-40ff-86a2-2af39138229f admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:51.341584 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c579da3-3341-468d-b115-f05f31663735 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:51.347737 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1094/2160] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:17:51.361841 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c579da3-3341-468d-b115-f05f31663735 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:51.370451 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddfc912-ab22-4471-9fb0-6bb4f67eddf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:51.371636 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddfc912-ab22-4471-9fb0-6bb4f67eddf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:51.371976 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddfc912-ab22-4471-9fb0-6bb4f67eddf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:51.372253 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddfc912-ab22-4471-9fb0-6bb4f67eddf8 admin admin] PATH_INFO: `/v3/projects/a2d9eb3dc4404de880c3e220e01ba2bf/users/980014ef772240669f30f17466d14630/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:51.432424 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddfc912-ab22-4471-9fb0-6bb4f67eddf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2d9eb3dc4404de880c3e220e01ba2bf, user_id=980014ef772240669f30f17466d14630, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:51.441377 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddfc912-ab22-4471-9fb0-6bb4f67eddf8 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:51.472307 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1067/2161] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:17:51 2022] PUT /identity/v3/projects/a2d9eb3dc4404de880c3e220e01ba2bf/users/980014ef772240669f30f17466d14630/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:17:51.483408 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93c23b-6c1b-4da9-989f-c84b60eb3f10 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:51.483743 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93c23b-6c1b-4da9-989f-c84b60eb3f10 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:51.484043 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93c23b-6c1b-4da9-989f-c84b60eb3f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:51.557672 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-1d93c23b-6c1b-4da9-989f-c84b60eb3f10 None None] MFA Rules not processed for user `980014ef772240669f30f17466d14630`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:51.558936 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-1d93c23b-6c1b-4da9-989f-c84b60eb3f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:51.701976 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1095/2162] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:17:51.804125 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddfc912-ab22-4471-9fb0-6bb4f67eddf8 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:51.808965 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-3ddfc912-ab22-4471-9fb0-6bb4f67eddf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:51.968433 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddfc912-ab22-4471-9fb0-6bb4f67eddf8 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:51.973887 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd1c11-89c3-40c4-a8dc-a4c8681a6190 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:51.974891 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd1c11-89c3-40c4-a8dc-a4c8681a6190 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:51.975546 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd1c11-89c3-40c4-a8dc-a4c8681a6190 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:51.976057 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd1c11-89c3-40c4-a8dc-a4c8681a6190 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:51.991700 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafd1c11-89c3-40c4-a8dc-a4c8681a6190 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:51.994399 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafd1c11-89c3-40c4-a8dc-a4c8681a6190 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:52.012741 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1068/2163] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:17:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:17:52.407034 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93c23b-6c1b-4da9-989f-c84b60eb3f10 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:52.554424 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93c23b-6c1b-4da9-989f-c84b60eb3f10 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:52.560892 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a0eb1-bb20-48dc-be8f-5e3c27768ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:52.561632 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a0eb1-bb20-48dc-be8f-5e3c27768ed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:52.561899 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a0eb1-bb20-48dc-be8f-5e3c27768ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:52.562169 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a0eb1-bb20-48dc-be8f-5e3c27768ed5 admin admin] PATH_INFO: `/v3/users/980014ef772240669f30f17466d14630` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:52.564170 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9a0eb1-bb20-48dc-be8f-5e3c27768ed5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=980014ef772240669f30f17466d14630)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:52.567383 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9a0eb1-bb20-48dc-be8f-5e3c27768ed5 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:52.667217 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-2a9a0eb1-bb20-48dc-be8f-5e3c27768ed5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '980014ef772240669f30f17466d14630'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:52.684296 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-2a9a0eb1-bb20-48dc-be8f-5e3c27768ed5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '980014ef772240669f30f17466d14630'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:52.688987 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-2a9a0eb1-bb20-48dc-be8f-5e3c27768ed5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '980014ef772240669f30f17466d14630'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:52.713759 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-2a9a0eb1-bb20-48dc-be8f-5e3c27768ed5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '980014ef772240669f30f17466d14630'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:52.715219 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-2a9a0eb1-bb20-48dc-be8f-5e3c27768ed5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '980014ef772240669f30f17466d14630'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:52.718160 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:INSERT=1,keystone:SELECT=90,keystone:DELETE=9 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:52.752164 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fff2da-d141-48c7-a02b-b5664a3bafd6 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:52.752627 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fff2da-d141-48c7-a02b-b5664a3bafd6 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:52.752747 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fff2da-d141-48c7-a02b-b5664a3bafd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:52.756632 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1096/2164] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:17:52 2022] DELETE /identity/v3/users/980014ef772240669f30f17466d14630 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:17:52.785912 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-34fff2da-d141-48c7-a02b-b5664a3bafd6 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:52.787272 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-34fff2da-d141-48c7-a02b-b5664a3bafd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:52.902827 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1069/2165] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:17:52.924949 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a0eb1-bb20-48dc-be8f-5e3c27768ed5 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:52.928179 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-2a9a0eb1-bb20-48dc-be8f-5e3c27768ed5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:53.076860 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a0eb1-bb20-48dc-be8f-5e3c27768ed5 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:53.082867 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adbda12-b21d-47df-af99-86fd3f0db5bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:53.083705 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbda12-b21d-47df-af99-86fd3f0db5bc service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:53.083981 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbda12-b21d-47df-af99-86fd3f0db5bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:53.084331 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbda12-b21d-47df-af99-86fd3f0db5bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:53.105918 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adbda12-b21d-47df-af99-86fd3f0db5bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:53.109761 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adbda12-b21d-47df-af99-86fd3f0db5bc service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:53.128493 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1097/2166] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:17:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:17:54.152701 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fff2da-d141-48c7-a02b-b5664a3bafd6 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:54.155222 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-34fff2da-d141-48c7-a02b-b5664a3bafd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:54.188565 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fff2da-d141-48c7-a02b-b5664a3bafd6 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:54.204334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e30ce-bf9c-4e66-bbae-25834685fb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:54.205483 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e30ce-bf9c-4e66-bbae-25834685fb7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:54.206052 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e30ce-bf9c-4e66-bbae-25834685fb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:54.206530 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e30ce-bf9c-4e66-bbae-25834685fb7b admin admin] PATH_INFO: `/v3/projects/a2d9eb3dc4404de880c3e220e01ba2bf` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:54.208196 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e30ce-bf9c-4e66-bbae-25834685fb7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2d9eb3dc4404de880c3e220e01ba2bf)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:54.212164 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e30ce-bf9c-4e66-bbae-25834685fb7b admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:54.286494 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:54.308275 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-b17e30ce-bf9c-4e66-bbae-25834685fb7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2d9eb3dc4404de880c3e220e01ba2bf', 'request_id': 'req-b17e30ce-bf9c-4e66-bbae-25834685fb7b'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:54.316613 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-b17e30ce-bf9c-4e66-bbae-25834685fb7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2d9eb3dc4404de880c3e220e01ba2bf', 'request_id': 'req-b17e30ce-bf9c-4e66-bbae-25834685fb7b'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:54.325745 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-b17e30ce-bf9c-4e66-bbae-25834685fb7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2d9eb3dc4404de880c3e220e01ba2bf', 'request_id': 'req-b17e30ce-bf9c-4e66-bbae-25834685fb7b'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:54.356228 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-b17e30ce-bf9c-4e66-bbae-25834685fb7b admin admin] The token cache is being invalidate because project a2d9eb3dc4404de880c3e220e01ba2bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:17:54.358706 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-b17e30ce-bf9c-4e66-bbae-25834685fb7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:54.359692 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-b17e30ce-bf9c-4e66-bbae-25834685fb7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:54.364962 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1070/2167] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:54 2022] DELETE /identity/v3/projects/a2d9eb3dc4404de880c3e220e01ba2bf => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:17:54.372994 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb73e9-8e5a-47cf-8fc4-b9ae0b33a88e None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:54.373390 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb73e9-8e5a-47cf-8fc4-b9ae0b33a88e None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:54.373544 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb73e9-8e5a-47cf-8fc4-b9ae0b33a88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:54.433764 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-bfeb73e9-8e5a-47cf-8fc4-b9ae0b33a88e None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:54.435165 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-bfeb73e9-8e5a-47cf-8fc4-b9ae0b33a88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:54.568377 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1098/2168] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:17:54.576193 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c5572-f5ba-4d5a-a5c9-57e301b5e114 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:54.576562 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c5572-f5ba-4d5a-a5c9-57e301b5e114 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:54.576903 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c5572-f5ba-4d5a-a5c9-57e301b5e114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:54.609307 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-047c5572-f5ba-4d5a-a5c9-57e301b5e114 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:54.611239 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-047c5572-f5ba-4d5a-a5c9-57e301b5e114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:54.626747 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1071/2169] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:17:54.631796 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb73e9-8e5a-47cf-8fc4-b9ae0b33a88e None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:54.650128 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb73e9-8e5a-47cf-8fc4-b9ae0b33a88e None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:54.663026 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a78bd4-2dd1-47ea-803a-c7bfae594be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:54.663914 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a78bd4-2dd1-47ea-803a-c7bfae594be2 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:54.664197 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a78bd4-2dd1-47ea-803a-c7bfae594be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:54.664470 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a78bd4-2dd1-47ea-803a-c7bfae594be2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:54.665193 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a78bd4-2dd1-47ea-803a-c7bfae594be2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:17:54.665552 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a78bd4-2dd1-47ea-803a-c7bfae594be2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:54.668317 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a78bd4-2dd1-47ea-803a-c7bfae594be2 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:54.686713 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1099/2170] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:17:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:17:54.690874 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c5572-f5ba-4d5a-a5c9-57e301b5e114 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:54.708747 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c5572-f5ba-4d5a-a5c9-57e301b5e114 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:54.721057 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba5f89-c1ab-4f46-8905-e2999e763fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:54.723113 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba5f89-c1ab-4f46-8905-e2999e763fc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:54.723620 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba5f89-c1ab-4f46-8905-e2999e763fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:54.724130 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba5f89-c1ab-4f46-8905-e2999e763fc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:54.727795 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fba5f89-c1ab-4f46-8905-e2999e763fc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:54.739954 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fba5f89-c1ab-4f46-8905-e2999e763fc0 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:54.830988 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1072/2171] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:17:54 2022] POST /identity/v3/projects => generated 377 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:17:54.832788 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a78bd4-2dd1-47ea-803a-c7bfae594be2 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:54.849874 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a78bd4-2dd1-47ea-803a-c7bfae594be2 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:54.952334 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c2778-b7af-4032-b126-3e8ff37f5337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:54.953145 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c2778-b7af-4032-b126-3e8ff37f5337 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:54.953521 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c2778-b7af-4032-b126-3e8ff37f5337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:54.958889 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c2778-b7af-4032-b126-3e8ff37f5337 admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:54.958889 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c2778-b7af-4032-b126-3e8ff37f5337 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:54.960926 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c2778-b7af-4032-b126-3e8ff37f5337 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:55.013374 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba5f89-c1ab-4f46-8905-e2999e763fc0 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:55.017335 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1100/2172] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:17:54 2022] POST /identity/v3/users => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:17:55.027288 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba5f89-c1ab-4f46-8905-e2999e763fc0 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:55.036174 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc13f5d-f97c-4a93-9e10-bbb9c1a682f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:55.036906 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc13f5d-f97c-4a93-9e10-bbb9c1a682f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:55.037246 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc13f5d-f97c-4a93-9e10-bbb9c1a682f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:55.037678 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc13f5d-f97c-4a93-9e10-bbb9c1a682f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:55.038416 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc13f5d-f97c-4a93-9e10-bbb9c1a682f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:55.041922 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc13f5d-f97c-4a93-9e10-bbb9c1a682f2 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:55.066439 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1073/2173] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:17:55.067808 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c2778-b7af-4032-b126-3e8ff37f5337 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:55.081777 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c2778-b7af-4032-b126-3e8ff37f5337 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:55.090471 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db01d0-4806-47c9-8e62-f87281eaef97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:55.091153 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db01d0-4806-47c9-8e62-f87281eaef97 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:55.091388 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db01d0-4806-47c9-8e62-f87281eaef97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:55.091732 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db01d0-4806-47c9-8e62-f87281eaef97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:55.092435 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50db01d0-4806-47c9-8e62-f87281eaef97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:55.094049 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50db01d0-4806-47c9-8e62-f87281eaef97 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:55.102124 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:55.123715 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1101/2174] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:17:55.125364 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc13f5d-f97c-4a93-9e10-bbb9c1a682f2 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:55.147186 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc13f5d-f97c-4a93-9e10-bbb9c1a682f2 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:55.156815 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0943189-b356-401c-9a55-f1416e14db4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:55.158093 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0943189-b356-401c-9a55-f1416e14db4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:55.158270 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0943189-b356-401c-9a55-f1416e14db4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:55.158577 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0943189-b356-401c-9a55-f1416e14db4a admin admin] PATH_INFO: `/v3/projects/3a1bac7550c546faa42a797da3ce3a51/users/944f6517de8746898baf45a1db0b9ca0/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:55.183000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0943189-b356-401c-9a55-f1416e14db4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a1bac7550c546faa42a797da3ce3a51, user_id=944f6517de8746898baf45a1db0b9ca0, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:55.187014 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0943189-b356-401c-9a55-f1416e14db4a admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:55.217904 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1074/2175] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:17:55 2022] PUT /identity/v3/projects/3a1bac7550c546faa42a797da3ce3a51/users/944f6517de8746898baf45a1db0b9ca0/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:17:55.231475 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004025c-b121-4e60-8998-97c2a12c38ee None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:55.232205 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004025c-b121-4e60-8998-97c2a12c38ee None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:55.232488 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004025c-b121-4e60-8998-97c2a12c38ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:55.269669 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-2004025c-b121-4e60-8998-97c2a12c38ee None None] MFA Rules not processed for user `944f6517de8746898baf45a1db0b9ca0`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:55.270819 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-2004025c-b121-4e60-8998-97c2a12c38ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:55.396183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1102/2176] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:17:55.479981 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0943189-b356-401c-9a55-f1416e14db4a admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:55.483898 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-f0943189-b356-401c-9a55-f1416e14db4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:55.584800 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0943189-b356-401c-9a55-f1416e14db4a admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:55.590790 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300adfa-de15-4e57-8a0d-091acf7eef3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:55.591608 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300adfa-de15-4e57-8a0d-091acf7eef3c service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:55.592392 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300adfa-de15-4e57-8a0d-091acf7eef3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:55.593694 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300adfa-de15-4e57-8a0d-091acf7eef3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:55.609251 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f300adfa-de15-4e57-8a0d-091acf7eef3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:55.610895 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f300adfa-de15-4e57-8a0d-091acf7eef3c service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:55.628257 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1075/2177] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:17:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:17:55.658562 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004025c-b121-4e60-8998-97c2a12c38ee None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:55.799151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004025c-b121-4e60-8998-97c2a12c38ee None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:55.806625 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d873037-3a2f-4a30-a452-e58774a90e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:55.807436 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d873037-3a2f-4a30-a452-e58774a90e74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:55.807901 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d873037-3a2f-4a30-a452-e58774a90e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:55.808075 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d873037-3a2f-4a30-a452-e58774a90e74 admin admin] PATH_INFO: `/v3/users/944f6517de8746898baf45a1db0b9ca0` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:55.809637 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d873037-3a2f-4a30-a452-e58774a90e74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=944f6517de8746898baf45a1db0b9ca0)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:55.811798 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d873037-3a2f-4a30-a452-e58774a90e74 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:55.902217 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-9d873037-3a2f-4a30-a452-e58774a90e74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '944f6517de8746898baf45a1db0b9ca0'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:55.914925 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-9d873037-3a2f-4a30-a452-e58774a90e74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '944f6517de8746898baf45a1db0b9ca0'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:55.917416 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-9d873037-3a2f-4a30-a452-e58774a90e74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '944f6517de8746898baf45a1db0b9ca0'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:55.949980 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-9d873037-3a2f-4a30-a452-e58774a90e74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '944f6517de8746898baf45a1db0b9ca0'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:55.951081 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-9d873037-3a2f-4a30-a452-e58774a90e74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '944f6517de8746898baf45a1db0b9ca0'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:55.988853 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1103/2178] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:17:55 2022] DELETE /identity/v3/users/944f6517de8746898baf45a1db0b9ca0 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:17:55.989617 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada568a-d8a8-4dcf-93e2-852d610490a2 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:55.990065 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada568a-d8a8-4dcf-93e2-852d610490a2 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:55.990312 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada568a-d8a8-4dcf-93e2-852d610490a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:56.054149 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-2ada568a-d8a8-4dcf-93e2-852d610490a2 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:56.055138 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-2ada568a-d8a8-4dcf-93e2-852d610490a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:56.180820 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:56.193888 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1076/2179] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:17:56.207789 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d873037-3a2f-4a30-a452-e58774a90e74 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:56.209538 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-9d873037-3a2f-4a30-a452-e58774a90e74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:56.229690 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:56.399145 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d873037-3a2f-4a30-a452-e58774a90e74 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:56.404995 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb3587-75a3-4f3b-8f45-531c5575ed90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:56.406051 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb3587-75a3-4f3b-8f45-531c5575ed90 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:56.406692 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb3587-75a3-4f3b-8f45-531c5575ed90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:56.407114 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb3587-75a3-4f3b-8f45-531c5575ed90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:56.427850 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb3587-75a3-4f3b-8f45-531c5575ed90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:56.429379 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb3587-75a3-4f3b-8f45-531c5575ed90 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:56.449197 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1104/2180] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:17:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:17:57.185069 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada568a-d8a8-4dcf-93e2-852d610490a2 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:57.186867 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-2ada568a-d8a8-4dcf-93e2-852d610490a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:57.209125 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada568a-d8a8-4dcf-93e2-852d610490a2 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:57.219986 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8883f0-bbfb-43a3-aaf8-971078b9b86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:57.220683 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8883f0-bbfb-43a3-aaf8-971078b9b86b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:57.220946 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8883f0-bbfb-43a3-aaf8-971078b9b86b admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:57.221262 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8883f0-bbfb-43a3-aaf8-971078b9b86b admin admin] PATH_INFO: `/v3/projects/3a1bac7550c546faa42a797da3ce3a51` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:57.227888 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8883f0-bbfb-43a3-aaf8-971078b9b86b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a1bac7550c546faa42a797da3ce3a51)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:57.229938 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8883f0-bbfb-43a3-aaf8-971078b9b86b admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:57.330822 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-2e8883f0-bbfb-43a3-aaf8-971078b9b86b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a1bac7550c546faa42a797da3ce3a51', 'request_id': 'req-2e8883f0-bbfb-43a3-aaf8-971078b9b86b'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:57.346876 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-2e8883f0-bbfb-43a3-aaf8-971078b9b86b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a1bac7550c546faa42a797da3ce3a51', 'request_id': 'req-2e8883f0-bbfb-43a3-aaf8-971078b9b86b'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:57.360045 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-2e8883f0-bbfb-43a3-aaf8-971078b9b86b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a1bac7550c546faa42a797da3ce3a51', 'request_id': 'req-2e8883f0-bbfb-43a3-aaf8-971078b9b86b'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:57.390178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-2e8883f0-bbfb-43a3-aaf8-971078b9b86b admin admin] The token cache is being invalidate because project 3a1bac7550c546faa42a797da3ce3a51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:17:57.390879 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-2e8883f0-bbfb-43a3-aaf8-971078b9b86b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:57.391836 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-2e8883f0-bbfb-43a3-aaf8-971078b9b86b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:17:57.395342 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1077/2181] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:57 2022] DELETE /identity/v3/projects/3a1bac7550c546faa42a797da3ce3a51 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:17:57.401714 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef946cc-2743-4896-aecf-3a099d62423d None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:57.402315 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef946cc-2743-4896-aecf-3a099d62423d None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:57.403670 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef946cc-2743-4896-aecf-3a099d62423d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:57.443529 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-1ef946cc-2743-4896-aecf-3a099d62423d None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:57.444791 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-1ef946cc-2743-4896-aecf-3a099d62423d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:57.606729 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1105/2182] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:17:57.615634 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120115bc-c6fb-4c93-b332-cce95fde5351 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:57.615984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120115bc-c6fb-4c93-b332-cce95fde5351 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:57.616267 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120115bc-c6fb-4c93-b332-cce95fde5351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:57.657449 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-120115bc-c6fb-4c93-b332-cce95fde5351 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:57.660114 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-120115bc-c6fb-4c93-b332-cce95fde5351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:57.689446 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1078/2183] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:17:57.692119 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef946cc-2743-4896-aecf-3a099d62423d None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:57.709902 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef946cc-2743-4896-aecf-3a099d62423d None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:57.717432 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d0b20-2d8a-4b7b-9510-2bff89bcb596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:57.718344 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d0b20-2d8a-4b7b-9510-2bff89bcb596 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:57.718631 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d0b20-2d8a-4b7b-9510-2bff89bcb596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:57.718915 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d0b20-2d8a-4b7b-9510-2bff89bcb596 admin admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:57.720650 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d0b20-2d8a-4b7b-9510-2bff89bcb596 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:17:57.720978 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d0b20-2d8a-4b7b-9510-2bff89bcb596 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:57.723008 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d0b20-2d8a-4b7b-9510-2bff89bcb596 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:57.742474 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1106/2184] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:17:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:17:57.743782 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120115bc-c6fb-4c93-b332-cce95fde5351 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:57.759005 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120115bc-c6fb-4c93-b332-cce95fde5351 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:57.764269 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886cc8c3-d9f8-448f-9db1-a934384844fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:57.764924 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886cc8c3-d9f8-448f-9db1-a934384844fc admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:57.765360 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886cc8c3-d9f8-448f-9db1-a934384844fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:57.765645 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886cc8c3-d9f8-448f-9db1-a934384844fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:57.766640 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886cc8c3-d9f8-448f-9db1-a934384844fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:57.769286 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886cc8c3-d9f8-448f-9db1-a934384844fc admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:57.814027 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1079/2185] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:17:57 2022] POST /identity/v3/projects => generated 375 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:17:57.816581 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d0b20-2d8a-4b7b-9510-2bff89bcb596 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:57.833544 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d0b20-2d8a-4b7b-9510-2bff89bcb596 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:57.997641 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8bfbe-a46c-427a-96aa-a258b98ba5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:57.998345 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8bfbe-a46c-427a-96aa-a258b98ba5e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:57.998623 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8bfbe-a46c-427a-96aa-a258b98ba5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:57.998837 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8bfbe-a46c-427a-96aa-a258b98ba5e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:57.999928 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c8bfbe-a46c-427a-96aa-a258b98ba5e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:58.003275 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c8bfbe-a46c-427a-96aa-a258b98ba5e0 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:58.042480 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1107/2186] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:17:57 2022] POST /identity/v3/users => generated 288 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:17:58.049043 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886cc8c3-d9f8-448f-9db1-a934384844fc admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:58.062658 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886cc8c3-d9f8-448f-9db1-a934384844fc admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:58.074166 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588b16c-709e-47af-ba69-86610b5a86ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:58.074824 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588b16c-709e-47af-ba69-86610b5a86ee admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:58.075106 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588b16c-709e-47af-ba69-86610b5a86ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:58.075375 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588b16c-709e-47af-ba69-86610b5a86ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:58.076118 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2588b16c-709e-47af-ba69-86610b5a86ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:58.077951 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2588b16c-709e-47af-ba69-86610b5a86ee admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:58.091761 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1080/2187] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:17:58.095935 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8bfbe-a46c-427a-96aa-a258b98ba5e0 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:58.110706 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8bfbe-a46c-427a-96aa-a258b98ba5e0 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:58.116987 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afd5d4-8178-4711-a81d-0db288ed9088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:58.117846 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afd5d4-8178-4711-a81d-0db288ed9088 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:58.118193 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afd5d4-8178-4711-a81d-0db288ed9088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:58.118541 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afd5d4-8178-4711-a81d-0db288ed9088 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:58.119462 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56afd5d4-8178-4711-a81d-0db288ed9088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:58.121419 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56afd5d4-8178-4711-a81d-0db288ed9088 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:58.147227 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1108/2188] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:17:58.155134 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588b16c-709e-47af-ba69-86610b5a86ee admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:58.171851 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588b16c-709e-47af-ba69-86610b5a86ee admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:58.178678 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210d545-a9c2-4fd5-93a6-85895aa14706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:58.179756 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210d545-a9c2-4fd5-93a6-85895aa14706 admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:58.180100 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210d545-a9c2-4fd5-93a6-85895aa14706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:58.180410 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210d545-a9c2-4fd5-93a6-85895aa14706 admin admin] PATH_INFO: `/v3/projects/8ec7f181b4e645638ca006d6311cc7e3/users/9e467b255bf54ded9815e902e99b41df/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:58.207355 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210d545-a9c2-4fd5-93a6-85895aa14706 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ec7f181b4e645638ca006d6311cc7e3, user_id=9e467b255bf54ded9815e902e99b41df, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:58.211246 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210d545-a9c2-4fd5-93a6-85895aa14706 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:58.239682 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1081/2189] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:17:58 2022] PUT /identity/v3/projects/8ec7f181b4e645638ca006d6311cc7e3/users/9e467b255bf54ded9815e902e99b41df/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:17:58.248265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed43150-ea0b-4a12-93b4-b76365be1cb2 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:58.249720 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed43150-ea0b-4a12-93b4-b76365be1cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:58.250154 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed43150-ea0b-4a12-93b4-b76365be1cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:58.295083 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-aed43150-ea0b-4a12-93b4-b76365be1cb2 None None] MFA Rules not processed for user `9e467b255bf54ded9815e902e99b41df`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:58.297230 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-aed43150-ea0b-4a12-93b4-b76365be1cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:58.306712 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:58.456212 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1109/2190] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:17:58.461945 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210d545-a9c2-4fd5-93a6-85895aa14706 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:58.636825 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210d545-a9c2-4fd5-93a6-85895aa14706 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:58.644036 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e6729d-7d6a-473f-bdad-bd6716882e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:58.645035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6729d-7d6a-473f-bdad-bd6716882e86 admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:58.645532 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6729d-7d6a-473f-bdad-bd6716882e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:58.646121 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6729d-7d6a-473f-bdad-bd6716882e86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:58.647043 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e6729d-7d6a-473f-bdad-bd6716882e86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:58.652748 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e6729d-7d6a-473f-bdad-bd6716882e86 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:58.736963 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1082/2191] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:17:58 2022] POST /identity/v3/projects => generated 375 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:17:58.740844 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed43150-ea0b-4a12-93b4-b76365be1cb2 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:58.757794 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed43150-ea0b-4a12-93b4-b76365be1cb2 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:58.869448 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6841baf-17be-427a-8e3e-4566fd58593f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:58.870792 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6841baf-17be-427a-8e3e-4566fd58593f admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:58.870792 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6841baf-17be-427a-8e3e-4566fd58593f admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:58.870792 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6841baf-17be-427a-8e3e-4566fd58593f admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:58.871573 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6841baf-17be-427a-8e3e-4566fd58593f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:58.873672 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6841baf-17be-427a-8e3e-4566fd58593f admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:58.916309 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1110/2192] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:17:58 2022] POST /identity/v3/users => generated 294 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:17:58.924646 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e6729d-7d6a-473f-bdad-bd6716882e86 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:58.937650 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:58.943973 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e6729d-7d6a-473f-bdad-bd6716882e86 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:58.953605 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c300ce-b602-40fc-93c1-caae7ca3520c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:58.955381 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c300ce-b602-40fc-93c1-caae7ca3520c admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:58.956158 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c300ce-b602-40fc-93c1-caae7ca3520c admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:58.956633 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c300ce-b602-40fc-93c1-caae7ca3520c admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:58.957830 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c300ce-b602-40fc-93c1-caae7ca3520c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:58.960346 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c300ce-b602-40fc-93c1-caae7ca3520c admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:58.983544 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1083/2193] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:17:58.987441 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6841baf-17be-427a-8e3e-4566fd58593f admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:58.997868 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6841baf-17be-427a-8e3e-4566fd58593f admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:59.004412 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31473d44-70f6-42db-91bc-4ee4a3fb76f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:59.005135 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31473d44-70f6-42db-91bc-4ee4a3fb76f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:59.005570 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31473d44-70f6-42db-91bc-4ee4a3fb76f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:59.005847 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31473d44-70f6-42db-91bc-4ee4a3fb76f4 admin admin] PATH_INFO: `/v3/projects/2efc4e5a30774a44b8fa9ebcb6ad103d/users/647397d2645d4553b22e75219cee8ec5/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:59.023386 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31473d44-70f6-42db-91bc-4ee4a3fb76f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2efc4e5a30774a44b8fa9ebcb6ad103d, user_id=647397d2645d4553b22e75219cee8ec5, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:59.026401 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31473d44-70f6-42db-91bc-4ee4a3fb76f4 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:59.052649 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1111/2194] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:17:58 2022] PUT /identity/v3/projects/2efc4e5a30774a44b8fa9ebcb6ad103d/users/647397d2645d4553b22e75219cee8ec5/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:17:59.052766 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c300ce-b602-40fc-93c1-caae7ca3520c admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:59.063775 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c300ce-b602-40fc-93c1-caae7ca3520c admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:59.163464 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37314ad-7e3f-48f1-a24f-413475f96931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:59.164339 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37314ad-7e3f-48f1-a24f-413475f96931 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:59.166648 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37314ad-7e3f-48f1-a24f-413475f96931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:59.167028 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37314ad-7e3f-48f1-a24f-413475f96931 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:59.168134 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37314ad-7e3f-48f1-a24f-413475f96931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:59.169861 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37314ad-7e3f-48f1-a24f-413475f96931 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:59.182983 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1084/2195] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:17:59.186792 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31473d44-70f6-42db-91bc-4ee4a3fb76f4 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:59.202010 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31473d44-70f6-42db-91bc-4ee4a3fb76f4 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:59.209353 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b19330-9781-4019-b8aa-a7a03302585f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:59.211790 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b19330-9781-4019-b8aa-a7a03302585f admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:59.212175 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b19330-9781-4019-b8aa-a7a03302585f admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:59.212544 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b19330-9781-4019-b8aa-a7a03302585f admin admin] PATH_INFO: `/v3/projects/2efc4e5a30774a44b8fa9ebcb6ad103d/users/647397d2645d4553b22e75219cee8ec5/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:59.215243 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b19330-9781-4019-b8aa-a7a03302585f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2efc4e5a30774a44b8fa9ebcb6ad103d, user_id=647397d2645d4553b22e75219cee8ec5, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:59.223267 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b19330-9781-4019-b8aa-a7a03302585f admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:59.236082 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1112/2196] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:17:59 2022] PUT /identity/v3/projects/2efc4e5a30774a44b8fa9ebcb6ad103d/users/647397d2645d4553b22e75219cee8ec5/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:17:59.249701 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939b8a8-51ef-46ed-891a-cbeb15ffe08a None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:59.250246 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939b8a8-51ef-46ed-891a-cbeb15ffe08a None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:59.250353 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939b8a8-51ef-46ed-891a-cbeb15ffe08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:59.304222 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-b939b8a8-51ef-46ed-891a-cbeb15ffe08a None None] MFA Rules not processed for user `647397d2645d4553b22e75219cee8ec5`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:17:59.307357 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-b939b8a8-51ef-46ed-891a-cbeb15ffe08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:59.482162 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1085/2197] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:17:59 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:17:59.536627 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b19330-9781-4019-b8aa-a7a03302585f admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:17:59.539972 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-22b19330-9781-4019-b8aa-a7a03302585f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:17:59.623344 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b19330-9781-4019-b8aa-a7a03302585f admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:17:59.628232 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec684300-df8b-4fc2-a243-5feb7a80fe57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:17:59.629155 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec684300-df8b-4fc2-a243-5feb7a80fe57 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:17:59.629601 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec684300-df8b-4fc2-a243-5feb7a80fe57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:17:59.630042 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec684300-df8b-4fc2-a243-5feb7a80fe57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:17:59.644731 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:59.718013 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec684300-df8b-4fc2-a243-5feb7a80fe57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:17:59.720211 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec684300-df8b-4fc2-a243-5feb7a80fe57 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:17:59.734137 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1113/2198] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:17:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:05.711120 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b939b8a8-51ef-46ed-891a-cbeb15ffe08a None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:05.713260 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-b939b8a8-51ef-46ed-891a-cbeb15ffe08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:05.820537 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b939b8a8-51ef-46ed-891a-cbeb15ffe08a None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:05.837881 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd5da9-2fb9-4e44-bad1-31536b270813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:05.839546 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd5da9-2fb9-4e44-bad1-31536b270813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:05.840048 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd5da9-2fb9-4e44-bad1-31536b270813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:05.840513 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd5da9-2fb9-4e44-bad1-31536b270813 admin admin] PATH_INFO: `/v3/users/de628153165445cf91e3dfdb5cc97f06` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:05.843160 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd5da9-2fb9-4e44-bad1-31536b270813 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de628153165445cf91e3dfdb5cc97f06)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:05.848395 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd5da9-2fb9-4e44-bad1-31536b270813 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:05.890795 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:05.994486 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-42cd5da9-2fb9-4e44-bad1-31536b270813 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de628153165445cf91e3dfdb5cc97f06'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:05.995307 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-42cd5da9-2fb9-4e44-bad1-31536b270813 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de628153165445cf91e3dfdb5cc97f06'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:06.031543 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-42cd5da9-2fb9-4e44-bad1-31536b270813 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de628153165445cf91e3dfdb5cc97f06'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:06.045399 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-42cd5da9-2fb9-4e44-bad1-31536b270813 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de628153165445cf91e3dfdb5cc97f06'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:06.046147 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-42cd5da9-2fb9-4e44-bad1-31536b270813 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de628153165445cf91e3dfdb5cc97f06'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:06.073487 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1086/2199] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:18:05 2022] DELETE /identity/v3/users/de628153165445cf91e3dfdb5cc97f06 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:06.075900 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7459612-c6e6-4267-8379-854c14d61852 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:06.076831 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7459612-c6e6-4267-8379-854c14d61852 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:06.077419 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7459612-c6e6-4267-8379-854c14d61852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:06.104231 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-c7459612-c6e6-4267-8379-854c14d61852 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:06.105707 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-c7459612-c6e6-4267-8379-854c14d61852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:06.204582 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1114/2200] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:18:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:06.226107 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd5da9-2fb9-4e44-bad1-31536b270813 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:06.227939 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-42cd5da9-2fb9-4e44-bad1-31536b270813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:06.350096 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd5da9-2fb9-4e44-bad1-31536b270813 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:06.365080 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d947a060-0a7b-4e5b-b236-db40e94257bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:06.366951 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947a060-0a7b-4e5b-b236-db40e94257bf service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:06.367383 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947a060-0a7b-4e5b-b236-db40e94257bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:06.400900 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947a060-0a7b-4e5b-b236-db40e94257bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:06.433225 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d947a060-0a7b-4e5b-b236-db40e94257bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:06.434866 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d947a060-0a7b-4e5b-b236-db40e94257bf service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:06.464049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1087/2201] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:06.560588 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7459612-c6e6-4267-8379-854c14d61852 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:06.574435 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7459612-c6e6-4267-8379-854c14d61852 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:06.585912 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ae836-3bbc-40be-9ef6-6ebe75e41556 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:06.586600 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ae836-3bbc-40be-9ef6-6ebe75e41556 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:06.586876 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ae836-3bbc-40be-9ef6-6ebe75e41556 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:06.587131 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ae836-3bbc-40be-9ef6-6ebe75e41556 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:06.592800 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-270ae836-3bbc-40be-9ef6-6ebe75e41556 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:06.742069 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270ae836-3bbc-40be-9ef6-6ebe75e41556 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:06.744059 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270ae836-3bbc-40be-9ef6-6ebe75e41556 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:06.767329 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1115/2202] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:06 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:07.411290 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d947a060-0a7b-4e5b-b236-db40e94257bf service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:07.412846 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-d947a060-0a7b-4e5b-b236-db40e94257bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:07.436942 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d947a060-0a7b-4e5b-b236-db40e94257bf service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:07.449300 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab08fbfe-ea46-4ba1-b616-ba4191ec3a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:07.450027 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08fbfe-ea46-4ba1-b616-ba4191ec3a3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:07.450303 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08fbfe-ea46-4ba1-b616-ba4191ec3a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:07.450573 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08fbfe-ea46-4ba1-b616-ba4191ec3a3f admin admin] PATH_INFO: `/v3/projects/8636171250234d728758747edd1a71d2` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:07.452519 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab08fbfe-ea46-4ba1-b616-ba4191ec3a3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8636171250234d728758747edd1a71d2)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:07.457070 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab08fbfe-ea46-4ba1-b616-ba4191ec3a3f admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:07.587922 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-ab08fbfe-ea46-4ba1-b616-ba4191ec3a3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8636171250234d728758747edd1a71d2', 'request_id': 'req-ab08fbfe-ea46-4ba1-b616-ba4191ec3a3f'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:07.593918 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-ab08fbfe-ea46-4ba1-b616-ba4191ec3a3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8636171250234d728758747edd1a71d2', 'request_id': 'req-ab08fbfe-ea46-4ba1-b616-ba4191ec3a3f'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:07.607217 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-ab08fbfe-ea46-4ba1-b616-ba4191ec3a3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8636171250234d728758747edd1a71d2', 'request_id': 'req-ab08fbfe-ea46-4ba1-b616-ba4191ec3a3f'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:07.641091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-ab08fbfe-ea46-4ba1-b616-ba4191ec3a3f admin admin] The token cache is being invalidate because project 8636171250234d728758747edd1a71d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:18:07.641621 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-ab08fbfe-ea46-4ba1-b616-ba4191ec3a3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:07.642692 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-ab08fbfe-ea46-4ba1-b616-ba4191ec3a3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:07.645552 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1088/2203] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:07 2022] DELETE /identity/v3/projects/8636171250234d728758747edd1a71d2 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:07.652015 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059e03f-2137-486e-bd8e-af23ba84b303 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:07.653267 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059e03f-2137-486e-bd8e-af23ba84b303 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:07.653779 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059e03f-2137-486e-bd8e-af23ba84b303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:07.710032 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-2059e03f-2137-486e-bd8e-af23ba84b303 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:07.711378 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-2059e03f-2137-486e-bd8e-af23ba84b303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:07.804994 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:07.826434 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1116/2204] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:07.827780 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711aa1c-aed0-4970-91c8-7532c68a3c74 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:07.828071 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711aa1c-aed0-4970-91c8-7532c68a3c74 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:07.828345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711aa1c-aed0-4970-91c8-7532c68a3c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:07.864645 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-f711aa1c-aed0-4970-91c8-7532c68a3c74 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:07.870260 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-f711aa1c-aed0-4970-91c8-7532c68a3c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:07.893471 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1089/2205] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:07.899595 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059e03f-2137-486e-bd8e-af23ba84b303 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:07.919582 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059e03f-2137-486e-bd8e-af23ba84b303 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:07.924428 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386008fe-ea79-4616-adc1-e3c65a573960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:07.925065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386008fe-ea79-4616-adc1-e3c65a573960 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:07.925343 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386008fe-ea79-4616-adc1-e3c65a573960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:07.925617 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386008fe-ea79-4616-adc1-e3c65a573960 admin admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:07.926323 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386008fe-ea79-4616-adc1-e3c65a573960 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:18:07.926629 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386008fe-ea79-4616-adc1-e3c65a573960 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:07.928273 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386008fe-ea79-4616-adc1-e3c65a573960 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:07.958019 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1117/2206] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:18:07.962852 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f711aa1c-aed0-4970-91c8-7532c68a3c74 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:07.974677 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f711aa1c-aed0-4970-91c8-7532c68a3c74 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:07.984828 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f7eb6-0b1e-4a34-92a8-6a2b16dc0451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:07.986912 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f7eb6-0b1e-4a34-92a8-6a2b16dc0451 admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:07.987033 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f7eb6-0b1e-4a34-92a8-6a2b16dc0451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:07.987745 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f7eb6-0b1e-4a34-92a8-6a2b16dc0451 admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:07.989555 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f7eb6-0b1e-4a34-92a8-6a2b16dc0451 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:07.991533 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f7eb6-0b1e-4a34-92a8-6a2b16dc0451 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:08.021072 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:08.072878 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1090/2207] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:18:07 2022] POST /identity/v3/projects => generated 361 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:08.076213 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386008fe-ea79-4616-adc1-e3c65a573960 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:08.094772 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386008fe-ea79-4616-adc1-e3c65a573960 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:08.247112 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009cfab-70c2-4cc4-bb8b-2feb0704e379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:08.247798 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009cfab-70c2-4cc4-bb8b-2feb0704e379 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:08.248071 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009cfab-70c2-4cc4-bb8b-2feb0704e379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:08.248361 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009cfab-70c2-4cc4-bb8b-2feb0704e379 admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:08.249065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009cfab-70c2-4cc4-bb8b-2feb0704e379 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:08.251445 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009cfab-70c2-4cc4-bb8b-2feb0704e379 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:08.300555 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1118/2208] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:18:08 2022] POST /identity/v3/users => generated 281 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:18:08.304818 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f7eb6-0b1e-4a34-92a8-6a2b16dc0451 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:08.321657 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f7eb6-0b1e-4a34-92a8-6a2b16dc0451 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:08.337618 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc543d3b-6ef0-42a7-9c88-7e81c412c9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:08.338442 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc543d3b-6ef0-42a7-9c88-7e81c412c9c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:08.338732 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc543d3b-6ef0-42a7-9c88-7e81c412c9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:08.339008 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc543d3b-6ef0-42a7-9c88-7e81c412c9c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:08.339768 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc543d3b-6ef0-42a7-9c88-7e81c412c9c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:08.342252 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc543d3b-6ef0-42a7-9c88-7e81c412c9c4 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:08.362535 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1091/2209] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:08.366835 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009cfab-70c2-4cc4-bb8b-2feb0704e379 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:08.389449 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009cfab-70c2-4cc4-bb8b-2feb0704e379 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:08.399639 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef8de5-6b64-4580-8c2b-6b4709b8cd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:08.400257 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef8de5-6b64-4580-8c2b-6b4709b8cd1c admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:08.400535 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef8de5-6b64-4580-8c2b-6b4709b8cd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:08.400807 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef8de5-6b64-4580-8c2b-6b4709b8cd1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:08.401532 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef8de5-6b64-4580-8c2b-6b4709b8cd1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:08.403187 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef8de5-6b64-4580-8c2b-6b4709b8cd1c admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:08.435961 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1119/2210] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:08.440059 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc543d3b-6ef0-42a7-9c88-7e81c412c9c4 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:08.458219 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc543d3b-6ef0-42a7-9c88-7e81c412c9c4 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:08.477229 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8dc06-e648-440c-8197-d0087422e978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:08.478275 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8dc06-e648-440c-8197-d0087422e978 admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:08.478734 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8dc06-e648-440c-8197-d0087422e978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:08.479163 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8dc06-e648-440c-8197-d0087422e978 admin admin] PATH_INFO: `/v3/projects/a63f71115ead4134b3e9d731feaed0a9/users/b4edfcc63a7b40d58abca62922571394/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:08.507857 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed8dc06-e648-440c-8197-d0087422e978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a63f71115ead4134b3e9d731feaed0a9, user_id=b4edfcc63a7b40d58abca62922571394, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:08.510642 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed8dc06-e648-440c-8197-d0087422e978 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:08.550024 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1092/2211] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:08 2022] PUT /identity/v3/projects/a63f71115ead4134b3e9d731feaed0a9/users/b4edfcc63a7b40d58abca62922571394/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:08.561212 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9b168-8695-4f5f-906b-7e7436bd425e None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:08.561696 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9b168-8695-4f5f-906b-7e7436bd425e None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:08.562066 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9b168-8695-4f5f-906b-7e7436bd425e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:08.627502 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-b8c9b168-8695-4f5f-906b-7e7436bd425e None None] MFA Rules not processed for user `b4edfcc63a7b40d58abca62922571394`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:08.628870 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-b8c9b168-8695-4f5f-906b-7e7436bd425e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:08.746343 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1120/2212] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:18:08 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:08.772255 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8dc06-e648-440c-8197-d0087422e978 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:08.774031 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-5ed8dc06-e648-440c-8197-d0087422e978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:08.899267 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8dc06-e648-440c-8197-d0087422e978 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:08.910140 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797aaab4-1f4f-4a59-bbff-822680e0c500 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:08.910811 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797aaab4-1f4f-4a59-bbff-822680e0c500 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:08.911092 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797aaab4-1f4f-4a59-bbff-822680e0c500 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:08.911378 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797aaab4-1f4f-4a59-bbff-822680e0c500 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:08.935252 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797aaab4-1f4f-4a59-bbff-822680e0c500 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:08.936797 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797aaab4-1f4f-4a59-bbff-822680e0c500 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:08.970589 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1093/2213] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:08 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:16.197576 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9b168-8695-4f5f-906b-7e7436bd425e None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:16.202994 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-b8c9b168-8695-4f5f-906b-7e7436bd425e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:16.393056 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:16.439540 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9b168-8695-4f5f-906b-7e7436bd425e None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:16.445187 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea8aa3-0efc-4f13-8545-dfbea689fc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:16.446092 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea8aa3-0efc-4f13-8545-dfbea689fc3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:16.446553 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea8aa3-0efc-4f13-8545-dfbea689fc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:16.447131 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea8aa3-0efc-4f13-8545-dfbea689fc3e admin admin] PATH_INFO: `/v3/users/c9ee21d2fb3f426687ae741ee87ce527` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:16.449231 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea8aa3-0efc-4f13-8545-dfbea689fc3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9ee21d2fb3f426687ae741ee87ce527)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:16.451375 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea8aa3-0efc-4f13-8545-dfbea689fc3e admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:16.578754 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-4cea8aa3-0efc-4f13-8545-dfbea689fc3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9ee21d2fb3f426687ae741ee87ce527'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:16.588733 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-4cea8aa3-0efc-4f13-8545-dfbea689fc3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9ee21d2fb3f426687ae741ee87ce527'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:16.589554 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-4cea8aa3-0efc-4f13-8545-dfbea689fc3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9ee21d2fb3f426687ae741ee87ce527'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:16.622520 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-4cea8aa3-0efc-4f13-8545-dfbea689fc3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9ee21d2fb3f426687ae741ee87ce527'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:16.623380 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-4cea8aa3-0efc-4f13-8545-dfbea689fc3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9ee21d2fb3f426687ae741ee87ce527'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:16.653245 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abe652-1e08-4b76-a3c4-d6d73c5052b0 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:16.653833 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abe652-1e08-4b76-a3c4-d6d73c5052b0 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:16.654260 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abe652-1e08-4b76-a3c4-d6d73c5052b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:16.661382 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1121/2214] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:18:16 2022] DELETE /identity/v3/users/c9ee21d2fb3f426687ae741ee87ce527 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:16.680264 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-b5abe652-1e08-4b76-a3c4-d6d73c5052b0 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:16.685676 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-b5abe652-1e08-4b76-a3c4-d6d73c5052b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:16.872948 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1094/2215] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:18:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:16.909316 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea8aa3-0efc-4f13-8545-dfbea689fc3e admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:16.910827 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-4cea8aa3-0efc-4f13-8545-dfbea689fc3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:17.119977 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea8aa3-0efc-4f13-8545-dfbea689fc3e admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:17.128277 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4c4cc-e709-443c-bcaf-c3d134dfbd23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:17.128940 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4c4cc-e709-443c-bcaf-c3d134dfbd23 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:17.129221 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4c4cc-e709-443c-bcaf-c3d134dfbd23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:17.129494 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4c4cc-e709-443c-bcaf-c3d134dfbd23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:17.154219 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4c4cc-e709-443c-bcaf-c3d134dfbd23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:17.158012 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4c4cc-e709-443c-bcaf-c3d134dfbd23 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:17.184366 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1122/2216] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:17.614062 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5abe652-1e08-4b76-a3c4-d6d73c5052b0 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:17.615692 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-b5abe652-1e08-4b76-a3c4-d6d73c5052b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:17.650641 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5abe652-1e08-4b76-a3c4-d6d73c5052b0 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:17.664760 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d593b-72bd-4cbb-840c-cbfd1702359a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:17.665419 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d593b-72bd-4cbb-840c-cbfd1702359a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:17.665720 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d593b-72bd-4cbb-840c-cbfd1702359a admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:17.666007 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d593b-72bd-4cbb-840c-cbfd1702359a admin admin] PATH_INFO: `/v3/projects/0c5f2e9e59e34c15bfc099812fd8fc90` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:17.668253 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d593b-72bd-4cbb-840c-cbfd1702359a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c5f2e9e59e34c15bfc099812fd8fc90)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:17.675304 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d593b-72bd-4cbb-840c-cbfd1702359a admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:17.792372 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-5d6d593b-72bd-4cbb-840c-cbfd1702359a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c5f2e9e59e34c15bfc099812fd8fc90', 'request_id': 'req-5d6d593b-72bd-4cbb-840c-cbfd1702359a'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:17.800981 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:17.814299 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-5d6d593b-72bd-4cbb-840c-cbfd1702359a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c5f2e9e59e34c15bfc099812fd8fc90', 'request_id': 'req-5d6d593b-72bd-4cbb-840c-cbfd1702359a'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:17.844162 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-5d6d593b-72bd-4cbb-840c-cbfd1702359a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c5f2e9e59e34c15bfc099812fd8fc90', 'request_id': 'req-5d6d593b-72bd-4cbb-840c-cbfd1702359a'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:17.878318 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-5d6d593b-72bd-4cbb-840c-cbfd1702359a admin admin] The token cache is being invalidate because project 0c5f2e9e59e34c15bfc099812fd8fc90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:18:17.878881 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-5d6d593b-72bd-4cbb-840c-cbfd1702359a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:17.881424 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-5d6d593b-72bd-4cbb-840c-cbfd1702359a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:17.886016 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1095/2217] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:17 2022] DELETE /identity/v3/projects/0c5f2e9e59e34c15bfc099812fd8fc90 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:17.892015 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116465ee-5f91-4f96-a0e1-987237ed93a6 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:17.892832 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116465ee-5f91-4f96-a0e1-987237ed93a6 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:17.893259 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116465ee-5f91-4f96-a0e1-987237ed93a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:17.927790 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-116465ee-5f91-4f96-a0e1-987237ed93a6 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:17.929463 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-116465ee-5f91-4f96-a0e1-987237ed93a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:18.017243 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7fe30-fe14-414b-b62c-326a02a2aab6 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:18.017527 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7fe30-fe14-414b-b62c-326a02a2aab6 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:18.017806 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7fe30-fe14-414b-b62c-326a02a2aab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:18.026011 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1123/2218] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:18:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:18.052339 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-3cb7fe30-fe14-414b-b62c-326a02a2aab6 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:18.053209 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-3cb7fe30-fe14-414b-b62c-326a02a2aab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:18.075118 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1096/2219] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:18:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:18:18.079802 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116465ee-5f91-4f96-a0e1-987237ed93a6 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:18.091689 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116465ee-5f91-4f96-a0e1-987237ed93a6 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:18.104442 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839aca96-d071-4372-9cf4-b90b1b46ad1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:18.105463 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839aca96-d071-4372-9cf4-b90b1b46ad1d admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:18.105931 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839aca96-d071-4372-9cf4-b90b1b46ad1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:18.106476 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839aca96-d071-4372-9cf4-b90b1b46ad1d admin admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:18.107409 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839aca96-d071-4372-9cf4-b90b1b46ad1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:18:18.107951 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839aca96-d071-4372-9cf4-b90b1b46ad1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:18.109819 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839aca96-d071-4372-9cf4-b90b1b46ad1d admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:18.115658 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:18.144986 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7fe30-fe14-414b-b62c-326a02a2aab6 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:18.150179 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1124/2220] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:18:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:18:18.163175 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7fe30-fe14-414b-b62c-326a02a2aab6 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:18.169036 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44887d88-38af-4107-b05f-d01f36542929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:18.170055 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44887d88-38af-4107-b05f-d01f36542929 admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:18.170538 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44887d88-38af-4107-b05f-d01f36542929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:18.172030 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44887d88-38af-4107-b05f-d01f36542929 admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:18.172760 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44887d88-38af-4107-b05f-d01f36542929 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:18.178074 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44887d88-38af-4107-b05f-d01f36542929 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:18.250620 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1097/2221] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:18:18 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:18.255185 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839aca96-d071-4372-9cf4-b90b1b46ad1d admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:18.269493 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839aca96-d071-4372-9cf4-b90b1b46ad1d admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:18.387548 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b44f6-7fd6-4e18-9baf-a5f5fac938e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:18.389409 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b44f6-7fd6-4e18-9baf-a5f5fac938e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:18.389785 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b44f6-7fd6-4e18-9baf-a5f5fac938e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:18.390578 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b44f6-7fd6-4e18-9baf-a5f5fac938e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:18.391374 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b44f6-7fd6-4e18-9baf-a5f5fac938e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:18.393474 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b44f6-7fd6-4e18-9baf-a5f5fac938e0 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:18.451451 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1125/2222] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:18:18 2022] POST /identity/v3/users => generated 289 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:18.456545 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44887d88-38af-4107-b05f-d01f36542929 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:18.470226 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44887d88-38af-4107-b05f-d01f36542929 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:18.484159 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfaba0f-3c8d-4e4c-9de3-685465a5cdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:18.484814 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfaba0f-3c8d-4e4c-9de3-685465a5cdc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:18.485094 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfaba0f-3c8d-4e4c-9de3-685465a5cdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:18.485365 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfaba0f-3c8d-4e4c-9de3-685465a5cdc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:18.486091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfaba0f-3c8d-4e4c-9de3-685465a5cdc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:18.487764 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfaba0f-3c8d-4e4c-9de3-685465a5cdc3 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:18.516072 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1098/2223] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:18.518968 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b44f6-7fd6-4e18-9baf-a5f5fac938e0 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:18.532792 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b44f6-7fd6-4e18-9baf-a5f5fac938e0 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:18.548861 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b53287-8d0b-490e-ad49-7cc9dc11fb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:18.549686 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b53287-8d0b-490e-ad49-7cc9dc11fb6e admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:18.550058 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b53287-8d0b-490e-ad49-7cc9dc11fb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:18.552178 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b53287-8d0b-490e-ad49-7cc9dc11fb6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:18.556137 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b53287-8d0b-490e-ad49-7cc9dc11fb6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:18.564773 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b53287-8d0b-490e-ad49-7cc9dc11fb6e admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:18.592921 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1126/2224] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:18.597419 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfaba0f-3c8d-4e4c-9de3-685465a5cdc3 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:18.630794 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfaba0f-3c8d-4e4c-9de3-685465a5cdc3 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:18.645848 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d2174-7080-4bae-a53f-0e6863715bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:18.646571 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d2174-7080-4bae-a53f-0e6863715bde admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:18.647378 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d2174-7080-4bae-a53f-0e6863715bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:18.647378 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d2174-7080-4bae-a53f-0e6863715bde admin admin] PATH_INFO: `/v3/projects/b34eb8d109784788b15b980fb254a246/users/2ff5b02e87a0463e9c30662199202acb/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:18.686160 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d2174-7080-4bae-a53f-0e6863715bde admin admin] RBAC: Authorizing `identity:create_grant(project_id=b34eb8d109784788b15b980fb254a246, user_id=2ff5b02e87a0463e9c30662199202acb, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:18.697089 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d2174-7080-4bae-a53f-0e6863715bde admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:18.726957 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1099/2225] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:18 2022] PUT /identity/v3/projects/b34eb8d109784788b15b980fb254a246/users/2ff5b02e87a0463e9c30662199202acb/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:18.740103 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbdebb9-fa7b-461e-b562-589bbc83b4ef None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:18.740494 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbdebb9-fa7b-461e-b562-589bbc83b4ef None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:18.740829 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbdebb9-fa7b-461e-b562-589bbc83b4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:18.802222 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-4fbdebb9-fa7b-461e-b562-589bbc83b4ef None None] MFA Rules not processed for user `2ff5b02e87a0463e9c30662199202acb`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:18.806292 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-4fbdebb9-fa7b-461e-b562-589bbc83b4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:18.953271 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1127/2226] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:18:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:19.002163 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d2174-7080-4bae-a53f-0e6863715bde admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:19.009391 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-7f5d2174-7080-4bae-a53f-0e6863715bde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:19.088963 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d2174-7080-4bae-a53f-0e6863715bde admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:19.093471 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0483c9-f4f8-474b-a1a3-2049eaefe5b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:19.094382 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0483c9-f4f8-474b-a1a3-2049eaefe5b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:19.094815 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0483c9-f4f8-474b-a1a3-2049eaefe5b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:19.095261 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0483c9-f4f8-474b-a1a3-2049eaefe5b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:19.106646 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0483c9-f4f8-474b-a1a3-2049eaefe5b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:19.108334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0483c9-f4f8-474b-a1a3-2049eaefe5b5 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:19.119651 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1100/2227] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:28.959600 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=69,keystone:INSERT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:29.114393 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=59,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:29.708252 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec4c6a-c052-435e-bccd-9b8d3c8913a6 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:29.708744 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec4c6a-c052-435e-bccd-9b8d3c8913a6 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:29.709160 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec4c6a-c052-435e-bccd-9b8d3c8913a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:29.745945 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-71ec4c6a-c052-435e-bccd-9b8d3c8913a6 None None] MFA Rules not processed for user `9e467b255bf54ded9815e902e99b41df`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:29.747440 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-71ec4c6a-c052-435e-bccd-9b8d3c8913a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:29.848873 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1128/2228] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:18:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:38.627182 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0483c9-f4f8-474b-a1a3-2049eaefe5b5 service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:38.630012 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-ce0483c9-f4f8-474b-a1a3-2049eaefe5b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:38.724975 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0483c9-f4f8-474b-a1a3-2049eaefe5b5 service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:38.732398 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236b67f-439d-4641-8991-d6d100f12d5c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:38.733506 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236b67f-439d-4641-8991-d6d100f12d5c service placement] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:38.734022 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236b67f-439d-4641-8991-d6d100f12d5c service placement] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:38.734551 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236b67f-439d-4641-8991-d6d100f12d5c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:38.737113 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-0236b67f-439d-4641-8991-d6d100f12d5c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:38.753517 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236b67f-439d-4641-8991-d6d100f12d5c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:38.755258 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236b67f-439d-4641-8991-d6d100f12d5c service placement] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:38.767030 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1101/2229] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:39.833450 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=25 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:42.940653 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec4c6a-c052-435e-bccd-9b8d3c8913a6 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:43.032167 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec4c6a-c052-435e-bccd-9b8d3c8913a6 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:43.039298 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be25371-0498-495e-b769-fd92ba534b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:43.040374 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be25371-0498-495e-b769-fd92ba534b31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:43.040801 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be25371-0498-495e-b769-fd92ba534b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:43.041420 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be25371-0498-495e-b769-fd92ba534b31 admin admin] PATH_INFO: `/v3/users/2ff5b02e87a0463e9c30662199202acb` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:43.042815 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be25371-0498-495e-b769-fd92ba534b31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ff5b02e87a0463e9c30662199202acb)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:43.045255 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be25371-0498-495e-b769-fd92ba534b31 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:43.167817 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-5be25371-0498-495e-b769-fd92ba534b31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ff5b02e87a0463e9c30662199202acb'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:43.178244 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-5be25371-0498-495e-b769-fd92ba534b31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ff5b02e87a0463e9c30662199202acb'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:43.179372 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-5be25371-0498-495e-b769-fd92ba534b31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ff5b02e87a0463e9c30662199202acb'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:43.203451 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-5be25371-0498-495e-b769-fd92ba534b31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ff5b02e87a0463e9c30662199202acb'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:43.205006 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-5be25371-0498-495e-b769-fd92ba534b31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ff5b02e87a0463e9c30662199202acb'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:43.228000 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1129/2230] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:18:42 2022] DELETE /identity/v3/users/2ff5b02e87a0463e9c30662199202acb => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:43.232999 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33866a6f-1279-4f41-bcf5-d7c940699274 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:43.233550 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33866a6f-1279-4f41-bcf5-d7c940699274 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:43.233550 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33866a6f-1279-4f41-bcf5-d7c940699274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:43.292868 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-33866a6f-1279-4f41-bcf5-d7c940699274 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:43.299929 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-33866a6f-1279-4f41-bcf5-d7c940699274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:43.484567 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1102/2231] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:43.626126 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be25371-0498-495e-b769-fd92ba534b31 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:43.627737 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-5be25371-0498-495e-b769-fd92ba534b31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:43.767599 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be25371-0498-495e-b769-fd92ba534b31 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:43.773837 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42672559-9de6-4d24-8df4-ee8f7fc55305 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:43.774494 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42672559-9de6-4d24-8df4-ee8f7fc55305 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:43.774770 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42672559-9de6-4d24-8df4-ee8f7fc55305 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:43.775039 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42672559-9de6-4d24-8df4-ee8f7fc55305 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:43.801361 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42672559-9de6-4d24-8df4-ee8f7fc55305 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:43.803269 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42672559-9de6-4d24-8df4-ee8f7fc55305 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:43.846835 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1130/2232] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:45.455889 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33866a6f-1279-4f41-bcf5-d7c940699274 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:45.459793 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-33866a6f-1279-4f41-bcf5-d7c940699274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:45.478958 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33866a6f-1279-4f41-bcf5-d7c940699274 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:45.484091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aba7a6-3bf5-4d26-be1a-951664a70fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:45.485505 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aba7a6-3bf5-4d26-be1a-951664a70fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:45.485928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aba7a6-3bf5-4d26-be1a-951664a70fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:45.486395 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aba7a6-3bf5-4d26-be1a-951664a70fa5 admin admin] PATH_INFO: `/v3/projects/b34eb8d109784788b15b980fb254a246` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:45.488757 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aba7a6-3bf5-4d26-be1a-951664a70fa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b34eb8d109784788b15b980fb254a246)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:45.490951 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aba7a6-3bf5-4d26-be1a-951664a70fa5 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:45.620726 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-59aba7a6-3bf5-4d26-be1a-951664a70fa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b34eb8d109784788b15b980fb254a246', 'request_id': 'req-59aba7a6-3bf5-4d26-be1a-951664a70fa5'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:45.628192 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-59aba7a6-3bf5-4d26-be1a-951664a70fa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b34eb8d109784788b15b980fb254a246', 'request_id': 'req-59aba7a6-3bf5-4d26-be1a-951664a70fa5'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:45.640250 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-59aba7a6-3bf5-4d26-be1a-951664a70fa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b34eb8d109784788b15b980fb254a246', 'request_id': 'req-59aba7a6-3bf5-4d26-be1a-951664a70fa5'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:45.664493 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-59aba7a6-3bf5-4d26-be1a-951664a70fa5 admin admin] The token cache is being invalidate because project b34eb8d109784788b15b980fb254a246 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:18:45.665033 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-59aba7a6-3bf5-4d26-be1a-951664a70fa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:45.666005 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-59aba7a6-3bf5-4d26-be1a-951664a70fa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:45.682500 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1103/2233] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:45 2022] DELETE /identity/v3/projects/b34eb8d109784788b15b980fb254a246 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:53.814053 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:55.657366 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:00.770017 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42672559-9de6-4d24-8df4-ee8f7fc55305 service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:00.771986 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-42672559-9de6-4d24-8df4-ee8f7fc55305 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:00.790585 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42672559-9de6-4d24-8df4-ee8f7fc55305 service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:00.872965 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e747c64-ec87-4547-aa49-6a82306d32e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:00.874755 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e747c64-ec87-4547-aa49-6a82306d32e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:00.876706 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e747c64-ec87-4547-aa49-6a82306d32e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:00.878008 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e747c64-ec87-4547-aa49-6a82306d32e4 admin admin] PATH_INFO: `/v3/users/5f4a326874b94ea899f450ba5d41b27c` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:00.880917 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e747c64-ec87-4547-aa49-6a82306d32e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f4a326874b94ea899f450ba5d41b27c)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:00.885180 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e747c64-ec87-4547-aa49-6a82306d32e4 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:00.959392 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-9e747c64-ec87-4547-aa49-6a82306d32e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f4a326874b94ea899f450ba5d41b27c'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:00.969479 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-9e747c64-ec87-4547-aa49-6a82306d32e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f4a326874b94ea899f450ba5d41b27c'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:00.970942 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-9e747c64-ec87-4547-aa49-6a82306d32e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f4a326874b94ea899f450ba5d41b27c'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:00.986634 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-9e747c64-ec87-4547-aa49-6a82306d32e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f4a326874b94ea899f450ba5d41b27c'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:00.987464 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-9e747c64-ec87-4547-aa49-6a82306d32e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f4a326874b94ea899f450ba5d41b27c'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:01.009908 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1131/2234] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:19:00 2022] DELETE /identity/v3/users/5f4a326874b94ea899f450ba5d41b27c => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:01.836917 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aba7a6-3bf5-4d26-be1a-951664a70fa5 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:01.838548 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-59aba7a6-3bf5-4d26-be1a-951664a70fa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:01.859838 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aba7a6-3bf5-4d26-be1a-951664a70fa5 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:01.991654 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3692ad2-877b-4352-ade9-3e16474e3cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:01.992846 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3692ad2-877b-4352-ade9-3e16474e3cc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:01.993311 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3692ad2-877b-4352-ade9-3e16474e3cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:01.993874 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3692ad2-877b-4352-ade9-3e16474e3cc3 admin admin] PATH_INFO: `/v3/projects/56a82235bdca4e98a5aeafc6deceed8a` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:01.996464 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3692ad2-877b-4352-ade9-3e16474e3cc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56a82235bdca4e98a5aeafc6deceed8a)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:01.999549 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3692ad2-877b-4352-ade9-3e16474e3cc3 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:02.129728 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-c3692ad2-877b-4352-ade9-3e16474e3cc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56a82235bdca4e98a5aeafc6deceed8a', 'request_id': 'req-c3692ad2-877b-4352-ade9-3e16474e3cc3'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:02.137378 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-c3692ad2-877b-4352-ade9-3e16474e3cc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56a82235bdca4e98a5aeafc6deceed8a', 'request_id': 'req-c3692ad2-877b-4352-ade9-3e16474e3cc3'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:02.157511 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-c3692ad2-877b-4352-ade9-3e16474e3cc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56a82235bdca4e98a5aeafc6deceed8a', 'request_id': 'req-c3692ad2-877b-4352-ade9-3e16474e3cc3'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:02.192293 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-c3692ad2-877b-4352-ade9-3e16474e3cc3 admin admin] The token cache is being invalidate because project 56a82235bdca4e98a5aeafc6deceed8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:19:02.192744 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-c3692ad2-877b-4352-ade9-3e16474e3cc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:02.195318 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-c3692ad2-877b-4352-ade9-3e16474e3cc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:02.198578 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1104/2235] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:19:01 2022] DELETE /identity/v3/projects/56a82235bdca4e98a5aeafc6deceed8a => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:02.204290 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385163ff-37e6-4d55-84b9-ff5f68ce7597 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:02.204780 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385163ff-37e6-4d55-84b9-ff5f68ce7597 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:02.205039 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385163ff-37e6-4d55-84b9-ff5f68ce7597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:02.238416 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-385163ff-37e6-4d55-84b9-ff5f68ce7597 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:02.240720 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-385163ff-37e6-4d55-84b9-ff5f68ce7597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:02.354691 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1132/2236] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:19:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:02.371562 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa782bf-60da-446f-8693-778e43493dc9 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:02.372936 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa782bf-60da-446f-8693-778e43493dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:02.373426 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa782bf-60da-446f-8693-778e43493dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:02.401465 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-8fa782bf-60da-446f-8693-778e43493dc9 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:02.402997 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-8fa782bf-60da-446f-8693-778e43493dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:02.413465 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1105/2237] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:19:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:02.416950 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385163ff-37e6-4d55-84b9-ff5f68ce7597 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:02.429121 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385163ff-37e6-4d55-84b9-ff5f68ce7597 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:02.434658 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f083d9b-c0ff-46b8-bb52-00390196ddf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:02.435745 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f083d9b-c0ff-46b8-bb52-00390196ddf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:02.436068 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f083d9b-c0ff-46b8-bb52-00390196ddf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:02.436434 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f083d9b-c0ff-46b8-bb52-00390196ddf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:02.437298 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f083d9b-c0ff-46b8-bb52-00390196ddf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:19:02.437690 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f083d9b-c0ff-46b8-bb52-00390196ddf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:02.439406 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f083d9b-c0ff-46b8-bb52-00390196ddf2 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:02.452642 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1133/2238] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:19:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:19:02.457208 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa782bf-60da-446f-8693-778e43493dc9 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:02.477175 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa782bf-60da-446f-8693-778e43493dc9 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:02.493819 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b482dd-ca02-400c-8421-13679d720997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:02.494480 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b482dd-ca02-400c-8421-13679d720997 admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:02.494755 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b482dd-ca02-400c-8421-13679d720997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:02.495023 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b482dd-ca02-400c-8421-13679d720997 admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:02.495955 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b482dd-ca02-400c-8421-13679d720997 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:02.498078 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b482dd-ca02-400c-8421-13679d720997 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:02.534956 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1106/2239] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:19:02 2022] POST /identity/v3/projects => generated 383 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:02.539952 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f083d9b-c0ff-46b8-bb52-00390196ddf2 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:02.554537 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f083d9b-c0ff-46b8-bb52-00390196ddf2 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:02.561382 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:02.642300 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be653db3-8f28-4958-9618-bc3f890947a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:02.643283 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be653db3-8f28-4958-9618-bc3f890947a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:02.643877 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be653db3-8f28-4958-9618-bc3f890947a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:02.644383 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be653db3-8f28-4958-9618-bc3f890947a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:02.645267 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be653db3-8f28-4958-9618-bc3f890947a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:02.647422 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be653db3-8f28-4958-9618-bc3f890947a8 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:02.689161 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1134/2240] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:19:02 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:02.691106 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b482dd-ca02-400c-8421-13679d720997 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:02.705404 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b482dd-ca02-400c-8421-13679d720997 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:02.712811 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c6991-4a5f-4d6e-aad1-b2caeded6e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:02.713862 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c6991-4a5f-4d6e-aad1-b2caeded6e9f admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:02.715099 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c6991-4a5f-4d6e-aad1-b2caeded6e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:02.715544 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c6991-4a5f-4d6e-aad1-b2caeded6e9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:02.716407 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c6991-4a5f-4d6e-aad1-b2caeded6e9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:02.718323 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c6991-4a5f-4d6e-aad1-b2caeded6e9f admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:02.737118 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1107/2241] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:19:02.741059 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be653db3-8f28-4958-9618-bc3f890947a8 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:02.757247 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be653db3-8f28-4958-9618-bc3f890947a8 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:02.765122 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5661f-cd18-40f2-9b6d-27c19828a09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:02.766111 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5661f-cd18-40f2-9b6d-27c19828a09c admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:02.766726 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5661f-cd18-40f2-9b6d-27c19828a09c admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:02.767345 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5661f-cd18-40f2-9b6d-27c19828a09c admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:02.768359 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d5661f-cd18-40f2-9b6d-27c19828a09c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:02.770501 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d5661f-cd18-40f2-9b6d-27c19828a09c admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:02.792058 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c6991-4a5f-4d6e-aad1-b2caeded6e9f admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:02.792752 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1135/2242] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:02.805476 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c6991-4a5f-4d6e-aad1-b2caeded6e9f admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:02.811531 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec7a89-6e48-404c-a0e3-c76a3ac2727e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:02.812654 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec7a89-6e48-404c-a0e3-c76a3ac2727e admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:02.813157 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec7a89-6e48-404c-a0e3-c76a3ac2727e admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:02.813652 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec7a89-6e48-404c-a0e3-c76a3ac2727e admin admin] PATH_INFO: `/v3/projects/5d78c29c7a8945d1950329729f6c778b/users/70ec25efe7004b0fa4a841616fad6d78/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:02.847274 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec7a89-6e48-404c-a0e3-c76a3ac2727e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d78c29c7a8945d1950329729f6c778b, user_id=70ec25efe7004b0fa4a841616fad6d78, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:02.850456 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec7a89-6e48-404c-a0e3-c76a3ac2727e admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:02.882546 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1108/2243] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:19:02 2022] PUT /identity/v3/projects/5d78c29c7a8945d1950329729f6c778b/users/70ec25efe7004b0fa4a841616fad6d78/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:02.885714 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b587d2c-18a1-4516-b40f-51f6f4ff0066 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:02.886267 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b587d2c-18a1-4516-b40f-51f6f4ff0066 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:02.886762 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b587d2c-18a1-4516-b40f-51f6f4ff0066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:02.925558 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-8b587d2c-18a1-4516-b40f-51f6f4ff0066 None None] MFA Rules not processed for user `70ec25efe7004b0fa4a841616fad6d78`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:02.927248 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-8b587d2c-18a1-4516-b40f-51f6f4ff0066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:03.040263 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1136/2244] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:19:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:03.042373 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec7a89-6e48-404c-a0e3-c76a3ac2727e admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:03.087020 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:03.146479 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec7a89-6e48-404c-a0e3-c76a3ac2727e admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:03.154083 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e7de0-f7b5-410e-ab17-47463f5bcc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:03.154966 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e7de0-f7b5-410e-ab17-47463f5bcc4d admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:03.155286 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e7de0-f7b5-410e-ab17-47463f5bcc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:03.155737 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e7de0-f7b5-410e-ab17-47463f5bcc4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:03.156597 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e7de0-f7b5-410e-ab17-47463f5bcc4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:03.160731 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e7de0-f7b5-410e-ab17-47463f5bcc4d admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:03.210935 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1109/2245] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:19:03 2022] POST /identity/v3/projects => generated 383 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:03.215080 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b587d2c-18a1-4516-b40f-51f6f4ff0066 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:03.234378 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b587d2c-18a1-4516-b40f-51f6f4ff0066 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:03.394985 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062eaca-a397-4152-b2ee-1bf3a19776a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:03.395969 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062eaca-a397-4152-b2ee-1bf3a19776a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:03.396979 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062eaca-a397-4152-b2ee-1bf3a19776a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:03.397411 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062eaca-a397-4152-b2ee-1bf3a19776a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:03.398303 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b062eaca-a397-4152-b2ee-1bf3a19776a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:03.408420 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b062eaca-a397-4152-b2ee-1bf3a19776a5 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:03.447535 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1137/2246] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:19:03 2022] POST /identity/v3/users => generated 298 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:03.450162 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e7de0-f7b5-410e-ab17-47463f5bcc4d admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:03.462279 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e7de0-f7b5-410e-ab17-47463f5bcc4d admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:03.467821 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce011da5-8da4-4123-b9c8-40508b64908e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:03.468771 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce011da5-8da4-4123-b9c8-40508b64908e admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:03.469148 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce011da5-8da4-4123-b9c8-40508b64908e admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:03.469519 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce011da5-8da4-4123-b9c8-40508b64908e admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:03.471317 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce011da5-8da4-4123-b9c8-40508b64908e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:03.472346 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce011da5-8da4-4123-b9c8-40508b64908e admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:03.487433 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1110/2247] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:03.511550 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062eaca-a397-4152-b2ee-1bf3a19776a5 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:03.521746 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:03.529348 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062eaca-a397-4152-b2ee-1bf3a19776a5 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:03.535977 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142b660-bfc9-4370-8f87-e651a548db1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:03.536695 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142b660-bfc9-4370-8f87-e651a548db1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:03.536981 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142b660-bfc9-4370-8f87-e651a548db1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:03.537255 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142b660-bfc9-4370-8f87-e651a548db1e admin admin] PATH_INFO: `/v3/projects/65778fb47bce4a8c90130d0a451d9f13/users/6dafc058186b461281a98e3d0ecc953c/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:03.557206 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b142b660-bfc9-4370-8f87-e651a548db1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=65778fb47bce4a8c90130d0a451d9f13, user_id=6dafc058186b461281a98e3d0ecc953c, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:03.561015 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b142b660-bfc9-4370-8f87-e651a548db1e admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:03.597509 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1138/2248] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:19:03 2022] PUT /identity/v3/projects/65778fb47bce4a8c90130d0a451d9f13/users/6dafc058186b461281a98e3d0ecc953c/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:03.601813 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce011da5-8da4-4123-b9c8-40508b64908e admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:03.617201 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce011da5-8da4-4123-b9c8-40508b64908e admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:03.772107 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b42017-8917-4363-9624-12f703ef315c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:03.773399 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b42017-8917-4363-9624-12f703ef315c admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:03.774073 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b42017-8917-4363-9624-12f703ef315c admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:03.774770 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b42017-8917-4363-9624-12f703ef315c admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:03.776607 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b42017-8917-4363-9624-12f703ef315c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:03.779108 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b42017-8917-4363-9624-12f703ef315c admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:03.816762 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1111/2249] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:03.821902 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142b660-bfc9-4370-8f87-e651a548db1e admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:03.841695 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142b660-bfc9-4370-8f87-e651a548db1e admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:03.852094 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212ec66-1cef-49b0-a5fe-6c3dddf4efb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:03.854179 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212ec66-1cef-49b0-a5fe-6c3dddf4efb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:03.854799 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212ec66-1cef-49b0-a5fe-6c3dddf4efb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:03.855395 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212ec66-1cef-49b0-a5fe-6c3dddf4efb2 admin admin] PATH_INFO: `/v3/projects/65778fb47bce4a8c90130d0a451d9f13/users/6dafc058186b461281a98e3d0ecc953c/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:03.858310 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d212ec66-1cef-49b0-a5fe-6c3dddf4efb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65778fb47bce4a8c90130d0a451d9f13, user_id=6dafc058186b461281a98e3d0ecc953c, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:03.862419 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d212ec66-1cef-49b0-a5fe-6c3dddf4efb2 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:03.878618 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1139/2250] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:19:03 2022] PUT /identity/v3/projects/65778fb47bce4a8c90130d0a451d9f13/users/6dafc058186b461281a98e3d0ecc953c/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:03.891501 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bac80-21f8-455f-8b88-7c3fd67dfcec None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:03.892073 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bac80-21f8-455f-8b88-7c3fd67dfcec None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:03.892073 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bac80-21f8-455f-8b88-7c3fd67dfcec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:03.935102 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-4b6bac80-21f8-455f-8b88-7c3fd67dfcec None None] MFA Rules not processed for user `6dafc058186b461281a98e3d0ecc953c`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:03.937109 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-4b6bac80-21f8-455f-8b88-7c3fd67dfcec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:04.071806 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1112/2251] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:19:03 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:04.157088 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212ec66-1cef-49b0-a5fe-6c3dddf4efb2 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:04.158906 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-d212ec66-1cef-49b0-a5fe-6c3dddf4efb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:04.271747 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212ec66-1cef-49b0-a5fe-6c3dddf4efb2 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:04.286113 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b174a-2776-4b60-b957-c451b0aec1ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:04.292523 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b174a-2776-4b60-b957-c451b0aec1ff service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:04.293186 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b174a-2776-4b60-b957-c451b0aec1ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:04.294310 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b174a-2776-4b60-b957-c451b0aec1ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:04.329876 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b174a-2776-4b60-b957-c451b0aec1ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:04.332918 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b174a-2776-4b60-b957-c451b0aec1ff service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:04.374899 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1140/2252] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:04 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:04.402049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6bac80-21f8-455f-8b88-7c3fd67dfcec None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:04.403514 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-4b6bac80-21f8-455f-8b88-7c3fd67dfcec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:04.482895 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:04.577547 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6bac80-21f8-455f-8b88-7c3fd67dfcec None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:04.585082 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5a797-9ba7-48c2-a359-97552827a43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:04.586185 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5a797-9ba7-48c2-a359-97552827a43d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:04.586592 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5a797-9ba7-48c2-a359-97552827a43d admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:04.586963 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5a797-9ba7-48c2-a359-97552827a43d admin admin] PATH_INFO: `/v3/users/dcd13218fbca4d4d95ca344beb881586` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:04.589346 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5a797-9ba7-48c2-a359-97552827a43d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcd13218fbca4d4d95ca344beb881586)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:04.593480 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5a797-9ba7-48c2-a359-97552827a43d admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:04.710970 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-44c5a797-9ba7-48c2-a359-97552827a43d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcd13218fbca4d4d95ca344beb881586'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:04.712306 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-44c5a797-9ba7-48c2-a359-97552827a43d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcd13218fbca4d4d95ca344beb881586'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:04.736640 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-44c5a797-9ba7-48c2-a359-97552827a43d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcd13218fbca4d4d95ca344beb881586'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:04.751161 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-44c5a797-9ba7-48c2-a359-97552827a43d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcd13218fbca4d4d95ca344beb881586'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:04.752238 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-44c5a797-9ba7-48c2-a359-97552827a43d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcd13218fbca4d4d95ca344beb881586'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:04.786918 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1113/2253] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:19:04 2022] DELETE /identity/v3/users/dcd13218fbca4d4d95ca344beb881586 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:04.788182 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e9244-1cef-4efb-a8e3-73fe33cd6ed7 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:04.788656 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e9244-1cef-4efb-a8e3-73fe33cd6ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:04.788998 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e9244-1cef-4efb-a8e3-73fe33cd6ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:04.812065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-e83e9244-1cef-4efb-a8e3-73fe33cd6ed7 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:04.813530 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-e83e9244-1cef-4efb-a8e3-73fe33cd6ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:04.886021 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1141/2254] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:19:04.943094 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5a797-9ba7-48c2-a359-97552827a43d admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:04.944575 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-44c5a797-9ba7-48c2-a359-97552827a43d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:05.056019 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5a797-9ba7-48c2-a359-97552827a43d admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:05.061537 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337041c1-ff03-40fc-8a54-1876f9303805 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:05.062634 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337041c1-ff03-40fc-8a54-1876f9303805 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:05.063318 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337041c1-ff03-40fc-8a54-1876f9303805 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:05.063884 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337041c1-ff03-40fc-8a54-1876f9303805 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:05.080390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337041c1-ff03-40fc-8a54-1876f9303805 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:05.082867 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337041c1-ff03-40fc-8a54-1876f9303805 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:05.097343 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1114/2255] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:06.484798 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e9244-1cef-4efb-a8e3-73fe33cd6ed7 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:06.486772 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-e83e9244-1cef-4efb-a8e3-73fe33cd6ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:06.505984 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e9244-1cef-4efb-a8e3-73fe33cd6ed7 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:06.527816 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9831290-bdb7-444d-ab77-136bc316f20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:06.532780 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9831290-bdb7-444d-ab77-136bc316f20f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:06.536453 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9831290-bdb7-444d-ab77-136bc316f20f admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:06.536805 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9831290-bdb7-444d-ab77-136bc316f20f admin admin] PATH_INFO: `/v3/projects/bcc439f89c18437497a414aeaa1a059b` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:06.545545 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9831290-bdb7-444d-ab77-136bc316f20f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcc439f89c18437497a414aeaa1a059b)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:06.549962 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9831290-bdb7-444d-ab77-136bc316f20f admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:06.689339 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-a9831290-bdb7-444d-ab77-136bc316f20f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcc439f89c18437497a414aeaa1a059b', 'request_id': 'req-a9831290-bdb7-444d-ab77-136bc316f20f'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:06.704035 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-a9831290-bdb7-444d-ab77-136bc316f20f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcc439f89c18437497a414aeaa1a059b', 'request_id': 'req-a9831290-bdb7-444d-ab77-136bc316f20f'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:06.717309 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-a9831290-bdb7-444d-ab77-136bc316f20f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcc439f89c18437497a414aeaa1a059b', 'request_id': 'req-a9831290-bdb7-444d-ab77-136bc316f20f'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:06.725327 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:06.746656 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-a9831290-bdb7-444d-ab77-136bc316f20f admin admin] The token cache is being invalidate because project bcc439f89c18437497a414aeaa1a059b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:19:06.747102 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-a9831290-bdb7-444d-ab77-136bc316f20f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:06.751167 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-a9831290-bdb7-444d-ab77-136bc316f20f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:06.753305 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1142/2256] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:19:06 2022] DELETE /identity/v3/projects/bcc439f89c18437497a414aeaa1a059b => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:06.758271 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e071d-dfc5-4a82-8278-5168d881ced0 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:06.758831 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e071d-dfc5-4a82-8278-5168d881ced0 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:06.758987 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e071d-dfc5-4a82-8278-5168d881ced0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:06.815423 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-668e071d-dfc5-4a82-8278-5168d881ced0 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:06.818163 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-668e071d-dfc5-4a82-8278-5168d881ced0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:06.905185 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:06.965130 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b7abc-018a-4019-a188-beb54ad243e7 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:06.965767 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b7abc-018a-4019-a188-beb54ad243e7 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:06.966099 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b7abc-018a-4019-a188-beb54ad243e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:06.966383 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1115/2257] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:19:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:07.023313 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-cf4b7abc-018a-4019-a188-beb54ad243e7 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:07.026996 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-cf4b7abc-018a-4019-a188-beb54ad243e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:07.062837 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e071d-dfc5-4a82-8278-5168d881ced0 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:07.079226 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1143/2258] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:19:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:07.082989 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e071d-dfc5-4a82-8278-5168d881ced0 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:07.089937 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf4e58-1e42-4bbe-889a-bbb17e74e886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:07.090742 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf4e58-1e42-4bbe-889a-bbb17e74e886 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:07.091086 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf4e58-1e42-4bbe-889a-bbb17e74e886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:07.091424 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf4e58-1e42-4bbe-889a-bbb17e74e886 admin admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:07.092281 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf4e58-1e42-4bbe-889a-bbb17e74e886 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:19:07.092655 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf4e58-1e42-4bbe-889a-bbb17e74e886 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:07.095768 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf4e58-1e42-4bbe-889a-bbb17e74e886 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:07.124079 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1116/2259] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:19:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:19:07.127705 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b7abc-018a-4019-a188-beb54ad243e7 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:07.142748 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b7abc-018a-4019-a188-beb54ad243e7 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:07.152396 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c02927-fd92-417b-a466-357504ea6a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:07.153059 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c02927-fd92-417b-a466-357504ea6a9f admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:07.153388 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c02927-fd92-417b-a466-357504ea6a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:07.153662 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c02927-fd92-417b-a466-357504ea6a9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:07.154390 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c02927-fd92-417b-a466-357504ea6a9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:07.156518 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c02927-fd92-417b-a466-357504ea6a9f admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:07.211374 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1144/2260] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:19:07 2022] POST /identity/v3/projects => generated 357 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:07.215002 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf4e58-1e42-4bbe-889a-bbb17e74e886 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:07.230250 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf4e58-1e42-4bbe-889a-bbb17e74e886 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:07.464905 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a3916-2f4e-467f-be14-4445db430680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:07.465558 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a3916-2f4e-467f-be14-4445db430680 admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:07.465833 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a3916-2f4e-467f-be14-4445db430680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:07.466106 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a3916-2f4e-467f-be14-4445db430680 admin admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:07.467675 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240a3916-2f4e-467f-be14-4445db430680 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:07.471658 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240a3916-2f4e-467f-be14-4445db430680 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:07.530161 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1117/2261] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:19:07 2022] POST /identity/v3/users => generated 279 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:07.532224 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c02927-fd92-417b-a466-357504ea6a9f admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:07.546688 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c02927-fd92-417b-a466-357504ea6a9f admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:07.555368 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4da47-d3d0-44c4-9dfd-b8385cbbbb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:07.555368 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4da47-d3d0-44c4-9dfd-b8385cbbbb11 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:07.556239 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4da47-d3d0-44c4-9dfd-b8385cbbbb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:07.556510 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4da47-d3d0-44c4-9dfd-b8385cbbbb11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:07.557925 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f4da47-d3d0-44c4-9dfd-b8385cbbbb11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:07.559659 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f4da47-d3d0-44c4-9dfd-b8385cbbbb11 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:07.583356 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a3916-2f4e-467f-be14-4445db430680 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:07.594926 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1145/2262] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:07.597928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a3916-2f4e-467f-be14-4445db430680 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:07.605993 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f25d58-b2a5-4c22-8244-978fb2828630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:07.606842 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f25d58-b2a5-4c22-8244-978fb2828630 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:07.607168 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f25d58-b2a5-4c22-8244-978fb2828630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:07.608049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f25d58-b2a5-4c22-8244-978fb2828630 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:07.608792 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f25d58-b2a5-4c22-8244-978fb2828630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:07.610764 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f25d58-b2a5-4c22-8244-978fb2828630 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:07.642359 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4da47-d3d0-44c4-9dfd-b8385cbbbb11 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:07.656230 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1118/2263] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:07.656500 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4da47-d3d0-44c4-9dfd-b8385cbbbb11 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:07.698329 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82ce7c-39e3-427b-b606-d057f63f6af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:07.699115 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82ce7c-39e3-427b-b606-d057f63f6af0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:07.699348 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82ce7c-39e3-427b-b606-d057f63f6af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:07.700497 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82ce7c-39e3-427b-b606-d057f63f6af0 admin admin] PATH_INFO: `/v3/projects/7c56d4d22dcf49d8b06559130d34fb74/users/9145a949bd714c3cb03f23d7bdfe534b/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:07.724716 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a82ce7c-39e3-427b-b606-d057f63f6af0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c56d4d22dcf49d8b06559130d34fb74, user_id=9145a949bd714c3cb03f23d7bdfe534b, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:07.727999 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a82ce7c-39e3-427b-b606-d057f63f6af0 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:07.778034 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1146/2264] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:19:07 2022] PUT /identity/v3/projects/7c56d4d22dcf49d8b06559130d34fb74/users/9145a949bd714c3cb03f23d7bdfe534b/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:07.790832 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4d967-3f47-443b-8bfb-d691de910aad None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:07.791880 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4d967-3f47-443b-8bfb-d691de910aad None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:07.793668 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4d967-3f47-443b-8bfb-d691de910aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:07.863477 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-f9e4d967-3f47-443b-8bfb-d691de910aad None None] MFA Rules not processed for user `9145a949bd714c3cb03f23d7bdfe534b`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:07.865882 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-f9e4d967-3f47-443b-8bfb-d691de910aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:08.064917 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1119/2265] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:19:07 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:08.110821 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82ce7c-39e3-427b-b606-d057f63f6af0 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:08.112895 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-9a82ce7c-39e3-427b-b606-d057f63f6af0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:08.217769 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82ce7c-39e3-427b-b606-d057f63f6af0 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:08.222525 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449919b4-5656-42e2-86fc-4f1cbd3ac82d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:08.223478 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449919b4-5656-42e2-86fc-4f1cbd3ac82d service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:08.224654 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449919b4-5656-42e2-86fc-4f1cbd3ac82d service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:08.225947 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449919b4-5656-42e2-86fc-4f1cbd3ac82d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:08.251276 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449919b4-5656-42e2-86fc-4f1cbd3ac82d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:08.259645 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449919b4-5656-42e2-86fc-4f1cbd3ac82d service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:08.275346 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1147/2266] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:08 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:12.213370 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e4d967-3f47-443b-8bfb-d691de910aad None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:12.218503 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-f9e4d967-3f47-443b-8bfb-d691de910aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:12.302566 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:12.337097 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e4d967-3f47-443b-8bfb-d691de910aad None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:12.346189 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d0573-271d-4b2c-91a9-8dde18a0a7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:12.347677 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d0573-271d-4b2c-91a9-8dde18a0a7bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:12.348058 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d0573-271d-4b2c-91a9-8dde18a0a7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:12.348430 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d0573-271d-4b2c-91a9-8dde18a0a7bb admin admin] PATH_INFO: `/v3/users/70ec25efe7004b0fa4a841616fad6d78` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:12.349947 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d0573-271d-4b2c-91a9-8dde18a0a7bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=70ec25efe7004b0fa4a841616fad6d78)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:12.353422 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d0573-271d-4b2c-91a9-8dde18a0a7bb admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:12.467318 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-497d0573-271d-4b2c-91a9-8dde18a0a7bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70ec25efe7004b0fa4a841616fad6d78'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:12.469333 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-497d0573-271d-4b2c-91a9-8dde18a0a7bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70ec25efe7004b0fa4a841616fad6d78'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:12.488235 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-497d0573-271d-4b2c-91a9-8dde18a0a7bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70ec25efe7004b0fa4a841616fad6d78'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:12.504767 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-497d0573-271d-4b2c-91a9-8dde18a0a7bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70ec25efe7004b0fa4a841616fad6d78'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:12.505754 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-497d0573-271d-4b2c-91a9-8dde18a0a7bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70ec25efe7004b0fa4a841616fad6d78'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:12.532765 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1120/2267] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:19:12 2022] DELETE /identity/v3/users/70ec25efe7004b0fa4a841616fad6d78 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:12.535245 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3252e3-b5b6-48bc-9c1e-842d3b6c77ab None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:12.535765 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3252e3-b5b6-48bc-9c1e-842d3b6c77ab None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:12.535877 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3252e3-b5b6-48bc-9c1e-842d3b6c77ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:12.572111 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-2c3252e3-b5b6-48bc-9c1e-842d3b6c77ab None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:12.573597 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-2c3252e3-b5b6-48bc-9c1e-842d3b6c77ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:12.648069 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1148/2268] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:19:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:12.687802 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d0573-271d-4b2c-91a9-8dde18a0a7bb admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:12.687802 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-497d0573-271d-4b2c-91a9-8dde18a0a7bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:12.755503 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d0573-271d-4b2c-91a9-8dde18a0a7bb admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:12.759645 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca147d-bd12-469e-b8de-20db3bd300bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:12.760411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca147d-bd12-469e-b8de-20db3bd300bb service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:12.760784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca147d-bd12-469e-b8de-20db3bd300bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:12.761159 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca147d-bd12-469e-b8de-20db3bd300bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:12.771954 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca147d-bd12-469e-b8de-20db3bd300bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:12.774159 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca147d-bd12-469e-b8de-20db3bd300bb service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:12.788725 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1121/2269] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:13.262552 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3252e3-b5b6-48bc-9c1e-842d3b6c77ab None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:13.264172 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-2c3252e3-b5b6-48bc-9c1e-842d3b6c77ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:13.290640 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3252e3-b5b6-48bc-9c1e-842d3b6c77ab None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:13.304512 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a875980-9a5e-41f0-9124-ea7830f4c815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:13.305219 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a875980-9a5e-41f0-9124-ea7830f4c815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:13.305493 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a875980-9a5e-41f0-9124-ea7830f4c815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:13.306078 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a875980-9a5e-41f0-9124-ea7830f4c815 admin admin] PATH_INFO: `/v3/users/7d2c02fcf92d481b8db3e4ee9ed475ed` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:13.307593 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a875980-9a5e-41f0-9124-ea7830f4c815 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d2c02fcf92d481b8db3e4ee9ed475ed)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:13.309550 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a875980-9a5e-41f0-9124-ea7830f4c815 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:13.358594 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:13.403982 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-1a875980-9a5e-41f0-9124-ea7830f4c815 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d2c02fcf92d481b8db3e4ee9ed475ed'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:13.424236 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-1a875980-9a5e-41f0-9124-ea7830f4c815 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d2c02fcf92d481b8db3e4ee9ed475ed'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:13.427363 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-1a875980-9a5e-41f0-9124-ea7830f4c815 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d2c02fcf92d481b8db3e4ee9ed475ed'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:13.457190 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-1a875980-9a5e-41f0-9124-ea7830f4c815 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d2c02fcf92d481b8db3e4ee9ed475ed'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:13.461768 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-1a875980-9a5e-41f0-9124-ea7830f4c815 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d2c02fcf92d481b8db3e4ee9ed475ed'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:13.489986 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1149/2270] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:19:13 2022] DELETE /identity/v3/users/7d2c02fcf92d481b8db3e4ee9ed475ed => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:13.493005 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c8b91-a638-4c42-be20-63e24283fd4f None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:13.493526 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c8b91-a638-4c42-be20-63e24283fd4f None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:13.493611 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c8b91-a638-4c42-be20-63e24283fd4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:13.523381 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-875c8b91-a638-4c42-be20-63e24283fd4f None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:13.525681 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-875c8b91-a638-4c42-be20-63e24283fd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:13.605078 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1122/2271] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:13.624250 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a875980-9a5e-41f0-9124-ea7830f4c815 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:13.626495 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-1a875980-9a5e-41f0-9124-ea7830f4c815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:13.701104 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a875980-9a5e-41f0-9124-ea7830f4c815 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:13.707517 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430d613-526a-4806-ad1b-14ec1471ff22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:13.708547 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430d613-526a-4806-ad1b-14ec1471ff22 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:13.709053 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430d613-526a-4806-ad1b-14ec1471ff22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:13.709825 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430d613-526a-4806-ad1b-14ec1471ff22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:13.721045 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e430d613-526a-4806-ad1b-14ec1471ff22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:13.723254 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e430d613-526a-4806-ad1b-14ec1471ff22 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:13.737691 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1150/2272] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:14.927129 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c8b91-a638-4c42-be20-63e24283fd4f None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:14.929753 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-875c8b91-a638-4c42-be20-63e24283fd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:14.940652 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:14.950343 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430d613-526a-4806-ad1b-14ec1471ff22 service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:14.954557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-e430d613-526a-4806-ad1b-14ec1471ff22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:14.975719 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c8b91-a638-4c42-be20-63e24283fd4f None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:14.983897 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430d613-526a-4806-ad1b-14ec1471ff22 service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:15.000412 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc3f72-7fc1-4607-9976-f9642aab7d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:15.001116 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc3f72-7fc1-4607-9976-f9642aab7d70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:15.001403 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc3f72-7fc1-4607-9976-f9642aab7d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:15.001707 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc3f72-7fc1-4607-9976-f9642aab7d70 admin admin] PATH_INFO: `/v3/projects/5d78c29c7a8945d1950329729f6c778b` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:15.007805 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfc3f72-7fc1-4607-9976-f9642aab7d70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d78c29c7a8945d1950329729f6c778b)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:15.009687 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfc3f72-7fc1-4607-9976-f9642aab7d70 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:15.018146 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fd63f-fd84-4c2e-bc76-688080b7659d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:15.018922 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fd63f-fd84-4c2e-bc76-688080b7659d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:15.019229 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fd63f-fd84-4c2e-bc76-688080b7659d admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:15.019584 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fd63f-fd84-4c2e-bc76-688080b7659d admin admin] PATH_INFO: `/v3/projects/0d2143b16ec24dfb8a3aec58b4dee90a` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:15.023353 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3fd63f-fd84-4c2e-bc76-688080b7659d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d2143b16ec24dfb8a3aec58b4dee90a)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:15.041452 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3fd63f-fd84-4c2e-bc76-688080b7659d admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:15.148578 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-7f3fd63f-fd84-4c2e-bc76-688080b7659d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d2143b16ec24dfb8a3aec58b4dee90a', 'request_id': 'req-7f3fd63f-fd84-4c2e-bc76-688080b7659d'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:15.163291 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-0bfc3f72-7fc1-4607-9976-f9642aab7d70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d78c29c7a8945d1950329729f6c778b', 'request_id': 'req-0bfc3f72-7fc1-4607-9976-f9642aab7d70'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:15.164251 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-7f3fd63f-fd84-4c2e-bc76-688080b7659d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d2143b16ec24dfb8a3aec58b4dee90a', 'request_id': 'req-7f3fd63f-fd84-4c2e-bc76-688080b7659d'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:15.178853 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-0bfc3f72-7fc1-4607-9976-f9642aab7d70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d78c29c7a8945d1950329729f6c778b', 'request_id': 'req-0bfc3f72-7fc1-4607-9976-f9642aab7d70'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:15.181919 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-7f3fd63f-fd84-4c2e-bc76-688080b7659d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d2143b16ec24dfb8a3aec58b4dee90a', 'request_id': 'req-7f3fd63f-fd84-4c2e-bc76-688080b7659d'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:15.193173 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-0bfc3f72-7fc1-4607-9976-f9642aab7d70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d78c29c7a8945d1950329729f6c778b', 'request_id': 'req-0bfc3f72-7fc1-4607-9976-f9642aab7d70'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:15.208829 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-7f3fd63f-fd84-4c2e-bc76-688080b7659d admin admin] The token cache is being invalidate because project 0d2143b16ec24dfb8a3aec58b4dee90a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:19:15.209148 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-7f3fd63f-fd84-4c2e-bc76-688080b7659d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:15.214112 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-7f3fd63f-fd84-4c2e-bc76-688080b7659d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:15.223646 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1151/2273] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:19:14 2022] DELETE /identity/v3/projects/0d2143b16ec24dfb8a3aec58b4dee90a => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:15.228900 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5adab7-1084-4abe-9c61-cbc876e187c7 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:15.231358 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5adab7-1084-4abe-9c61-cbc876e187c7 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:15.231998 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5adab7-1084-4abe-9c61-cbc876e187c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:15.237132 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-0bfc3f72-7fc1-4607-9976-f9642aab7d70 admin admin] The token cache is being invalidate because project 5d78c29c7a8945d1950329729f6c778b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:19:15.237409 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-0bfc3f72-7fc1-4607-9976-f9642aab7d70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:15.238436 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-0bfc3f72-7fc1-4607-9976-f9642aab7d70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:15.240570 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1123/2274] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:19:14 2022] DELETE /identity/v3/projects/5d78c29c7a8945d1950329729f6c778b => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:15.246607 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc3f72-7fc1-4607-9976-f9642aab7d70 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:15.249902 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-0bfc3f72-7fc1-4607-9976-f9642aab7d70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:15.283454 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-1a5adab7-1084-4abe-9c61-cbc876e187c7 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:15.285940 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-1a5adab7-1084-4abe-9c61-cbc876e187c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:15.367749 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:15.430386 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc3f72-7fc1-4607-9976-f9642aab7d70 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:15.442446 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49998b-6d03-4479-ab90-95b16de53b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:15.443133 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49998b-6d03-4479-ab90-95b16de53b06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:15.443822 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49998b-6d03-4479-ab90-95b16de53b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:15.444258 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49998b-6d03-4479-ab90-95b16de53b06 admin admin] PATH_INFO: `/v3/users/6dafc058186b461281a98e3d0ecc953c` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:15.447839 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee49998b-6d03-4479-ab90-95b16de53b06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dafc058186b461281a98e3d0ecc953c)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:15.456090 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee49998b-6d03-4479-ab90-95b16de53b06 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:15.473851 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1152/2275] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:19:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:15.485798 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e856d-46cb-41f0-b79d-d77178c248ce None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:15.485798 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e856d-46cb-41f0-b79d-d77178c248ce None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:15.492732 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e856d-46cb-41f0-b79d-d77178c248ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:15.538065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-bf7e856d-46cb-41f0-b79d-d77178c248ce None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:15.539956 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-bf7e856d-46cb-41f0-b79d-d77178c248ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:15.556701 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1153/2276] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:19:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:15.561792 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e856d-46cb-41f0-b79d-d77178c248ce None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:15.581344 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e856d-46cb-41f0-b79d-d77178c248ce None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:15.584112 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-ee49998b-6d03-4479-ab90-95b16de53b06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dafc058186b461281a98e3d0ecc953c'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:15.584897 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-ee49998b-6d03-4479-ab90-95b16de53b06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dafc058186b461281a98e3d0ecc953c'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:15.591353 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce73719-04ab-452c-83e6-ebddbd2e4b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:15.592770 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce73719-04ab-452c-83e6-ebddbd2e4b4c admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:15.592770 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce73719-04ab-452c-83e6-ebddbd2e4b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:15.594271 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce73719-04ab-452c-83e6-ebddbd2e4b4c admin admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:15.596277 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce73719-04ab-452c-83e6-ebddbd2e4b4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:19:15.597826 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce73719-04ab-452c-83e6-ebddbd2e4b4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:15.600118 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce73719-04ab-452c-83e6-ebddbd2e4b4c admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:15.614750 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-ee49998b-6d03-4479-ab90-95b16de53b06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dafc058186b461281a98e3d0ecc953c'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:15.635842 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1154/2277] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:19:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:19:15.637986 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce73719-04ab-452c-83e6-ebddbd2e4b4c admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:15.652488 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-ee49998b-6d03-4479-ab90-95b16de53b06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dafc058186b461281a98e3d0ecc953c'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:15.653833 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-ee49998b-6d03-4479-ab90-95b16de53b06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dafc058186b461281a98e3d0ecc953c'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:15.662734 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce73719-04ab-452c-83e6-ebddbd2e4b4c admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:15.677361 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1124/2278] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:19:15 2022] DELETE /identity/v3/users/6dafc058186b461281a98e3d0ecc953c => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:15.684178 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c14f52-4560-497b-87b2-81cb5c152d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:15.687105 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c14f52-4560-497b-87b2-81cb5c152d6a admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:15.689069 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c14f52-4560-497b-87b2-81cb5c152d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:15.689599 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c14f52-4560-497b-87b2-81cb5c152d6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:15.692276 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c14f52-4560-497b-87b2-81cb5c152d6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:15.694538 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c14f52-4560-497b-87b2-81cb5c152d6a admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:15.748159 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1155/2279] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:19:15 2022] POST /identity/v3/projects => generated 387 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:15.749217 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49998b-6d03-4479-ab90-95b16de53b06 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:15.750837 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-ee49998b-6d03-4479-ab90-95b16de53b06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:15.761194 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:15.843591 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49998b-6d03-4479-ab90-95b16de53b06 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:15.923644 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90765a64-1209-4626-9861-7849a45e6be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:15.924625 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90765a64-1209-4626-9861-7849a45e6be7 admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:15.925091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90765a64-1209-4626-9861-7849a45e6be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:15.925576 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90765a64-1209-4626-9861-7849a45e6be7 admin admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:15.926469 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90765a64-1209-4626-9861-7849a45e6be7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:15.928744 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90765a64-1209-4626-9861-7849a45e6be7 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:15.969337 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1125/2280] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:19:15 2022] POST /identity/v3/users => generated 294 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:19:15.974508 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c14f52-4560-497b-87b2-81cb5c152d6a admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:15.988572 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c14f52-4560-497b-87b2-81cb5c152d6a admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:16.005902 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9b150-8f94-47cc-8563-5fe3a5bd9d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:16.006839 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9b150-8f94-47cc-8563-5fe3a5bd9d13 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:16.008280 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9b150-8f94-47cc-8563-5fe3a5bd9d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:16.008794 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9b150-8f94-47cc-8563-5fe3a5bd9d13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:16.011443 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d9b150-8f94-47cc-8563-5fe3a5bd9d13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:16.013829 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d9b150-8f94-47cc-8563-5fe3a5bd9d13 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:16.038392 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90765a64-1209-4626-9861-7849a45e6be7 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:16.055347 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1156/2281] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:16.059168 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90765a64-1209-4626-9861-7849a45e6be7 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:16.068819 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0f824-d5ed-4325-ac25-4a9e26ef2e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:16.070664 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0f824-d5ed-4325-ac25-4a9e26ef2e73 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:16.071147 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0f824-d5ed-4325-ac25-4a9e26ef2e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:16.072348 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0f824-d5ed-4325-ac25-4a9e26ef2e73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:16.073729 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f0f824-d5ed-4325-ac25-4a9e26ef2e73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:16.075983 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f0f824-d5ed-4325-ac25-4a9e26ef2e73 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:16.107099 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9b150-8f94-47cc-8563-5fe3a5bd9d13 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:16.118805 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1126/2282] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:16.122745 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9b150-8f94-47cc-8563-5fe3a5bd9d13 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:16.129694 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f878f346-01e2-4b72-b359-005ce5394eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:16.134735 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878f346-01e2-4b72-b359-005ce5394eaa admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:16.135382 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878f346-01e2-4b72-b359-005ce5394eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:16.135909 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878f346-01e2-4b72-b359-005ce5394eaa admin admin] PATH_INFO: `/v3/projects/a3c0a12776694fe0bcde898fbf2f2e3f/users/79ca513d30cc4bbf8ec30d0bc1c1b0a5/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:16.165344 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f878f346-01e2-4b72-b359-005ce5394eaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3c0a12776694fe0bcde898fbf2f2e3f, user_id=79ca513d30cc4bbf8ec30d0bc1c1b0a5, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:16.169236 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f878f346-01e2-4b72-b359-005ce5394eaa admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:16.204124 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1157/2283] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:19:16 2022] PUT /identity/v3/projects/a3c0a12776694fe0bcde898fbf2f2e3f/users/79ca513d30cc4bbf8ec30d0bc1c1b0a5/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:19:16.204785 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60b7a3-5a86-4ebf-b932-920c187dec82 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:16.205075 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60b7a3-5a86-4ebf-b932-920c187dec82 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:16.205345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60b7a3-5a86-4ebf-b932-920c187dec82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:16.272551 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-3e60b7a3-5a86-4ebf-b932-920c187dec82 None None] MFA Rules not processed for user `79ca513d30cc4bbf8ec30d0bc1c1b0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:16.273974 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-3e60b7a3-5a86-4ebf-b932-920c187dec82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:16.464418 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1127/2284] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:19:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:16.503267 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f878f346-01e2-4b72-b359-005ce5394eaa admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:16.506270 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-f878f346-01e2-4b72-b359-005ce5394eaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:16.679934 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f878f346-01e2-4b72-b359-005ce5394eaa admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:16.692472 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850c6b0-1823-4e08-a7b7-81294b6cddb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:16.693252 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850c6b0-1823-4e08-a7b7-81294b6cddb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:16.693595 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850c6b0-1823-4e08-a7b7-81294b6cddb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:16.693918 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850c6b0-1823-4e08-a7b7-81294b6cddb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:16.733464 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e850c6b0-1823-4e08-a7b7-81294b6cddb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:16.735060 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e850c6b0-1823-4e08-a7b7-81294b6cddb7 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:16.747949 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1158/2285] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:17.167175 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e60b7a3-5a86-4ebf-b932-920c187dec82 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:17.169246 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-3e60b7a3-5a86-4ebf-b932-920c187dec82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:17.210828 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:17.282333 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e60b7a3-5a86-4ebf-b932-920c187dec82 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:17.289724 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9141d-f986-4b65-91c9-7e1c8c6401a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:17.290533 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9141d-f986-4b65-91c9-7e1c8c6401a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:17.290818 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9141d-f986-4b65-91c9-7e1c8c6401a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:17.291144 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9141d-f986-4b65-91c9-7e1c8c6401a2 admin admin] PATH_INFO: `/v3/projects/65778fb47bce4a8c90130d0a451d9f13` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:17.292423 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb9141d-f986-4b65-91c9-7e1c8c6401a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65778fb47bce4a8c90130d0a451d9f13)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:17.294521 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb9141d-f986-4b65-91c9-7e1c8c6401a2 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:17.372870 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-efb9141d-f986-4b65-91c9-7e1c8c6401a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65778fb47bce4a8c90130d0a451d9f13', 'request_id': 'req-efb9141d-f986-4b65-91c9-7e1c8c6401a2'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:17.389419 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-efb9141d-f986-4b65-91c9-7e1c8c6401a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65778fb47bce4a8c90130d0a451d9f13', 'request_id': 'req-efb9141d-f986-4b65-91c9-7e1c8c6401a2'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:17.402301 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-efb9141d-f986-4b65-91c9-7e1c8c6401a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65778fb47bce4a8c90130d0a451d9f13', 'request_id': 'req-efb9141d-f986-4b65-91c9-7e1c8c6401a2'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:17.423818 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-efb9141d-f986-4b65-91c9-7e1c8c6401a2 admin admin] The token cache is being invalidate because project 65778fb47bce4a8c90130d0a451d9f13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:19:17.424506 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-efb9141d-f986-4b65-91c9-7e1c8c6401a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:17.425603 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-efb9141d-f986-4b65-91c9-7e1c8c6401a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:17.427840 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1128/2286] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:19:17 2022] DELETE /identity/v3/projects/65778fb47bce4a8c90130d0a451d9f13 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:17.432760 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad287f32-7d9a-417b-a515-ac6c75d5b387 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:17.434699 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad287f32-7d9a-417b-a515-ac6c75d5b387 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:17.435208 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad287f32-7d9a-417b-a515-ac6c75d5b387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:17.466664 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-ad287f32-7d9a-417b-a515-ac6c75d5b387 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:17.469305 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-ad287f32-7d9a-417b-a515-ac6c75d5b387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:17.581836 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:17.618919 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1159/2287] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:19:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:17.620817 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a342f30-1e2f-4b6d-b536-a39ad8be65a5 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:17.621292 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a342f30-1e2f-4b6d-b536-a39ad8be65a5 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:17.622172 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a342f30-1e2f-4b6d-b536-a39ad8be65a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:17.650561 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-6a342f30-1e2f-4b6d-b536-a39ad8be65a5 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:17.652926 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-6a342f30-1e2f-4b6d-b536-a39ad8be65a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:17.685790 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad287f32-7d9a-417b-a515-ac6c75d5b387 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:17.686242 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1129/2288] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:19:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:17.698683 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad287f32-7d9a-417b-a515-ac6c75d5b387 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:17.718192 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb098c18-a027-4a94-aab5-f3cc1cc90af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:17.724885 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb098c18-a027-4a94-aab5-f3cc1cc90af1 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:17.726537 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb098c18-a027-4a94-aab5-f3cc1cc90af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:17.727508 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb098c18-a027-4a94-aab5-f3cc1cc90af1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:17.728631 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb098c18-a027-4a94-aab5-f3cc1cc90af1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:19:17.729154 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb098c18-a027-4a94-aab5-f3cc1cc90af1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:17.743783 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb098c18-a027-4a94-aab5-f3cc1cc90af1 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:17.774840 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1160/2289] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:19:17.779465 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a342f30-1e2f-4b6d-b536-a39ad8be65a5 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:17.797690 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a342f30-1e2f-4b6d-b536-a39ad8be65a5 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:17.805648 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b5b60-9c5d-4124-b438-ac5953c20837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:17.806307 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b5b60-9c5d-4124-b438-ac5953c20837 admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:17.806584 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b5b60-9c5d-4124-b438-ac5953c20837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:17.806854 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b5b60-9c5d-4124-b438-ac5953c20837 admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:17.807564 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b5b60-9c5d-4124-b438-ac5953c20837 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:17.811121 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b5b60-9c5d-4124-b438-ac5953c20837 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:17.885257 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1130/2290] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:19:17 2022] POST /identity/v3/projects => generated 389 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:17.886571 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb098c18-a027-4a94-aab5-f3cc1cc90af1 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:17.911161 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb098c18-a027-4a94-aab5-f3cc1cc90af1 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:18.076143 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb665828-c9a3-4b27-bb2d-fb81f85d3fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:18.076833 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb665828-c9a3-4b27-bb2d-fb81f85d3fb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:18.077112 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb665828-c9a3-4b27-bb2d-fb81f85d3fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:18.077386 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb665828-c9a3-4b27-bb2d-fb81f85d3fb9 admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:18.078072 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb665828-c9a3-4b27-bb2d-fb81f85d3fb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:18.084531 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb665828-c9a3-4b27-bb2d-fb81f85d3fb9 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:18.137081 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1161/2291] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:19:17 2022] POST /identity/v3/users => generated 295 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:18.141477 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b5b60-9c5d-4124-b438-ac5953c20837 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:18.154122 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b5b60-9c5d-4124-b438-ac5953c20837 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:18.165932 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ffea6-9e3a-42fe-a7ef-aa40cd833d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:18.166611 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ffea6-9e3a-42fe-a7ef-aa40cd833d1a admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:18.167187 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ffea6-9e3a-42fe-a7ef-aa40cd833d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:18.167794 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ffea6-9e3a-42fe-a7ef-aa40cd833d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:18.168388 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ffea6-9e3a-42fe-a7ef-aa40cd833d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:18.174252 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ffea6-9e3a-42fe-a7ef-aa40cd833d1a admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:18.202023 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1131/2292] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:19:18.202918 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb665828-c9a3-4b27-bb2d-fb81f85d3fb9 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:18.224543 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb665828-c9a3-4b27-bb2d-fb81f85d3fb9 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:18.230672 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263281cd-1db1-4f84-9cb0-d6c8c546a66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:18.231323 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263281cd-1db1-4f84-9cb0-d6c8c546a66a admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:18.231637 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263281cd-1db1-4f84-9cb0-d6c8c546a66a admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:18.232192 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263281cd-1db1-4f84-9cb0-d6c8c546a66a admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:18.234270 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263281cd-1db1-4f84-9cb0-d6c8c546a66a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:18.236022 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263281cd-1db1-4f84-9cb0-d6c8c546a66a admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:18.270449 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ffea6-9e3a-42fe-a7ef-aa40cd833d1a admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:18.276764 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1162/2293] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:19:18.282955 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ffea6-9e3a-42fe-a7ef-aa40cd833d1a admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:18.288530 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b825f59-e775-496e-b5c9-1e4b117dc878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:18.290854 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b825f59-e775-496e-b5c9-1e4b117dc878 admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:18.291139 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b825f59-e775-496e-b5c9-1e4b117dc878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:18.291667 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b825f59-e775-496e-b5c9-1e4b117dc878 admin admin] PATH_INFO: `/v3/projects/4c93c74ca95948678c7f04168191f506/users/5a11d4191923470c9a30a6c96bd0fe06/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:18.324988 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b825f59-e775-496e-b5c9-1e4b117dc878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c93c74ca95948678c7f04168191f506, user_id=5a11d4191923470c9a30a6c96bd0fe06, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:18.327917 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b825f59-e775-496e-b5c9-1e4b117dc878 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:18.352682 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1132/2294] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:19:18 2022] PUT /identity/v3/projects/4c93c74ca95948678c7f04168191f506/users/5a11d4191923470c9a30a6c96bd0fe06/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:19:18.367900 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b76e23-852a-46db-bad6-7d4ee82f3238 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:18.367900 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b76e23-852a-46db-bad6-7d4ee82f3238 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:18.367900 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b76e23-852a-46db-bad6-7d4ee82f3238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:18.444875 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-b6b76e23-852a-46db-bad6-7d4ee82f3238 None None] MFA Rules not processed for user `5a11d4191923470c9a30a6c96bd0fe06`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:18.445920 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-b6b76e23-852a-46db-bad6-7d4ee82f3238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:18.646554 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1163/2295] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:19:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:18.685947 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b825f59-e775-496e-b5c9-1e4b117dc878 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:18.687949 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-7b825f59-e775-496e-b5c9-1e4b117dc878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:18.829844 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:18.843318 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b825f59-e775-496e-b5c9-1e4b117dc878 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:18.852544 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10730f01-bc1a-43c3-838e-f6f504ecd587 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:18.855383 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10730f01-bc1a-43c3-838e-f6f504ecd587 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:18.857712 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10730f01-bc1a-43c3-838e-f6f504ecd587 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:18.859343 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10730f01-bc1a-43c3-838e-f6f504ecd587 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:18.882397 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10730f01-bc1a-43c3-838e-f6f504ecd587 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:18.892594 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10730f01-bc1a-43c3-838e-f6f504ecd587 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:18.922304 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1133/2296] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:28.633894 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=73,keystone:INSERT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:28.906734 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=5 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:39.184170 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b76e23-852a-46db-bad6-7d4ee82f3238 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:39.185633 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-b6b76e23-852a-46db-bad6-7d4ee82f3238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:39.346060 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b76e23-852a-46db-bad6-7d4ee82f3238 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:39.363818 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553cc03-c91e-4b6e-815e-8a04c53b3879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:39.364960 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553cc03-c91e-4b6e-815e-8a04c53b3879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:39.365435 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553cc03-c91e-4b6e-815e-8a04c53b3879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:39.366706 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553cc03-c91e-4b6e-815e-8a04c53b3879 admin admin] PATH_INFO: `/v3/users/9145a949bd714c3cb03f23d7bdfe534b` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:39.369583 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9553cc03-c91e-4b6e-815e-8a04c53b3879 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9145a949bd714c3cb03f23d7bdfe534b)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:39.377317 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9553cc03-c91e-4b6e-815e-8a04c53b3879 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:39.471175 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-9553cc03-c91e-4b6e-815e-8a04c53b3879 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9145a949bd714c3cb03f23d7bdfe534b'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:39.482304 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-9553cc03-c91e-4b6e-815e-8a04c53b3879 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9145a949bd714c3cb03f23d7bdfe534b'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:39.483906 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-9553cc03-c91e-4b6e-815e-8a04c53b3879 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9145a949bd714c3cb03f23d7bdfe534b'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:39.501141 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-9553cc03-c91e-4b6e-815e-8a04c53b3879 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9145a949bd714c3cb03f23d7bdfe534b'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:39.501953 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-9553cc03-c91e-4b6e-815e-8a04c53b3879 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9145a949bd714c3cb03f23d7bdfe534b'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:39.534506 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1164/2297] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:19:39 2022] DELETE /identity/v3/users/9145a949bd714c3cb03f23d7bdfe534b => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:39.538479 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321db5de-a33a-4ab2-b062-80e16a07e16d None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:39.540450 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321db5de-a33a-4ab2-b062-80e16a07e16d None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:39.540841 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321db5de-a33a-4ab2-b062-80e16a07e16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:39.589513 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-321db5de-a33a-4ab2-b062-80e16a07e16d None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:39.592638 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-321db5de-a33a-4ab2-b062-80e16a07e16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:39.705189 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1134/2298] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:19:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:39.736183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553cc03-c91e-4b6e-815e-8a04c53b3879 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:39.737961 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-9553cc03-c91e-4b6e-815e-8a04c53b3879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:39.903223 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553cc03-c91e-4b6e-815e-8a04c53b3879 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:39.908502 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055baad4-f48b-4904-bbf1-67bb4992b53d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:39.910115 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055baad4-f48b-4904-bbf1-67bb4992b53d service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:39.911512 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055baad4-f48b-4904-bbf1-67bb4992b53d service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:39.911943 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055baad4-f48b-4904-bbf1-67bb4992b53d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:39.926997 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055baad4-f48b-4904-bbf1-67bb4992b53d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:39.929033 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055baad4-f48b-4904-bbf1-67bb4992b53d service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:39.946580 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1165/2299] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:40.659911 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321db5de-a33a-4ab2-b062-80e16a07e16d None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:40.661426 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-321db5de-a33a-4ab2-b062-80e16a07e16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:40.679451 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321db5de-a33a-4ab2-b062-80e16a07e16d None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:40.696392 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72d67b-6539-43c8-b4f3-d5ecaed4b229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:40.697290 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72d67b-6539-43c8-b4f3-d5ecaed4b229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:40.697723 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72d67b-6539-43c8-b4f3-d5ecaed4b229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:40.698157 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72d67b-6539-43c8-b4f3-d5ecaed4b229 admin admin] PATH_INFO: `/v3/projects/7c56d4d22dcf49d8b06559130d34fb74` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:40.701126 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c72d67b-6539-43c8-b4f3-d5ecaed4b229 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c56d4d22dcf49d8b06559130d34fb74)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:40.703407 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c72d67b-6539-43c8-b4f3-d5ecaed4b229 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:40.798228 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-3c72d67b-6539-43c8-b4f3-d5ecaed4b229 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c56d4d22dcf49d8b06559130d34fb74', 'request_id': 'req-3c72d67b-6539-43c8-b4f3-d5ecaed4b229'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:40.812823 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-3c72d67b-6539-43c8-b4f3-d5ecaed4b229 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c56d4d22dcf49d8b06559130d34fb74', 'request_id': 'req-3c72d67b-6539-43c8-b4f3-d5ecaed4b229'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:40.833025 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-3c72d67b-6539-43c8-b4f3-d5ecaed4b229 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c56d4d22dcf49d8b06559130d34fb74', 'request_id': 'req-3c72d67b-6539-43c8-b4f3-d5ecaed4b229'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:40.870406 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-3c72d67b-6539-43c8-b4f3-d5ecaed4b229 admin admin] The token cache is being invalidate because project 7c56d4d22dcf49d8b06559130d34fb74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:19:40.870775 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-3c72d67b-6539-43c8-b4f3-d5ecaed4b229 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:40.871779 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-3c72d67b-6539-43c8-b4f3-d5ecaed4b229 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:40.874102 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1135/2300] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:19:40 2022] DELETE /identity/v3/projects/7c56d4d22dcf49d8b06559130d34fb74 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:19:40.880523 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a18aa4-ea26-46d8-a369-13f36e0e3923 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:40.881326 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a18aa4-ea26-46d8-a369-13f36e0e3923 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:40.881811 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a18aa4-ea26-46d8-a369-13f36e0e3923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:40.925303 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-70a18aa4-ea26-46d8-a369-13f36e0e3923 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:40.928310 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-70a18aa4-ea26-46d8-a369-13f36e0e3923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:40.969208 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:41.061494 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1166/2301] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:19:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:41.069274 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb10b9-c9f5-4105-ba28-1ffa02dfcc7c None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:41.069639 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb10b9-c9f5-4105-ba28-1ffa02dfcc7c None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:41.069923 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb10b9-c9f5-4105-ba28-1ffa02dfcc7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:41.114292 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-03bb10b9-c9f5-4105-ba28-1ffa02dfcc7c None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:41.115693 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-03bb10b9-c9f5-4105-ba28-1ffa02dfcc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:41.135687 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1136/2302] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:19:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:19:41.136953 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a18aa4-ea26-46d8-a369-13f36e0e3923 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:41.147988 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a18aa4-ea26-46d8-a369-13f36e0e3923 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:41.154448 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547c905-2c38-498c-9dbb-a09c70f24674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:41.155311 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547c905-2c38-498c-9dbb-a09c70f24674 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:41.155825 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547c905-2c38-498c-9dbb-a09c70f24674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:41.156494 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547c905-2c38-498c-9dbb-a09c70f24674 admin admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:41.163552 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a547c905-2c38-498c-9dbb-a09c70f24674 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:19:41.164121 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a547c905-2c38-498c-9dbb-a09c70f24674 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:41.166061 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a547c905-2c38-498c-9dbb-a09c70f24674 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:41.189779 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1167/2303] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:19:41.190661 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb10b9-c9f5-4105-ba28-1ffa02dfcc7c None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:41.202381 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb10b9-c9f5-4105-ba28-1ffa02dfcc7c None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:41.219079 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4e7fd-b277-45e8-ae3b-f5b50654c50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:41.219773 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4e7fd-b277-45e8-ae3b-f5b50654c50f admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:41.220053 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4e7fd-b277-45e8-ae3b-f5b50654c50f admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:41.220326 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4e7fd-b277-45e8-ae3b-f5b50654c50f admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:41.221026 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec4e7fd-b277-45e8-ae3b-f5b50654c50f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:41.222956 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec4e7fd-b277-45e8-ae3b-f5b50654c50f admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:41.291510 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547c905-2c38-498c-9dbb-a09c70f24674 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:41.293848 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1137/2304] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:19:41 2022] POST /identity/v3/projects => generated 351 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:19:41.307982 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547c905-2c38-498c-9dbb-a09c70f24674 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:41.453200 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db8471d-3fe0-4b14-8da8-75d16dc2a8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:41.454165 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8471d-3fe0-4b14-8da8-75d16dc2a8ad admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:41.454891 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8471d-3fe0-4b14-8da8-75d16dc2a8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:41.455351 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8471d-3fe0-4b14-8da8-75d16dc2a8ad admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:41.456844 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db8471d-3fe0-4b14-8da8-75d16dc2a8ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:41.459096 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db8471d-3fe0-4b14-8da8-75d16dc2a8ad admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:41.493106 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1168/2305] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:19:41 2022] POST /identity/v3/users => generated 276 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:41.495007 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4e7fd-b277-45e8-ae3b-f5b50654c50f admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:41.511075 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4e7fd-b277-45e8-ae3b-f5b50654c50f admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:41.520987 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82193a-15c2-4afb-8940-3eeb9b3b3d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:41.521951 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82193a-15c2-4afb-8940-3eeb9b3b3d42 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:41.522490 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82193a-15c2-4afb-8940-3eeb9b3b3d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:41.522940 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82193a-15c2-4afb-8940-3eeb9b3b3d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:41.523914 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82193a-15c2-4afb-8940-3eeb9b3b3d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:41.527801 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82193a-15c2-4afb-8940-3eeb9b3b3d42 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:41.553716 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db8471d-3fe0-4b14-8da8-75d16dc2a8ad admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:41.553998 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1138/2306] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:41.567375 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db8471d-3fe0-4b14-8da8-75d16dc2a8ad admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:41.579087 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa331b-828f-4c70-842f-cf137366e930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:41.580261 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa331b-828f-4c70-842f-cf137366e930 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:41.580650 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa331b-828f-4c70-842f-cf137366e930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:41.581081 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa331b-828f-4c70-842f-cf137366e930 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:41.581910 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa331b-828f-4c70-842f-cf137366e930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:41.583749 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa331b-828f-4c70-842f-cf137366e930 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:41.607929 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1169/2307] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:41.609921 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82193a-15c2-4afb-8940-3eeb9b3b3d42 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:41.627228 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82193a-15c2-4afb-8940-3eeb9b3b3d42 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:41.641991 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9fb519-cd69-414d-8697-4ec5015de587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:41.643826 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fb519-cd69-414d-8697-4ec5015de587 admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:41.644585 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fb519-cd69-414d-8697-4ec5015de587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:41.644967 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fb519-cd69-414d-8697-4ec5015de587 admin admin] PATH_INFO: `/v3/projects/4043689a42a04f0f873f5c7205443101/users/84420a3abba2431fa2559ad59ecbc71a/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:41.695168 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9fb519-cd69-414d-8697-4ec5015de587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4043689a42a04f0f873f5c7205443101, user_id=84420a3abba2431fa2559ad59ecbc71a, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:41.700177 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9fb519-cd69-414d-8697-4ec5015de587 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:41.748211 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1139/2308] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:19:41 2022] PUT /identity/v3/projects/4043689a42a04f0f873f5c7205443101/users/84420a3abba2431fa2559ad59ecbc71a/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:41.764824 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342ec3e-ff4a-41b0-b465-1f1269c3a1af None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:41.765331 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342ec3e-ff4a-41b0-b465-1f1269c3a1af None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:41.766049 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342ec3e-ff4a-41b0-b465-1f1269c3a1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:41.820287 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-5342ec3e-ff4a-41b0-b465-1f1269c3a1af None None] MFA Rules not processed for user `84420a3abba2431fa2559ad59ecbc71a`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:41.824398 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-5342ec3e-ff4a-41b0-b465-1f1269c3a1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:42.017435 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1170/2309] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:19:41 2022] POST /identity/v3/auth/tokens => generated 3218 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:19:42.047892 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9fb519-cd69-414d-8697-4ec5015de587 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:42.049684 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-3a9fb519-cd69-414d-8697-4ec5015de587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:42.094755 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:42.192363 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9fb519-cd69-414d-8697-4ec5015de587 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:42.201499 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37801f-5eed-4457-a184-415e3062432d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:42.202396 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37801f-5eed-4457-a184-415e3062432d service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:42.203113 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37801f-5eed-4457-a184-415e3062432d service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:42.203113 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37801f-5eed-4457-a184-415e3062432d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:42.220220 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c37801f-5eed-4457-a184-415e3062432d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:42.223750 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c37801f-5eed-4457-a184-415e3062432d service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:42.245090 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1140/2310] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:42 2022] GET /identity/v3/auth/tokens => generated 3218 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:43.334057 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049c8a2-4202-4d17-8920-261bd5cc0fb9 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:43.334797 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049c8a2-4202-4d17-8920-261bd5cc0fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:43.334797 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049c8a2-4202-4d17-8920-261bd5cc0fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:43.386292 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-b049c8a2-4202-4d17-8920-261bd5cc0fb9 None None] MFA Rules not processed for user `9e467b255bf54ded9815e902e99b41df`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:43.393574 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-b049c8a2-4202-4d17-8920-261bd5cc0fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:43.426934 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:43.493073 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1171/2311] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:19:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:48.511293 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37801f-5eed-4457-a184-415e3062432d service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:48.648381 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37801f-5eed-4457-a184-415e3062432d service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:48.665439 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa175390-f594-4bb3-be32-aa255c1b0230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:48.666127 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa175390-f594-4bb3-be32-aa255c1b0230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:48.666727 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa175390-f594-4bb3-be32-aa255c1b0230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:48.667202 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa175390-f594-4bb3-be32-aa255c1b0230 admin admin] PATH_INFO: `/v3/users/84420a3abba2431fa2559ad59ecbc71a` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:48.669128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa175390-f594-4bb3-be32-aa255c1b0230 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84420a3abba2431fa2559ad59ecbc71a)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:48.673249 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa175390-f594-4bb3-be32-aa255c1b0230 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:48.767027 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-aa175390-f594-4bb3-be32-aa255c1b0230 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84420a3abba2431fa2559ad59ecbc71a'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:48.768052 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-aa175390-f594-4bb3-be32-aa255c1b0230 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84420a3abba2431fa2559ad59ecbc71a'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:48.785165 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-aa175390-f594-4bb3-be32-aa255c1b0230 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84420a3abba2431fa2559ad59ecbc71a'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:48.821486 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-aa175390-f594-4bb3-be32-aa255c1b0230 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84420a3abba2431fa2559ad59ecbc71a'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:48.822332 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-aa175390-f594-4bb3-be32-aa255c1b0230 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84420a3abba2431fa2559ad59ecbc71a'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:48.846690 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1141/2312] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:19:48 2022] DELETE /identity/v3/users/84420a3abba2431fa2559ad59ecbc71a => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:48.851536 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a5cbf-6bba-415e-b032-d5da96568c53 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:48.852676 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a5cbf-6bba-415e-b032-d5da96568c53 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:48.853103 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a5cbf-6bba-415e-b032-d5da96568c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:48.889973 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-d09a5cbf-6bba-415e-b032-d5da96568c53 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:48.892843 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-d09a5cbf-6bba-415e-b032-d5da96568c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:49.031674 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1172/2313] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:19:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:49.112287 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa175390-f594-4bb3-be32-aa255c1b0230 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:49.114059 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-aa175390-f594-4bb3-be32-aa255c1b0230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:49.274682 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:49.303862 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa175390-f594-4bb3-be32-aa255c1b0230 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:49.312066 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f0a59-d1d2-4081-a3ce-1c592742601c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:49.317619 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f0a59-d1d2-4081-a3ce-1c592742601c service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:49.317997 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f0a59-d1d2-4081-a3ce-1c592742601c service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:49.318357 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f0a59-d1d2-4081-a3ce-1c592742601c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:49.343563 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f0a59-d1d2-4081-a3ce-1c592742601c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:49.348258 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f0a59-d1d2-4081-a3ce-1c592742601c service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:49.376049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1142/2314] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:50.753727 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a5cbf-6bba-415e-b032-d5da96568c53 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:50.756733 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-d09a5cbf-6bba-415e-b032-d5da96568c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:50.771822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a5cbf-6bba-415e-b032-d5da96568c53 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:50.777408 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ca3c1-c551-4597-a377-73d3133ea784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:50.778189 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ca3c1-c551-4597-a377-73d3133ea784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:50.778565 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ca3c1-c551-4597-a377-73d3133ea784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:50.778942 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ca3c1-c551-4597-a377-73d3133ea784 admin admin] PATH_INFO: `/v3/projects/4043689a42a04f0f873f5c7205443101` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:50.780538 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13ca3c1-c551-4597-a377-73d3133ea784 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4043689a42a04f0f873f5c7205443101)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:50.782606 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13ca3c1-c551-4597-a377-73d3133ea784 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:50.866905 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-a13ca3c1-c551-4597-a377-73d3133ea784 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4043689a42a04f0f873f5c7205443101', 'request_id': 'req-a13ca3c1-c551-4597-a377-73d3133ea784'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:50.873751 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-a13ca3c1-c551-4597-a377-73d3133ea784 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4043689a42a04f0f873f5c7205443101', 'request_id': 'req-a13ca3c1-c551-4597-a377-73d3133ea784'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:50.880408 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-a13ca3c1-c551-4597-a377-73d3133ea784 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4043689a42a04f0f873f5c7205443101', 'request_id': 'req-a13ca3c1-c551-4597-a377-73d3133ea784'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:50.910783 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-a13ca3c1-c551-4597-a377-73d3133ea784 admin admin] The token cache is being invalidate because project 4043689a42a04f0f873f5c7205443101 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:19:50.911757 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-a13ca3c1-c551-4597-a377-73d3133ea784 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:50.913093 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-a13ca3c1-c551-4597-a377-73d3133ea784 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:50.915235 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1173/2315] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:19:50 2022] DELETE /identity/v3/projects/4043689a42a04f0f873f5c7205443101 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:54.230007 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f0a59-d1d2-4081-a3ce-1c592742601c service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:54.231511 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-503f0a59-d1d2-4081-a3ce-1c592742601c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:54.263071 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f0a59-d1d2-4081-a3ce-1c592742601c service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:54.381440 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878bace-29ea-484a-81d0-2cc40612c000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:54.382296 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878bace-29ea-484a-81d0-2cc40612c000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:54.382991 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878bace-29ea-484a-81d0-2cc40612c000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:54.382991 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878bace-29ea-484a-81d0-2cc40612c000 admin admin] PATH_INFO: `/v3/users/79ca513d30cc4bbf8ec30d0bc1c1b0a5` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:54.384478 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0878bace-29ea-484a-81d0-2cc40612c000 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79ca513d30cc4bbf8ec30d0bc1c1b0a5)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:54.387230 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0878bace-29ea-484a-81d0-2cc40612c000 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:54.491851 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-0878bace-29ea-484a-81d0-2cc40612c000 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79ca513d30cc4bbf8ec30d0bc1c1b0a5'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:54.494028 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-0878bace-29ea-484a-81d0-2cc40612c000 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79ca513d30cc4bbf8ec30d0bc1c1b0a5'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:54.530237 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-0878bace-29ea-484a-81d0-2cc40612c000 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79ca513d30cc4bbf8ec30d0bc1c1b0a5'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:54.546105 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-0878bace-29ea-484a-81d0-2cc40612c000 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79ca513d30cc4bbf8ec30d0bc1c1b0a5'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:54.558377 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-0878bace-29ea-484a-81d0-2cc40612c000 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79ca513d30cc4bbf8ec30d0bc1c1b0a5'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:54.601180 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1143/2316] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:19:54 2022] DELETE /identity/v3/users/79ca513d30cc4bbf8ec30d0bc1c1b0a5 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:54.602561 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6883388-d6e6-4850-a872-501a85b80a73 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:54.603038 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6883388-d6e6-4850-a872-501a85b80a73 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:54.603135 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6883388-d6e6-4850-a872-501a85b80a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:54.640264 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-e6883388-d6e6-4850-a872-501a85b80a73 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:54.642691 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-e6883388-d6e6-4850-a872-501a85b80a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:54.692873 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:54.719373 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1174/2317] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:19:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:54.754101 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878bace-29ea-484a-81d0-2cc40612c000 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:54.756310 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-0878bace-29ea-484a-81d0-2cc40612c000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:54.841614 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878bace-29ea-484a-81d0-2cc40612c000 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:54.846436 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e26d1bf-466c-40e5-b774-65108cdd06e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:54.847281 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26d1bf-466c-40e5-b774-65108cdd06e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:54.847795 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26d1bf-466c-40e5-b774-65108cdd06e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:54.848269 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26d1bf-466c-40e5-b774-65108cdd06e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:54.864965 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e26d1bf-466c-40e5-b774-65108cdd06e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:54.867137 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e26d1bf-466c-40e5-b774-65108cdd06e1 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:54.879841 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1144/2318] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:55.393837 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6883388-d6e6-4850-a872-501a85b80a73 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:55.395403 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-e6883388-d6e6-4850-a872-501a85b80a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:55.413374 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6883388-d6e6-4850-a872-501a85b80a73 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:55.419926 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191920dd-0c87-4896-90d9-abd6390bb15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:55.421115 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191920dd-0c87-4896-90d9-abd6390bb15b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:55.421737 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191920dd-0c87-4896-90d9-abd6390bb15b admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:55.422006 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191920dd-0c87-4896-90d9-abd6390bb15b admin admin] PATH_INFO: `/v3/projects/a3c0a12776694fe0bcde898fbf2f2e3f` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:55.423304 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191920dd-0c87-4896-90d9-abd6390bb15b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3c0a12776694fe0bcde898fbf2f2e3f)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:55.439590 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191920dd-0c87-4896-90d9-abd6390bb15b admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:55.545770 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-191920dd-0c87-4896-90d9-abd6390bb15b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3c0a12776694fe0bcde898fbf2f2e3f', 'request_id': 'req-191920dd-0c87-4896-90d9-abd6390bb15b'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:55.553170 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-191920dd-0c87-4896-90d9-abd6390bb15b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3c0a12776694fe0bcde898fbf2f2e3f', 'request_id': 'req-191920dd-0c87-4896-90d9-abd6390bb15b'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:55.561789 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-191920dd-0c87-4896-90d9-abd6390bb15b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3c0a12776694fe0bcde898fbf2f2e3f', 'request_id': 'req-191920dd-0c87-4896-90d9-abd6390bb15b'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:55.578998 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-191920dd-0c87-4896-90d9-abd6390bb15b admin admin] The token cache is being invalidate because project a3c0a12776694fe0bcde898fbf2f2e3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:19:55.580850 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-191920dd-0c87-4896-90d9-abd6390bb15b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:55.581832 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-191920dd-0c87-4896-90d9-abd6390bb15b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:55.587148 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1175/2319] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:19:55 2022] DELETE /identity/v3/projects/a3c0a12776694fe0bcde898fbf2f2e3f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:55.588763 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d35861-40eb-44cb-a8e2-3e07d19907f4 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:55.589568 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d35861-40eb-44cb-a8e2-3e07d19907f4 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:55.590021 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d35861-40eb-44cb-a8e2-3e07d19907f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:55.605680 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:55.612103 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-b4d35861-40eb-44cb-a8e2-3e07d19907f4 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:55.613620 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-b4d35861-40eb-44cb-a8e2-3e07d19907f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:55.686820 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1145/2320] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:19:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:55.694610 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9dbc8-ff1d-4aa0-82a3-f60e02301841 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:55.695474 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9dbc8-ff1d-4aa0-82a3-f60e02301841 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:55.695908 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9dbc8-ff1d-4aa0-82a3-f60e02301841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:55.716929 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-caf9dbc8-ff1d-4aa0-82a3-f60e02301841 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:55.718770 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-caf9dbc8-ff1d-4aa0-82a3-f60e02301841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:55.734727 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1176/2321] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:19:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:55.735360 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d35861-40eb-44cb-a8e2-3e07d19907f4 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:55.746551 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d35861-40eb-44cb-a8e2-3e07d19907f4 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:55.752621 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4249d13b-085f-4d03-957e-4244b797b278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:55.754310 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249d13b-085f-4d03-957e-4244b797b278 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:55.754740 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249d13b-085f-4d03-957e-4244b797b278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:55.755150 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249d13b-085f-4d03-957e-4244b797b278 admin admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:55.756158 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4249d13b-085f-4d03-957e-4244b797b278 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:19:55.756635 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4249d13b-085f-4d03-957e-4244b797b278 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:55.758446 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4249d13b-085f-4d03-957e-4244b797b278 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:55.777214 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1146/2322] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:19:55.782053 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9dbc8-ff1d-4aa0-82a3-f60e02301841 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:55.797839 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9dbc8-ff1d-4aa0-82a3-f60e02301841 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:55.810218 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc2e33-1958-453d-bc9a-e5ed591dc708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:55.810873 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc2e33-1958-453d-bc9a-e5ed591dc708 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:55.811152 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc2e33-1958-453d-bc9a-e5ed591dc708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:55.811422 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc2e33-1958-453d-bc9a-e5ed591dc708 admin admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:55.812109 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc2e33-1958-453d-bc9a-e5ed591dc708 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:55.814052 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc2e33-1958-453d-bc9a-e5ed591dc708 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:55.877216 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1177/2323] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:19:55 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:55.881636 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4249d13b-085f-4d03-957e-4244b797b278 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:55.895059 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4249d13b-085f-4d03-957e-4244b797b278 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:55.992594 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33f6df-bb0e-45c2-a15a-b4621c3c85ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:55.993237 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33f6df-bb0e-45c2-a15a-b4621c3c85ba admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:55.993512 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33f6df-bb0e-45c2-a15a-b4621c3c85ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:55.993784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33f6df-bb0e-45c2-a15a-b4621c3c85ba admin admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:55.995148 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df33f6df-bb0e-45c2-a15a-b4621c3c85ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:55.996438 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df33f6df-bb0e-45c2-a15a-b4621c3c85ba admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:56.032827 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1147/2324] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:19:55 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:19:56.034177 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc2e33-1958-453d-bc9a-e5ed591dc708 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:56.050738 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc2e33-1958-453d-bc9a-e5ed591dc708 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:56.061364 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c22e3-c498-49c9-99ed-1cfcb1b4e0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:56.062423 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c22e3-c498-49c9-99ed-1cfcb1b4e0f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:56.063789 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c22e3-c498-49c9-99ed-1cfcb1b4e0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:56.064100 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c22e3-c498-49c9-99ed-1cfcb1b4e0f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:56.064841 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c22e3-c498-49c9-99ed-1cfcb1b4e0f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:56.066472 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c22e3-c498-49c9-99ed-1cfcb1b4e0f4 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:56.093100 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1178/2325] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:56.096411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33f6df-bb0e-45c2-a15a-b4621c3c85ba admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:56.113877 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33f6df-bb0e-45c2-a15a-b4621c3c85ba admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:56.127735 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060bdecd-4d61-4635-8137-0389c2a5aac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:56.128859 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060bdecd-4d61-4635-8137-0389c2a5aac8 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:56.129294 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060bdecd-4d61-4635-8137-0389c2a5aac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:56.129744 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060bdecd-4d61-4635-8137-0389c2a5aac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:56.130775 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060bdecd-4d61-4635-8137-0389c2a5aac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:56.135227 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060bdecd-4d61-4635-8137-0389c2a5aac8 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:56.157580 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1148/2326] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:56.163557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c22e3-c498-49c9-99ed-1cfcb1b4e0f4 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:56.180666 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c22e3-c498-49c9-99ed-1cfcb1b4e0f4 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:56.188116 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2fd1fc-d8ec-4b69-9a53-4a371f255077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:56.189863 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fd1fc-d8ec-4b69-9a53-4a371f255077 admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:56.190354 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fd1fc-d8ec-4b69-9a53-4a371f255077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:56.190801 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fd1fc-d8ec-4b69-9a53-4a371f255077 admin admin] PATH_INFO: `/v3/projects/9cc4225769cf4e998300ba5e35efe40b/users/9785c1ad76f24f2a9d66a007aa9f78a4/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:56.220472 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2fd1fc-d8ec-4b69-9a53-4a371f255077 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cc4225769cf4e998300ba5e35efe40b, user_id=9785c1ad76f24f2a9d66a007aa9f78a4, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:56.226773 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2fd1fc-d8ec-4b69-9a53-4a371f255077 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:56.256897 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1179/2327] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:19:56 2022] PUT /identity/v3/projects/9cc4225769cf4e998300ba5e35efe40b/users/9785c1ad76f24f2a9d66a007aa9f78a4/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:56.268592 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93edb38-eb54-4df8-af4e-001dd324fb9f None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:56.269047 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93edb38-eb54-4df8-af4e-001dd324fb9f None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:56.269521 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93edb38-eb54-4df8-af4e-001dd324fb9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:56.320721 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-a93edb38-eb54-4df8-af4e-001dd324fb9f None None] MFA Rules not processed for user `9785c1ad76f24f2a9d66a007aa9f78a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:56.323587 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-a93edb38-eb54-4df8-af4e-001dd324fb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:56.464671 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1149/2328] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:19:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:56.532418 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2fd1fc-d8ec-4b69-9a53-4a371f255077 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:56.534443 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-3b2fd1fc-d8ec-4b69-9a53-4a371f255077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:56.628735 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2fd1fc-d8ec-4b69-9a53-4a371f255077 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:56.635992 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d641eb-e90a-4b75-a6df-1db67a44a0e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:56.636924 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d641eb-e90a-4b75-a6df-1db67a44a0e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:56.637291 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d641eb-e90a-4b75-a6df-1db67a44a0e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:56.638404 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d641eb-e90a-4b75-a6df-1db67a44a0e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:56.655321 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d641eb-e90a-4b75-a6df-1db67a44a0e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:56.657112 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d641eb-e90a-4b75-a6df-1db67a44a0e1 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:56.686043 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1180/2329] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:20:01.001852 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93edb38-eb54-4df8-af4e-001dd324fb9f None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:01.004397 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-a93edb38-eb54-4df8-af4e-001dd324fb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:01.010208 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:01.147413 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93edb38-eb54-4df8-af4e-001dd324fb9f None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:01.161142 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff35603-ca52-45f5-886e-735f71d275cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:01.162061 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff35603-ca52-45f5-886e-735f71d275cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:01.162386 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff35603-ca52-45f5-886e-735f71d275cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:01.162665 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff35603-ca52-45f5-886e-735f71d275cb admin admin] PATH_INFO: `/v3/users/5a11d4191923470c9a30a6c96bd0fe06` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:01.172564 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff35603-ca52-45f5-886e-735f71d275cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a11d4191923470c9a30a6c96bd0fe06)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:01.177936 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff35603-ca52-45f5-886e-735f71d275cb admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:01.264461 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-fff35603-ca52-45f5-886e-735f71d275cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a11d4191923470c9a30a6c96bd0fe06'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:01.265445 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-fff35603-ca52-45f5-886e-735f71d275cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a11d4191923470c9a30a6c96bd0fe06'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:01.281558 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-fff35603-ca52-45f5-886e-735f71d275cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a11d4191923470c9a30a6c96bd0fe06'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:01.296604 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-fff35603-ca52-45f5-886e-735f71d275cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a11d4191923470c9a30a6c96bd0fe06'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:01.299694 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-fff35603-ca52-45f5-886e-735f71d275cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a11d4191923470c9a30a6c96bd0fe06'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:01.335081 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1150/2330] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:20:01 2022] DELETE /identity/v3/users/5a11d4191923470c9a30a6c96bd0fe06 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:20:01.339544 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085846bb-e1d7-402a-887b-1b10fdf4fed1 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:01.340082 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085846bb-e1d7-402a-887b-1b10fdf4fed1 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:01.340179 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085846bb-e1d7-402a-887b-1b10fdf4fed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:01.377410 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-085846bb-e1d7-402a-887b-1b10fdf4fed1 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:20:01.378895 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-085846bb-e1d7-402a-887b-1b10fdf4fed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:01.383922 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:01.478891 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1181/2331] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:20:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:20:01.514032 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff35603-ca52-45f5-886e-735f71d275cb admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:01.519921 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-fff35603-ca52-45f5-886e-735f71d275cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:01.667807 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff35603-ca52-45f5-886e-735f71d275cb admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:01.672922 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51654712-b5a9-43eb-93a1-0b08f890e85e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:01.674197 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51654712-b5a9-43eb-93a1-0b08f890e85e service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:01.674480 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51654712-b5a9-43eb-93a1-0b08f890e85e service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:01.674754 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51654712-b5a9-43eb-93a1-0b08f890e85e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:01.695217 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51654712-b5a9-43eb-93a1-0b08f890e85e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:01.696732 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51654712-b5a9-43eb-93a1-0b08f890e85e service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:01.733320 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1151/2332] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:20:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:20:02.559162 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085846bb-e1d7-402a-887b-1b10fdf4fed1 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:02.560694 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-085846bb-e1d7-402a-887b-1b10fdf4fed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:02.573368 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085846bb-e1d7-402a-887b-1b10fdf4fed1 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:02.580811 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80337e7c-6d94-4ee8-a4f6-67e0cc834585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:02.581853 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80337e7c-6d94-4ee8-a4f6-67e0cc834585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:02.582102 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80337e7c-6d94-4ee8-a4f6-67e0cc834585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:02.582561 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80337e7c-6d94-4ee8-a4f6-67e0cc834585 admin admin] PATH_INFO: `/v3/projects/4c93c74ca95948678c7f04168191f506` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:02.583843 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80337e7c-6d94-4ee8-a4f6-67e0cc834585 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c93c74ca95948678c7f04168191f506)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:02.586870 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80337e7c-6d94-4ee8-a4f6-67e0cc834585 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:02.678099 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-80337e7c-6d94-4ee8-a4f6-67e0cc834585 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c93c74ca95948678c7f04168191f506', 'request_id': 'req-80337e7c-6d94-4ee8-a4f6-67e0cc834585'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:02.684428 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-80337e7c-6d94-4ee8-a4f6-67e0cc834585 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c93c74ca95948678c7f04168191f506', 'request_id': 'req-80337e7c-6d94-4ee8-a4f6-67e0cc834585'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:02.691526 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-80337e7c-6d94-4ee8-a4f6-67e0cc834585 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c93c74ca95948678c7f04168191f506', 'request_id': 'req-80337e7c-6d94-4ee8-a4f6-67e0cc834585'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:02.708952 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-80337e7c-6d94-4ee8-a4f6-67e0cc834585 admin admin] The token cache is being invalidate because project 4c93c74ca95948678c7f04168191f506 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:20:02.709331 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-80337e7c-6d94-4ee8-a4f6-67e0cc834585 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:02.710682 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-80337e7c-6d94-4ee8-a4f6-67e0cc834585 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:02.712658 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1182/2333] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:20:02 2022] DELETE /identity/v3/projects/4c93c74ca95948678c7f04168191f506 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:20:02.717469 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee1aa9-8347-40c6-958e-bafe85a5632e None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:02.717957 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee1aa9-8347-40c6-958e-bafe85a5632e None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:02.718082 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee1aa9-8347-40c6-958e-bafe85a5632e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:02.739316 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-fbee1aa9-8347-40c6-958e-bafe85a5632e None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:20:02.740669 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-fbee1aa9-8347-40c6-958e-bafe85a5632e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:02.774067 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:02.825241 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1152/2334] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:20:02.833357 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f8c63-c590-4d52-badd-2abbaab1c50f None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:02.834128 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f8c63-c590-4d52-badd-2abbaab1c50f None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:02.834624 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f8c63-c590-4d52-badd-2abbaab1c50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:02.860733 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-f60f8c63-c590-4d52-badd-2abbaab1c50f None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:20:02.862358 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-f60f8c63-c590-4d52-badd-2abbaab1c50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:02.877082 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1183/2335] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:20:02.878218 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee1aa9-8347-40c6-958e-bafe85a5632e None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:02.899019 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee1aa9-8347-40c6-958e-bafe85a5632e None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:02.905209 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b47f2-0463-4bb0-b9f4-efa04597a529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:02.906143 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b47f2-0463-4bb0-b9f4-efa04597a529 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:02.906632 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b47f2-0463-4bb0-b9f4-efa04597a529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:02.907110 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b47f2-0463-4bb0-b9f4-efa04597a529 admin admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:02.908091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447b47f2-0463-4bb0-b9f4-efa04597a529 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:20:02.908501 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447b47f2-0463-4bb0-b9f4-efa04597a529 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:02.910885 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447b47f2-0463-4bb0-b9f4-efa04597a529 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:02.927551 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1153/2336] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:20:02.932339 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f8c63-c590-4d52-badd-2abbaab1c50f None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:02.944272 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f8c63-c590-4d52-badd-2abbaab1c50f None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:02.950203 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201fd72d-ac80-4b3e-a57a-5f6754d1fe71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:02.950965 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201fd72d-ac80-4b3e-a57a-5f6754d1fe71 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:02.951315 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201fd72d-ac80-4b3e-a57a-5f6754d1fe71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:02.951597 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201fd72d-ac80-4b3e-a57a-5f6754d1fe71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:02.952613 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201fd72d-ac80-4b3e-a57a-5f6754d1fe71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:02.955143 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201fd72d-ac80-4b3e-a57a-5f6754d1fe71 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:03.003290 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1184/2337] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:20:02 2022] POST /identity/v3/projects => generated 369 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:20:03.007952 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b47f2-0463-4bb0-b9f4-efa04597a529 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:03.024382 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b47f2-0463-4bb0-b9f4-efa04597a529 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:03.142223 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7466b61-88ee-4a29-a14e-6a6f5b9ebb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:03.144724 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7466b61-88ee-4a29-a14e-6a6f5b9ebb5d admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:03.148595 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7466b61-88ee-4a29-a14e-6a6f5b9ebb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:03.149621 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7466b61-88ee-4a29-a14e-6a6f5b9ebb5d admin admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:03.153254 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7466b61-88ee-4a29-a14e-6a6f5b9ebb5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:03.156760 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7466b61-88ee-4a29-a14e-6a6f5b9ebb5d admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:03.205316 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1154/2338] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:20:03 2022] POST /identity/v3/users => generated 285 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:20:03.206408 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201fd72d-ac80-4b3e-a57a-5f6754d1fe71 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:03.221594 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201fd72d-ac80-4b3e-a57a-5f6754d1fe71 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:03.235742 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2cef9-bf39-4110-bcf9-9fcdcede45b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:03.236832 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2cef9-bf39-4110-bcf9-9fcdcede45b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:03.237318 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2cef9-bf39-4110-bcf9-9fcdcede45b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:03.237820 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2cef9-bf39-4110-bcf9-9fcdcede45b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:03.239201 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b2cef9-bf39-4110-bcf9-9fcdcede45b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:03.241418 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b2cef9-bf39-4110-bcf9-9fcdcede45b0 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:03.272742 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1185/2339] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:20:03.275555 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7466b61-88ee-4a29-a14e-6a6f5b9ebb5d admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:03.292047 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7466b61-88ee-4a29-a14e-6a6f5b9ebb5d admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:03.298528 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d815a-4a04-4d59-931e-8382ce8ed5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:03.299340 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d815a-4a04-4d59-931e-8382ce8ed5d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:03.299892 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d815a-4a04-4d59-931e-8382ce8ed5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:03.300262 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d815a-4a04-4d59-931e-8382ce8ed5d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:03.301274 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d815a-4a04-4d59-931e-8382ce8ed5d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:03.303082 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d815a-4a04-4d59-931e-8382ce8ed5d6 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:03.319235 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1155/2340] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:20:03.323821 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2cef9-bf39-4110-bcf9-9fcdcede45b0 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:03.336728 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2cef9-bf39-4110-bcf9-9fcdcede45b0 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:03.346776 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ad1c1-521b-4c3c-8f6d-50c2324c503c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:03.348249 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ad1c1-521b-4c3c-8f6d-50c2324c503c admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:03.348941 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ad1c1-521b-4c3c-8f6d-50c2324c503c admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:03.349430 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ad1c1-521b-4c3c-8f6d-50c2324c503c admin admin] PATH_INFO: `/v3/projects/644822969a634c3ebfaf4bcd7293df20/users/7aced85a5bb24ccbb947a8239d508ec7/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:03.370684 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ad1c1-521b-4c3c-8f6d-50c2324c503c admin admin] RBAC: Authorizing `identity:create_grant(project_id=644822969a634c3ebfaf4bcd7293df20, user_id=7aced85a5bb24ccbb947a8239d508ec7, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:03.375794 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ad1c1-521b-4c3c-8f6d-50c2324c503c admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:03.413661 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1186/2341] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:20:03 2022] PUT /identity/v3/projects/644822969a634c3ebfaf4bcd7293df20/users/7aced85a5bb24ccbb947a8239d508ec7/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:20:03.417771 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bddc85-fb50-42cf-a3f5-184198cf89c4 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:03.418161 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bddc85-fb50-42cf-a3f5-184198cf89c4 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:03.418543 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bddc85-fb50-42cf-a3f5-184198cf89c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:03.458135 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-37bddc85-fb50-42cf-a3f5-184198cf89c4 None None] MFA Rules not processed for user `7aced85a5bb24ccbb947a8239d508ec7`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:20:03.459714 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-37bddc85-fb50-42cf-a3f5-184198cf89c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:03.590864 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1156/2342] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:20:03 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:20:03.624531 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ad1c1-521b-4c3c-8f6d-50c2324c503c admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:03.629934 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-204ad1c1-521b-4c3c-8f6d-50c2324c503c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:03.695532 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:03.768055 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ad1c1-521b-4c3c-8f6d-50c2324c503c admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:03.779648 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f68c33-69a0-4d50-9683-be6d9ab7fce2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:03.780321 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f68c33-69a0-4d50-9683-be6d9ab7fce2 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:03.780605 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f68c33-69a0-4d50-9683-be6d9ab7fce2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:03.780857 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f68c33-69a0-4d50-9683-be6d9ab7fce2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:03.797983 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f68c33-69a0-4d50-9683-be6d9ab7fce2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:03.799466 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f68c33-69a0-4d50-9683-be6d9ab7fce2 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:03.811677 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1187/2343] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:20:03 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:20:11.618412 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a72e6b-185b-461b-b066-76a7e927aa8c None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:11.619053 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a72e6b-185b-461b-b066-76a7e927aa8c None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:11.619369 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a72e6b-185b-461b-b066-76a7e927aa8c None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:11.622733 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1157/2344] 10.222.0.60 () {54 vars in 961 bytes} [Sun Jul 31 01:20:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:20:11.628783 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421944b5-372f-467a-af45-6c2130b12420 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:11.629372 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421944b5-372f-467a-af45-6c2130b12420 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:11.629965 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421944b5-372f-467a-af45-6c2130b12420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:11.659849 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-421944b5-372f-467a-af45-6c2130b12420 None None] MFA Rules not processed for user `657a3f73879e4b31b70a1c4f73e80f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:20:11.662140 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-421944b5-372f-467a-af45-6c2130b12420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:11.783114 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1188/2345] 10.222.0.60 () {58 vars in 1058 bytes} [Sun Jul 31 01:20:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:20:11.792640 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a72e6b-185b-461b-b066-76a7e927aa8c None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:11.822306 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a72e6b-185b-461b-b066-76a7e927aa8c None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:11.832077 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d68bf-93ac-4025-b767-d1cb5531705c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:11.832730 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d68bf-93ac-4025-b767-d1cb5531705c service placement] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:11.833005 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d68bf-93ac-4025-b767-d1cb5531705c service placement] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:11.833272 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d68bf-93ac-4025-b767-d1cb5531705c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:11.835179 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-ac4d68bf-93ac-4025-b767-d1cb5531705c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:11.848407 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d68bf-93ac-4025-b767-d1cb5531705c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:11.850508 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d68bf-93ac-4025-b767-d1cb5531705c service placement] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:11.881132 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1158/2346] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:20:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:20:17.192210 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421944b5-372f-467a-af45-6c2130b12420 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:17.197644 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-421944b5-372f-467a-af45-6c2130b12420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:17.363662 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421944b5-372f-467a-af45-6c2130b12420 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:17.375825 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58357ca-0a8b-4f74-ba95-d845a39105d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:17.377798 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58357ca-0a8b-4f74-ba95-d845a39105d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:17.378525 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58357ca-0a8b-4f74-ba95-d845a39105d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:17.379053 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58357ca-0a8b-4f74-ba95-d845a39105d9 admin admin] PATH_INFO: `/v3/users/9785c1ad76f24f2a9d66a007aa9f78a4` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:17.383180 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58357ca-0a8b-4f74-ba95-d845a39105d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9785c1ad76f24f2a9d66a007aa9f78a4)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:17.386122 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58357ca-0a8b-4f74-ba95-d845a39105d9 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:17.492217 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-a58357ca-0a8b-4f74-ba95-d845a39105d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9785c1ad76f24f2a9d66a007aa9f78a4'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:17.505380 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-a58357ca-0a8b-4f74-ba95-d845a39105d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9785c1ad76f24f2a9d66a007aa9f78a4'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:17.506439 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-a58357ca-0a8b-4f74-ba95-d845a39105d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9785c1ad76f24f2a9d66a007aa9f78a4'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:17.529802 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:17.533104 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-a58357ca-0a8b-4f74-ba95-d845a39105d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9785c1ad76f24f2a9d66a007aa9f78a4'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:17.534004 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-a58357ca-0a8b-4f74-ba95-d845a39105d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9785c1ad76f24f2a9d66a007aa9f78a4'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:17.578464 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1189/2347] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:20:17 2022] DELETE /identity/v3/users/9785c1ad76f24f2a9d66a007aa9f78a4 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:20:17.580071 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13152971-95d6-42fa-92c4-1940ba6afa9b None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:17.580944 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13152971-95d6-42fa-92c4-1940ba6afa9b None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:17.581703 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13152971-95d6-42fa-92c4-1940ba6afa9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:17.601363 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:17.618605 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-13152971-95d6-42fa-92c4-1940ba6afa9b None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:20:17.625812 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-13152971-95d6-42fa-92c4-1940ba6afa9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:17.787688 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1159/2348] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:20:17.818653 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58357ca-0a8b-4f74-ba95-d845a39105d9 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:17.822206 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-a58357ca-0a8b-4f74-ba95-d845a39105d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:17.943903 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58357ca-0a8b-4f74-ba95-d845a39105d9 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:17.952603 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1dbe3b-1e00-42e9-94c2-bebcef6a7e70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:17.953269 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1dbe3b-1e00-42e9-94c2-bebcef6a7e70 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:17.953528 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1dbe3b-1e00-42e9-94c2-bebcef6a7e70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:17.953798 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1dbe3b-1e00-42e9-94c2-bebcef6a7e70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:17.966433 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1dbe3b-1e00-42e9-94c2-bebcef6a7e70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:17.968329 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1dbe3b-1e00-42e9-94c2-bebcef6a7e70 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:17.994933 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1190/2349] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:20:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:20:18.760412 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13152971-95d6-42fa-92c4-1940ba6afa9b None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:18.763135 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-13152971-95d6-42fa-92c4-1940ba6afa9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:18.809913 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13152971-95d6-42fa-92c4-1940ba6afa9b None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:18.821283 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9aa5d-8ce2-46a7-8589-fcdc7aa13ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:18.821967 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9aa5d-8ce2-46a7-8589-fcdc7aa13ff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:18.822247 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9aa5d-8ce2-46a7-8589-fcdc7aa13ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:18.822522 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9aa5d-8ce2-46a7-8589-fcdc7aa13ff0 admin admin] PATH_INFO: `/v3/projects/9cc4225769cf4e998300ba5e35efe40b` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:18.823782 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c9aa5d-8ce2-46a7-8589-fcdc7aa13ff0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cc4225769cf4e998300ba5e35efe40b)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:18.845898 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c9aa5d-8ce2-46a7-8589-fcdc7aa13ff0 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:18.962481 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-05c9aa5d-8ce2-46a7-8589-fcdc7aa13ff0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cc4225769cf4e998300ba5e35efe40b', 'request_id': 'req-05c9aa5d-8ce2-46a7-8589-fcdc7aa13ff0'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:18.982316 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-05c9aa5d-8ce2-46a7-8589-fcdc7aa13ff0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cc4225769cf4e998300ba5e35efe40b', 'request_id': 'req-05c9aa5d-8ce2-46a7-8589-fcdc7aa13ff0'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:19.010353 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-05c9aa5d-8ce2-46a7-8589-fcdc7aa13ff0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cc4225769cf4e998300ba5e35efe40b', 'request_id': 'req-05c9aa5d-8ce2-46a7-8589-fcdc7aa13ff0'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:19.064391 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-05c9aa5d-8ce2-46a7-8589-fcdc7aa13ff0 admin admin] The token cache is being invalidate because project 9cc4225769cf4e998300ba5e35efe40b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:20:19.064697 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-05c9aa5d-8ce2-46a7-8589-fcdc7aa13ff0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:19.070562 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-05c9aa5d-8ce2-46a7-8589-fcdc7aa13ff0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:19.073018 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1160/2350] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:20:18 2022] DELETE /identity/v3/projects/9cc4225769cf4e998300ba5e35efe40b => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:20:19.092023 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1dbe3b-1e00-42e9-94c2-bebcef6a7e70 service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:19.092023 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-0e1dbe3b-1e00-42e9-94c2-bebcef6a7e70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:19.108894 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1dbe3b-1e00-42e9-94c2-bebcef6a7e70 service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:19.211539 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32409cf4-233f-48a4-862f-ca654e43b972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:19.212981 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32409cf4-233f-48a4-862f-ca654e43b972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:19.213472 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32409cf4-233f-48a4-862f-ca654e43b972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:19.213980 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32409cf4-233f-48a4-862f-ca654e43b972 admin admin] PATH_INFO: `/v3/users/cbc45b80a4a9458b8fa648228425c226` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:19.215640 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32409cf4-233f-48a4-862f-ca654e43b972 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbc45b80a4a9458b8fa648228425c226)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:19.217930 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32409cf4-233f-48a4-862f-ca654e43b972 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:19.333114 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-32409cf4-233f-48a4-862f-ca654e43b972 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbc45b80a4a9458b8fa648228425c226'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:19.356612 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-32409cf4-233f-48a4-862f-ca654e43b972 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbc45b80a4a9458b8fa648228425c226'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:19.364927 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-32409cf4-233f-48a4-862f-ca654e43b972 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbc45b80a4a9458b8fa648228425c226'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:19.384305 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-32409cf4-233f-48a4-862f-ca654e43b972 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbc45b80a4a9458b8fa648228425c226'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:19.385576 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-32409cf4-233f-48a4-862f-ca654e43b972 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbc45b80a4a9458b8fa648228425c226'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:19.415899 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1191/2351] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:20:19 2022] DELETE /identity/v3/users/cbc45b80a4a9458b8fa648228425c226 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:20:19.422040 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8d20d-fc68-43e1-bded-6160bdbf2740 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:19.422555 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8d20d-fc68-43e1-bded-6160bdbf2740 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:19.422983 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8d20d-fc68-43e1-bded-6160bdbf2740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:19.449829 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-7aa8d20d-fc68-43e1-bded-6160bdbf2740 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:20:19.451340 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-7aa8d20d-fc68-43e1-bded-6160bdbf2740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:19.590193 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1161/2352] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:20:19.605430 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32409cf4-233f-48a4-862f-ca654e43b972 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:19.607326 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-32409cf4-233f-48a4-862f-ca654e43b972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:19.620793 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:19.770431 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32409cf4-233f-48a4-862f-ca654e43b972 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:19.787967 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80116ec-ac85-4d95-8564-e373ab3082cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:19.788930 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80116ec-ac85-4d95-8564-e373ab3082cb service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:19.789359 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80116ec-ac85-4d95-8564-e373ab3082cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:19.789777 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80116ec-ac85-4d95-8564-e373ab3082cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:19.820857 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80116ec-ac85-4d95-8564-e373ab3082cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:19.828600 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80116ec-ac85-4d95-8564-e373ab3082cb service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:19.861520 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1192/2353] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:20:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:20:20.131068 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8d20d-fc68-43e1-bded-6160bdbf2740 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:20.134187 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-7aa8d20d-fc68-43e1-bded-6160bdbf2740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:20.151778 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8d20d-fc68-43e1-bded-6160bdbf2740 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:20.158998 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ee2aa-ecf7-46b2-860c-d345b0995329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:20.160202 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ee2aa-ecf7-46b2-860c-d345b0995329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:20.160762 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ee2aa-ecf7-46b2-860c-d345b0995329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:20.161514 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ee2aa-ecf7-46b2-860c-d345b0995329 admin admin] PATH_INFO: `/v3/projects/881a99aede6c47c9b628816904c8157e` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:20.163540 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ee2aa-ecf7-46b2-860c-d345b0995329 admin admin] RBAC: Authorizing `identity:delete_project(project_id=881a99aede6c47c9b628816904c8157e)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:20.169592 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ee2aa-ecf7-46b2-860c-d345b0995329 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:20.224756 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:20.248643 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-e52ee2aa-ecf7-46b2-860c-d345b0995329 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '881a99aede6c47c9b628816904c8157e', 'request_id': 'req-e52ee2aa-ecf7-46b2-860c-d345b0995329'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:20.256274 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-e52ee2aa-ecf7-46b2-860c-d345b0995329 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '881a99aede6c47c9b628816904c8157e', 'request_id': 'req-e52ee2aa-ecf7-46b2-860c-d345b0995329'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:20.263859 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-e52ee2aa-ecf7-46b2-860c-d345b0995329 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '881a99aede6c47c9b628816904c8157e', 'request_id': 'req-e52ee2aa-ecf7-46b2-860c-d345b0995329'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:20.279129 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-e52ee2aa-ecf7-46b2-860c-d345b0995329 admin admin] The token cache is being invalidate because project 881a99aede6c47c9b628816904c8157e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:20:20.279761 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-e52ee2aa-ecf7-46b2-860c-d345b0995329 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:20.280494 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-e52ee2aa-ecf7-46b2-860c-d345b0995329 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:20.282939 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1162/2354] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:20:20 2022] DELETE /identity/v3/projects/881a99aede6c47c9b628816904c8157e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:20:22.809801 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80116ec-ac85-4d95-8564-e373ab3082cb service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:22.811354 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-f80116ec-ac85-4d95-8564-e373ab3082cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:22.943899 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80116ec-ac85-4d95-8564-e373ab3082cb service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:23.068849 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a3774-7a2b-47bf-93f6-337cfb9429c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:23.069819 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a3774-7a2b-47bf-93f6-337cfb9429c2 service placement] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:23.070250 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a3774-7a2b-47bf-93f6-337cfb9429c2 service placement] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:23.070710 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a3774-7a2b-47bf-93f6-337cfb9429c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:23.076259 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-f19a3774-7a2b-47bf-93f6-337cfb9429c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:23.105022 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a3774-7a2b-47bf-93f6-337cfb9429c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:23.109286 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a3774-7a2b-47bf-93f6-337cfb9429c2 service placement] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:23.144501 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1193/2355] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:20:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:20:28.853456 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ee2aa-ecf7-46b2-860c-d345b0995329 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:28.856597 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-e52ee2aa-ecf7-46b2-860c-d345b0995329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:28.981710 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ee2aa-ecf7-46b2-860c-d345b0995329 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:28.987164 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4906a8a9-aaef-4576-91b4-5c006d57ac87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:28.987943 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906a8a9-aaef-4576-91b4-5c006d57ac87 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:28.988287 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906a8a9-aaef-4576-91b4-5c006d57ac87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:28.988631 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906a8a9-aaef-4576-91b4-5c006d57ac87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:28.991024 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-4906a8a9-aaef-4576-91b4-5c006d57ac87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:29.004739 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4906a8a9-aaef-4576-91b4-5c006d57ac87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:29.007130 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4906a8a9-aaef-4576-91b4-5c006d57ac87 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:29.018605 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1163/2356] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:20:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:20:31.660852 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a3774-7a2b-47bf-93f6-337cfb9429c2 service placement] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:31.677630 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a3774-7a2b-47bf-93f6-337cfb9429c2 service placement] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:31.686033 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a53071-5a38-4c1d-a8a5-0189e6ce7c71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:31.686033 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a53071-5a38-4c1d-a8a5-0189e6ce7c71 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:31.686274 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a53071-5a38-4c1d-a8a5-0189e6ce7c71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:31.686509 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a53071-5a38-4c1d-a8a5-0189e6ce7c71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:31.691474 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-76a53071-5a38-4c1d-a8a5-0189e6ce7c71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:31.786542 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=100 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:31.839230 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a53071-5a38-4c1d-a8a5-0189e6ce7c71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:31.840906 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a53071-5a38-4c1d-a8a5-0189e6ce7c71 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:31.854795 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1194/2357] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:20:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:20:33.257098 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4906a8a9-aaef-4576-91b4-5c006d57ac87 service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:33.259306 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-4906a8a9-aaef-4576-91b4-5c006d57ac87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:33.294649 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4906a8a9-aaef-4576-91b4-5c006d57ac87 service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:33.303917 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedcbb74-ec29-4e9e-a67b-513e429bd916 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:33.306793 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcbb74-ec29-4e9e-a67b-513e429bd916 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:33.307259 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcbb74-ec29-4e9e-a67b-513e429bd916 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:33.308135 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcbb74-ec29-4e9e-a67b-513e429bd916 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:33.310524 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-eedcbb74-ec29-4e9e-a67b-513e429bd916 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:33.326712 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedcbb74-ec29-4e9e-a67b-513e429bd916 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:33.328506 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedcbb74-ec29-4e9e-a67b-513e429bd916 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:33.342226 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1164/2358] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:20:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:20:34.139387 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a53071-5a38-4c1d-a8a5-0189e6ce7c71 service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:34.141164 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-76a53071-5a38-4c1d-a8a5-0189e6ce7c71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:34.183476 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a53071-5a38-4c1d-a8a5-0189e6ce7c71 service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:34.192407 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85e5f3-20d7-45ec-8908-81bdf9875c97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:34.193702 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85e5f3-20d7-45ec-8908-81bdf9875c97 service nova] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:34.194139 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85e5f3-20d7-45ec-8908-81bdf9875c97 service nova] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:34.194626 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85e5f3-20d7-45ec-8908-81bdf9875c97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:34.200705 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-3d85e5f3-20d7-45ec-8908-81bdf9875c97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:34.228597 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d85e5f3-20d7-45ec-8908-81bdf9875c97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:34.230251 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d85e5f3-20d7-45ec-8908-81bdf9875c97 service nova] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:34.258048 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1195/2359] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:20:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:20:37.648723 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedcbb74-ec29-4e9e-a67b-513e429bd916 service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:37.651210 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-eedcbb74-ec29-4e9e-a67b-513e429bd916 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:37.816766 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedcbb74-ec29-4e9e-a67b-513e429bd916 service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:37.823758 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16aa1f-b875-4db6-b73e-c46fecc32e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:37.825591 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16aa1f-b875-4db6-b73e-c46fecc32e3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:37.826123 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16aa1f-b875-4db6-b73e-c46fecc32e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:37.826705 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16aa1f-b875-4db6-b73e-c46fecc32e3d admin admin] PATH_INFO: `/v3/users/b4edfcc63a7b40d58abca62922571394` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:37.830202 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16aa1f-b875-4db6-b73e-c46fecc32e3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4edfcc63a7b40d58abca62922571394)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:37.835236 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16aa1f-b875-4db6-b73e-c46fecc32e3d admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:37.932028 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:37.935415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-bf16aa1f-b875-4db6-b73e-c46fecc32e3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4edfcc63a7b40d58abca62922571394'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:37.936419 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-bf16aa1f-b875-4db6-b73e-c46fecc32e3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4edfcc63a7b40d58abca62922571394'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:37.975323 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-bf16aa1f-b875-4db6-b73e-c46fecc32e3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4edfcc63a7b40d58abca62922571394'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:37.986308 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-bf16aa1f-b875-4db6-b73e-c46fecc32e3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4edfcc63a7b40d58abca62922571394'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:37.988049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-bf16aa1f-b875-4db6-b73e-c46fecc32e3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4edfcc63a7b40d58abca62922571394'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:38.011835 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1165/2360] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:20:37 2022] DELETE /identity/v3/users/b4edfcc63a7b40d58abca62922571394 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:20:38.015166 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852cbe0-83c4-4f2e-922f-aaedc71dbc17 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:38.015760 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852cbe0-83c4-4f2e-922f-aaedc71dbc17 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:38.015760 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852cbe0-83c4-4f2e-922f-aaedc71dbc17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:38.053074 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-9852cbe0-83c4-4f2e-922f-aaedc71dbc17 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:20:38.054602 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-9852cbe0-83c4-4f2e-922f-aaedc71dbc17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:38.213117 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1196/2361] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:20:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:20:38.249627 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16aa1f-b875-4db6-b73e-c46fecc32e3d admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:38.251389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-bf16aa1f-b875-4db6-b73e-c46fecc32e3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:38.409696 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16aa1f-b875-4db6-b73e-c46fecc32e3d admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:38.426297 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67808cc8-8043-49ea-8c07-a4a89a5c90b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:38.428174 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67808cc8-8043-49ea-8c07-a4a89a5c90b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:38.428174 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67808cc8-8043-49ea-8c07-a4a89a5c90b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:38.428399 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67808cc8-8043-49ea-8c07-a4a89a5c90b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:38.440425 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67808cc8-8043-49ea-8c07-a4a89a5c90b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:38.441892 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67808cc8-8043-49ea-8c07-a4a89a5c90b8 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:38.454527 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1166/2362] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:20:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:20:38.949004 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852cbe0-83c4-4f2e-922f-aaedc71dbc17 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:38.950657 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-9852cbe0-83c4-4f2e-922f-aaedc71dbc17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:38.964350 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852cbe0-83c4-4f2e-922f-aaedc71dbc17 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:38.969475 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4713b-5659-4751-84f6-76e33ac6fcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:38.970478 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4713b-5659-4751-84f6-76e33ac6fcad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:38.970968 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4713b-5659-4751-84f6-76e33ac6fcad admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:38.971432 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4713b-5659-4751-84f6-76e33ac6fcad admin admin] PATH_INFO: `/v3/projects/a63f71115ead4134b3e9d731feaed0a9` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:38.972943 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef4713b-5659-4751-84f6-76e33ac6fcad admin admin] RBAC: Authorizing `identity:delete_project(project_id=a63f71115ead4134b3e9d731feaed0a9)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:38.975238 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef4713b-5659-4751-84f6-76e33ac6fcad admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:39.038524 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-4ef4713b-5659-4751-84f6-76e33ac6fcad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a63f71115ead4134b3e9d731feaed0a9', 'request_id': 'req-4ef4713b-5659-4751-84f6-76e33ac6fcad'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:39.046428 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-4ef4713b-5659-4751-84f6-76e33ac6fcad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a63f71115ead4134b3e9d731feaed0a9', 'request_id': 'req-4ef4713b-5659-4751-84f6-76e33ac6fcad'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:39.054829 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-4ef4713b-5659-4751-84f6-76e33ac6fcad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a63f71115ead4134b3e9d731feaed0a9', 'request_id': 'req-4ef4713b-5659-4751-84f6-76e33ac6fcad'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:39.081874 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-4ef4713b-5659-4751-84f6-76e33ac6fcad admin admin] The token cache is being invalidate because project a63f71115ead4134b3e9d731feaed0a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:20:39.082572 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-4ef4713b-5659-4751-84f6-76e33ac6fcad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:39.083641 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-4ef4713b-5659-4751-84f6-76e33ac6fcad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:39.085877 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1197/2363] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:20:38 2022] DELETE /identity/v3/projects/a63f71115ead4134b3e9d731feaed0a9 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:20:39.090788 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d4353-058a-45e5-9768-5ab8c667e4f4 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:39.091712 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d4353-058a-45e5-9768-5ab8c667e4f4 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:39.091992 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d4353-058a-45e5-9768-5ab8c667e4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:39.136631 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-e75d4353-058a-45e5-9768-5ab8c667e4f4 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:20:39.137963 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-e75d4353-058a-45e5-9768-5ab8c667e4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:39.259913 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1167/2364] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:20:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:20:39.263316 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fbfa5-5b53-4e7d-8c19-be2ee1e41ccd None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:39.263698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fbfa5-5b53-4e7d-8c19-be2ee1e41ccd None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:39.263996 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fbfa5-5b53-4e7d-8c19-be2ee1e41ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:39.291695 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-da4fbfa5-5b53-4e7d-8c19-be2ee1e41ccd None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:20:39.293353 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-da4fbfa5-5b53-4e7d-8c19-be2ee1e41ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:39.306789 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1198/2365] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:20:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:20:39.307726 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d4353-058a-45e5-9768-5ab8c667e4f4 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:39.318127 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d4353-058a-45e5-9768-5ab8c667e4f4 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:39.324831 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee084bf-65ac-4b9f-8285-f97392d60771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:39.325485 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee084bf-65ac-4b9f-8285-f97392d60771 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:39.325764 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee084bf-65ac-4b9f-8285-f97392d60771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:39.326038 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee084bf-65ac-4b9f-8285-f97392d60771 admin admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:39.326757 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee084bf-65ac-4b9f-8285-f97392d60771 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:20:39.327062 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee084bf-65ac-4b9f-8285-f97392d60771 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:39.329284 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee084bf-65ac-4b9f-8285-f97392d60771 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:39.349691 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1168/2366] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:20:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:20:39.353905 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4fbfa5-5b53-4e7d-8c19-be2ee1e41ccd None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:39.383850 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4fbfa5-5b53-4e7d-8c19-be2ee1e41ccd None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:39.390794 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c594cb-0d1d-49c7-94f4-680000dc2fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:39.391787 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c594cb-0d1d-49c7-94f4-680000dc2fc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:39.392296 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c594cb-0d1d-49c7-94f4-680000dc2fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:39.392769 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c594cb-0d1d-49c7-94f4-680000dc2fc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:39.393825 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c594cb-0d1d-49c7-94f4-680000dc2fc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:39.396763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c594cb-0d1d-49c7-94f4-680000dc2fc3 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:39.431617 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1199/2367] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:20:39 2022] POST /identity/v3/projects => generated 365 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:20:39.436760 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee084bf-65ac-4b9f-8285-f97392d60771 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:39.458118 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee084bf-65ac-4b9f-8285-f97392d60771 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:39.546201 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:39.562159 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a03e0-2933-4958-bc1d-534ea006ede4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:39.563952 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a03e0-2933-4958-bc1d-534ea006ede4 admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:39.564547 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a03e0-2933-4958-bc1d-534ea006ede4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:39.565355 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a03e0-2933-4958-bc1d-534ea006ede4 admin admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:39.566872 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137a03e0-2933-4958-bc1d-534ea006ede4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:39.570747 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137a03e0-2933-4958-bc1d-534ea006ede4 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:39.626703 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1169/2368] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:20:39 2022] POST /identity/v3/users => generated 283 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:20:39.628985 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c594cb-0d1d-49c7-94f4-680000dc2fc3 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:39.645188 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c594cb-0d1d-49c7-94f4-680000dc2fc3 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:39.658955 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5838aa93-1351-4c5a-b50e-ed226d6f1198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:39.659633 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838aa93-1351-4c5a-b50e-ed226d6f1198 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:39.660134 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838aa93-1351-4c5a-b50e-ed226d6f1198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:39.664581 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838aa93-1351-4c5a-b50e-ed226d6f1198 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:39.668209 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5838aa93-1351-4c5a-b50e-ed226d6f1198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:39.669924 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5838aa93-1351-4c5a-b50e-ed226d6f1198 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:39.686613 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:39.697656 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1200/2369] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:20:39.699994 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a03e0-2933-4958-bc1d-534ea006ede4 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:39.721576 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a03e0-2933-4958-bc1d-534ea006ede4 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:39.743221 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5348373-370a-40d5-9754-e7529d7919f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:39.745247 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5348373-370a-40d5-9754-e7529d7919f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:39.745800 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5348373-370a-40d5-9754-e7529d7919f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:39.746326 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5348373-370a-40d5-9754-e7529d7919f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:39.749934 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5348373-370a-40d5-9754-e7529d7919f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:39.759370 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5348373-370a-40d5-9754-e7529d7919f1 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:39.787542 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1170/2370] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:20:39.791291 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5838aa93-1351-4c5a-b50e-ed226d6f1198 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:39.807718 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5838aa93-1351-4c5a-b50e-ed226d6f1198 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:39.829939 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2143597-30fb-4b3f-982a-ae934238defa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:39.830657 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2143597-30fb-4b3f-982a-ae934238defa admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:39.830935 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2143597-30fb-4b3f-982a-ae934238defa admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:39.831208 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2143597-30fb-4b3f-982a-ae934238defa admin admin] PATH_INFO: `/v3/projects/93e7d61b3f334a7a9b20912dfc71a0df/users/918c83000b924c55bb862db07d9becb6/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:39.852274 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2143597-30fb-4b3f-982a-ae934238defa admin admin] RBAC: Authorizing `identity:create_grant(project_id=93e7d61b3f334a7a9b20912dfc71a0df, user_id=918c83000b924c55bb862db07d9becb6, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:39.856365 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2143597-30fb-4b3f-982a-ae934238defa admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:39.881798 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1201/2371] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:20:39 2022] PUT /identity/v3/projects/93e7d61b3f334a7a9b20912dfc71a0df/users/918c83000b924c55bb862db07d9becb6/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:20:39.891984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717e48b-da6a-4b65-b060-9d14d99cec69 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:39.892304 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717e48b-da6a-4b65-b060-9d14d99cec69 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:39.892554 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717e48b-da6a-4b65-b060-9d14d99cec69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:39.950020 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-c717e48b-da6a-4b65-b060-9d14d99cec69 None None] MFA Rules not processed for user `918c83000b924c55bb862db07d9becb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:20:39.953305 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-c717e48b-da6a-4b65-b060-9d14d99cec69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:40.081332 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1171/2372] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:20:39 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:20:40.094145 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2143597-30fb-4b3f-982a-ae934238defa admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:40.096181 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-a2143597-30fb-4b3f-982a-ae934238defa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:40.242889 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2143597-30fb-4b3f-982a-ae934238defa admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:40.300190 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb3434-2042-4279-b225-f6576479affd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:40.300859 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb3434-2042-4279-b225-f6576479affd service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:40.301140 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb3434-2042-4279-b225-f6576479affd service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:40.301411 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb3434-2042-4279-b225-f6576479affd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:40.320871 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb3434-2042-4279-b225-f6576479affd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:40.323083 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb3434-2042-4279-b225-f6576479affd service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:40.347226 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1202/2373] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:20:40 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:20:50.071204 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=42,keystone:INSERT=3 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:50.331705 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=36,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:21:12.792778 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc2de5-63c1-4ab0-9bbd-8a738c7210c9 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:12.793358 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc2de5-63c1-4ab0-9bbd-8a738c7210c9 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:12.793358 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc2de5-63c1-4ab0-9bbd-8a738c7210c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:12.814721 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-6dfc2de5-63c1-4ab0-9bbd-8a738c7210c9 None None] MFA Rules not processed for user `9e467b255bf54ded9815e902e99b41df`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:21:12.816207 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-6dfc2de5-63c1-4ab0-9bbd-8a738c7210c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:12.881373 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1172/2374] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:21:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:21:13.454805 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb3434-2042-4279-b225-f6576479affd service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:13.467337 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb3434-2042-4279-b225-f6576479affd service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:13.493925 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e6092-3fd1-430c-8b4b-70f13ddf80ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:13.494993 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e6092-3fd1-430c-8b4b-70f13ddf80ce service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:13.495271 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e6092-3fd1-430c-8b4b-70f13ddf80ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:13.495805 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e6092-3fd1-430c-8b4b-70f13ddf80ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:13.501150 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-390e6092-3fd1-430c-8b4b-70f13ddf80ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:13.523734 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390e6092-3fd1-430c-8b4b-70f13ddf80ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:13.525459 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390e6092-3fd1-430c-8b4b-70f13ddf80ce service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:13.545513 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1203/2375] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:21:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:21:14.358070 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc2de5-63c1-4ab0-9bbd-8a738c7210c9 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:14.360195 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-6dfc2de5-63c1-4ab0-9bbd-8a738c7210c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:14.550323 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc2de5-63c1-4ab0-9bbd-8a738c7210c9 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:14.570396 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab055afb-a251-4fc5-99dd-a775171f63eb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:14.571069 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab055afb-a251-4fc5-99dd-a775171f63eb service placement] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:14.571349 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab055afb-a251-4fc5-99dd-a775171f63eb service placement] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:14.571675 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab055afb-a251-4fc5-99dd-a775171f63eb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:14.573573 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-ab055afb-a251-4fc5-99dd-a775171f63eb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:14.623816 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab055afb-a251-4fc5-99dd-a775171f63eb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:14.628153 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab055afb-a251-4fc5-99dd-a775171f63eb service placement] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:14.661785 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1173/2376] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:21:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:21:19.394803 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e6092-3fd1-430c-8b4b-70f13ddf80ce service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:19.396439 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-390e6092-3fd1-430c-8b4b-70f13ddf80ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:19.558008 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e6092-3fd1-430c-8b4b-70f13ddf80ce service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:19.565083 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf8c9f1-5371-4cf7-bf1e-ce12243a68ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:19.565673 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8c9f1-5371-4cf7-bf1e-ce12243a68ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:19.566205 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8c9f1-5371-4cf7-bf1e-ce12243a68ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:19.566653 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8c9f1-5371-4cf7-bf1e-ce12243a68ad admin admin] PATH_INFO: `/v3/users/3bb57c19619d45cc8424511f4c5f1a7b` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:19.568310 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf8c9f1-5371-4cf7-bf1e-ce12243a68ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bb57c19619d45cc8424511f4c5f1a7b)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:19.571182 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf8c9f1-5371-4cf7-bf1e-ce12243a68ad admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:19.685381 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-5cf8c9f1-5371-4cf7-bf1e-ce12243a68ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bb57c19619d45cc8424511f4c5f1a7b'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:19.699381 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-5cf8c9f1-5371-4cf7-bf1e-ce12243a68ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bb57c19619d45cc8424511f4c5f1a7b'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:19.700157 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-5cf8c9f1-5371-4cf7-bf1e-ce12243a68ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bb57c19619d45cc8424511f4c5f1a7b'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:19.733040 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-5cf8c9f1-5371-4cf7-bf1e-ce12243a68ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bb57c19619d45cc8424511f4c5f1a7b'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:19.733801 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-5cf8c9f1-5371-4cf7-bf1e-ce12243a68ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bb57c19619d45cc8424511f4c5f1a7b'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:19.760594 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1204/2377] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:21:19 2022] DELETE /identity/v3/users/3bb57c19619d45cc8424511f4c5f1a7b => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:21:19.765669 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9476e-760f-401f-aaac-b488e9d2bd21 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:19.766874 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9476e-760f-401f-aaac-b488e9d2bd21 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:19.767602 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9476e-760f-401f-aaac-b488e9d2bd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:19.838558 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-85f9476e-760f-401f-aaac-b488e9d2bd21 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:21:19.843034 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-85f9476e-760f-401f-aaac-b488e9d2bd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:19.941498 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1174/2378] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:21:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:21:19.957885 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf8c9f1-5371-4cf7-bf1e-ce12243a68ad admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:19.959477 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-5cf8c9f1-5371-4cf7-bf1e-ce12243a68ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:20.021327 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf8c9f1-5371-4cf7-bf1e-ce12243a68ad admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:20.025262 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6cb3dc-ed97-4052-809e-4c2f666768b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:20.026092 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cb3dc-ed97-4052-809e-4c2f666768b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:20.026515 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cb3dc-ed97-4052-809e-4c2f666768b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:20.026944 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cb3dc-ed97-4052-809e-4c2f666768b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:20.037497 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6cb3dc-ed97-4052-809e-4c2f666768b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:20.039371 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6cb3dc-ed97-4052-809e-4c2f666768b1 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:20.050504 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1205/2379] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:21:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:21:20.403470 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9476e-760f-401f-aaac-b488e9d2bd21 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:20.405639 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-85f9476e-760f-401f-aaac-b488e9d2bd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:20.423692 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9476e-760f-401f-aaac-b488e9d2bd21 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:20.429553 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e762cf-1587-4a34-8625-71f114c0a8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:20.430359 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e762cf-1587-4a34-8625-71f114c0a8c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:20.430748 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e762cf-1587-4a34-8625-71f114c0a8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:20.431342 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e762cf-1587-4a34-8625-71f114c0a8c1 admin admin] PATH_INFO: `/v3/projects/26547d75e1d24e2e98066da07d59a169` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:20.432674 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e762cf-1587-4a34-8625-71f114c0a8c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26547d75e1d24e2e98066da07d59a169)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:20.435844 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e762cf-1587-4a34-8625-71f114c0a8c1 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:20.478917 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:21:20.493985 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-b8e762cf-1587-4a34-8625-71f114c0a8c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26547d75e1d24e2e98066da07d59a169', 'request_id': 'req-b8e762cf-1587-4a34-8625-71f114c0a8c1'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:20.501335 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-b8e762cf-1587-4a34-8625-71f114c0a8c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26547d75e1d24e2e98066da07d59a169', 'request_id': 'req-b8e762cf-1587-4a34-8625-71f114c0a8c1'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:20.509299 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-b8e762cf-1587-4a34-8625-71f114c0a8c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26547d75e1d24e2e98066da07d59a169', 'request_id': 'req-b8e762cf-1587-4a34-8625-71f114c0a8c1'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:20.526168 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-b8e762cf-1587-4a34-8625-71f114c0a8c1 admin admin] The token cache is being invalidate because project 26547d75e1d24e2e98066da07d59a169 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:21:20.526477 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-b8e762cf-1587-4a34-8625-71f114c0a8c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:20.527119 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-b8e762cf-1587-4a34-8625-71f114c0a8c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:20.529002 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1175/2380] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:21:20 2022] DELETE /identity/v3/projects/26547d75e1d24e2e98066da07d59a169 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:21:20.534200 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e80a5-5ac3-41b5-b6d4-fc3706d01c60 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:20.534793 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e80a5-5ac3-41b5-b6d4-fc3706d01c60 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:20.534948 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e80a5-5ac3-41b5-b6d4-fc3706d01c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:20.555694 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-136e80a5-5ac3-41b5-b6d4-fc3706d01c60 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:21:20.557870 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-136e80a5-5ac3-41b5-b6d4-fc3706d01c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:20.562424 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:21:20.621568 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1206/2381] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:21:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:21:20.630063 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1291e3-04d4-4dd0-bc87-3259c8fe1710 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:20.630324 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1291e3-04d4-4dd0-bc87-3259c8fe1710 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:20.630594 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1291e3-04d4-4dd0-bc87-3259c8fe1710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:20.650767 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-bf1291e3-04d4-4dd0-bc87-3259c8fe1710 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:21:20.651942 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-bf1291e3-04d4-4dd0-bc87-3259c8fe1710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:20.667284 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1176/2382] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:21:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:21:20.671869 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e80a5-5ac3-41b5-b6d4-fc3706d01c60 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:20.683865 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e80a5-5ac3-41b5-b6d4-fc3706d01c60 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:20.688287 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994a828-f126-4766-86d8-87c2a333ce48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:20.688927 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994a828-f126-4766-86d8-87c2a333ce48 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:20.689196 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994a828-f126-4766-86d8-87c2a333ce48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:20.689471 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994a828-f126-4766-86d8-87c2a333ce48 admin admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:20.690164 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9994a828-f126-4766-86d8-87c2a333ce48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:21:20.690462 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9994a828-f126-4766-86d8-87c2a333ce48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:20.692397 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9994a828-f126-4766-86d8-87c2a333ce48 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:20.707049 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1207/2383] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:21:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:21:20.711572 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1291e3-04d4-4dd0-bc87-3259c8fe1710 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:20.723611 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1291e3-04d4-4dd0-bc87-3259c8fe1710 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:20.730656 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12282cd5-532f-43fd-8f8b-aecb636fd51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:20.731783 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12282cd5-532f-43fd-8f8b-aecb636fd51e admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:20.731979 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12282cd5-532f-43fd-8f8b-aecb636fd51e admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:20.732255 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12282cd5-532f-43fd-8f8b-aecb636fd51e admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:20.732937 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12282cd5-532f-43fd-8f8b-aecb636fd51e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:20.735001 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12282cd5-532f-43fd-8f8b-aecb636fd51e admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:20.789429 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1177/2384] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:21:20 2022] POST /identity/v3/projects => generated 379 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:21:20.794521 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994a828-f126-4766-86d8-87c2a333ce48 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:20.807257 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994a828-f126-4766-86d8-87c2a333ce48 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:20.874048 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2b3b9-f11e-4c3a-9def-0bf8ea5fc57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:20.874961 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2b3b9-f11e-4c3a-9def-0bf8ea5fc57f admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:20.875315 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2b3b9-f11e-4c3a-9def-0bf8ea5fc57f admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:20.875683 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2b3b9-f11e-4c3a-9def-0bf8ea5fc57f admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:20.876422 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf2b3b9-f11e-4c3a-9def-0bf8ea5fc57f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:20.878478 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf2b3b9-f11e-4c3a-9def-0bf8ea5fc57f admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:20.902252 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1208/2385] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:21:20 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:21:20.906609 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12282cd5-532f-43fd-8f8b-aecb636fd51e admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:20.917856 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12282cd5-532f-43fd-8f8b-aecb636fd51e admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:20.923111 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07afd5-beb3-46a3-898a-e067045a8920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:20.923954 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07afd5-beb3-46a3-898a-e067045a8920 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:20.924542 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07afd5-beb3-46a3-898a-e067045a8920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:20.924909 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07afd5-beb3-46a3-898a-e067045a8920 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:20.926087 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba07afd5-beb3-46a3-898a-e067045a8920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:20.927828 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba07afd5-beb3-46a3-898a-e067045a8920 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:20.938772 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1178/2386] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:21:20.943176 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2b3b9-f11e-4c3a-9def-0bf8ea5fc57f admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:20.954405 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2b3b9-f11e-4c3a-9def-0bf8ea5fc57f admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:20.962750 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476796f1-e8dc-40a5-810f-ef66a2383eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:20.963870 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476796f1-e8dc-40a5-810f-ef66a2383eac admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:20.964388 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476796f1-e8dc-40a5-810f-ef66a2383eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:20.964750 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476796f1-e8dc-40a5-810f-ef66a2383eac admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:20.965678 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476796f1-e8dc-40a5-810f-ef66a2383eac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:20.967538 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476796f1-e8dc-40a5-810f-ef66a2383eac admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:20.980100 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1209/2387] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:21:20.985050 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07afd5-beb3-46a3-898a-e067045a8920 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:20.995867 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07afd5-beb3-46a3-898a-e067045a8920 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:21.001983 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f99ef6b-24ae-466c-86ce-b0bf5c56770d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:21.002668 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f99ef6b-24ae-466c-86ce-b0bf5c56770d admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:21.002939 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f99ef6b-24ae-466c-86ce-b0bf5c56770d admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:21.003205 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f99ef6b-24ae-466c-86ce-b0bf5c56770d admin admin] PATH_INFO: `/v3/projects/2d608beaa8254bc0a4e85fdbecaf5e6c/users/8a8fc5247c0d4d03a831311aa19fe1e8/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:21.021111 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f99ef6b-24ae-466c-86ce-b0bf5c56770d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d608beaa8254bc0a4e85fdbecaf5e6c, user_id=8a8fc5247c0d4d03a831311aa19fe1e8, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:21.024081 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f99ef6b-24ae-466c-86ce-b0bf5c56770d admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:21.045690 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1179/2388] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:21:20 2022] PUT /identity/v3/projects/2d608beaa8254bc0a4e85fdbecaf5e6c/users/8a8fc5247c0d4d03a831311aa19fe1e8/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:21:21.056661 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc721b4-ecf4-423e-bd90-41a991d034f8 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:21.056932 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc721b4-ecf4-423e-bd90-41a991d034f8 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:21.057410 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc721b4-ecf4-423e-bd90-41a991d034f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:21.111096 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-1fc721b4-ecf4-423e-bd90-41a991d034f8 None None] MFA Rules not processed for user `8a8fc5247c0d4d03a831311aa19fe1e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:21:21.113014 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-1fc721b4-ecf4-423e-bd90-41a991d034f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:21.230843 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1210/2389] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:21:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:21:21.285084 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f99ef6b-24ae-466c-86ce-b0bf5c56770d admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:21.287156 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-2f99ef6b-24ae-466c-86ce-b0bf5c56770d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:21.407253 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f99ef6b-24ae-466c-86ce-b0bf5c56770d admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:21.412296 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61fff3-e8e6-4ec6-bf60-dabd867e57e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:21.413353 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61fff3-e8e6-4ec6-bf60-dabd867e57e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:21.414019 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61fff3-e8e6-4ec6-bf60-dabd867e57e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:21.414649 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61fff3-e8e6-4ec6-bf60-dabd867e57e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:21.428310 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61fff3-e8e6-4ec6-bf60-dabd867e57e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:21.430038 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61fff3-e8e6-4ec6-bf60-dabd867e57e0 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:21.451245 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1180/2390] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:21:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:21:26.184717 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc721b4-ecf4-423e-bd90-41a991d034f8 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:26.186794 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-1fc721b4-ecf4-423e-bd90-41a991d034f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:26.197348 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:21:26.327008 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc721b4-ecf4-423e-bd90-41a991d034f8 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:26.343687 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1aff8d-dcfc-4b8b-a270-b0ad9340ab72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:26.345755 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1aff8d-dcfc-4b8b-a270-b0ad9340ab72 service nova] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:26.346154 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1aff8d-dcfc-4b8b-a270-b0ad9340ab72 service nova] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:26.347502 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1aff8d-dcfc-4b8b-a270-b0ad9340ab72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:26.352630 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-0d1aff8d-dcfc-4b8b-a270-b0ad9340ab72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:26.376172 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1aff8d-dcfc-4b8b-a270-b0ad9340ab72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:26.384447 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1aff8d-dcfc-4b8b-a270-b0ad9340ab72 service nova] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:26.401411 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1211/2391] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:21:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:21:31.442676 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=66,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:21:36.393818 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=32 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:21:40.904397 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61fff3-e8e6-4ec6-bf60-dabd867e57e0 service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:40.988264 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61fff3-e8e6-4ec6-bf60-dabd867e57e0 service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:40.992938 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74ef21-c965-4f17-81e1-3ac522a16be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:40.993828 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74ef21-c965-4f17-81e1-3ac522a16be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:40.994111 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74ef21-c965-4f17-81e1-3ac522a16be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:40.994391 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74ef21-c965-4f17-81e1-3ac522a16be6 admin admin] PATH_INFO: `/v3/users/8a8fc5247c0d4d03a831311aa19fe1e8` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:40.995604 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a74ef21-c965-4f17-81e1-3ac522a16be6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a8fc5247c0d4d03a831311aa19fe1e8)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:40.998093 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a74ef21-c965-4f17-81e1-3ac522a16be6 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:41.052093 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-0a74ef21-c965-4f17-81e1-3ac522a16be6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a8fc5247c0d4d03a831311aa19fe1e8'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:41.052911 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-0a74ef21-c965-4f17-81e1-3ac522a16be6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a8fc5247c0d4d03a831311aa19fe1e8'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:41.065472 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-0a74ef21-c965-4f17-81e1-3ac522a16be6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a8fc5247c0d4d03a831311aa19fe1e8'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:41.073663 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-0a74ef21-c965-4f17-81e1-3ac522a16be6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a8fc5247c0d4d03a831311aa19fe1e8'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:41.074392 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-0a74ef21-c965-4f17-81e1-3ac522a16be6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a8fc5247c0d4d03a831311aa19fe1e8'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:41.088243 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1181/2392] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:21:40 2022] DELETE /identity/v3/users/8a8fc5247c0d4d03a831311aa19fe1e8 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:21:41.092855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e7ac6-6ef9-400b-a422-5de3d902d85e None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:41.093700 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e7ac6-6ef9-400b-a422-5de3d902d85e None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:41.094146 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e7ac6-6ef9-400b-a422-5de3d902d85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:41.117450 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-aa9e7ac6-6ef9-400b-a422-5de3d902d85e None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:21:41.118786 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-aa9e7ac6-6ef9-400b-a422-5de3d902d85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:41.183042 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1212/2393] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:21:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:21:41.193378 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74ef21-c965-4f17-81e1-3ac522a16be6 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:41.195175 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-0a74ef21-c965-4f17-81e1-3ac522a16be6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:41.258927 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74ef21-c965-4f17-81e1-3ac522a16be6 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:41.263299 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb51ee-787f-49b1-9982-2ee19c6e3f92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:41.264130 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb51ee-787f-49b1-9982-2ee19c6e3f92 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:41.264528 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb51ee-787f-49b1-9982-2ee19c6e3f92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:41.264949 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb51ee-787f-49b1-9982-2ee19c6e3f92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:41.279200 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb51ee-787f-49b1-9982-2ee19c6e3f92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:41.280926 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb51ee-787f-49b1-9982-2ee19c6e3f92 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:41.286532 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e7ac6-6ef9-400b-a422-5de3d902d85e None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:41.288147 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-aa9e7ac6-6ef9-400b-a422-5de3d902d85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:41.295279 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1182/2394] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:21:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:21:41.311020 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e7ac6-6ef9-400b-a422-5de3d902d85e None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:41.317341 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c340e-f4f2-46ab-a0ac-bb1fea591a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:41.318619 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c340e-f4f2-46ab-a0ac-bb1fea591a8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:41.319290 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c340e-f4f2-46ab-a0ac-bb1fea591a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:41.319825 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c340e-f4f2-46ab-a0ac-bb1fea591a8e admin admin] PATH_INFO: `/v3/users/7aced85a5bb24ccbb947a8239d508ec7` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:41.321813 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c340e-f4f2-46ab-a0ac-bb1fea591a8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7aced85a5bb24ccbb947a8239d508ec7)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:41.323917 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c340e-f4f2-46ab-a0ac-bb1fea591a8e admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:41.411645 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-db8c340e-f4f2-46ab-a0ac-bb1fea591a8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7aced85a5bb24ccbb947a8239d508ec7'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:41.421236 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-db8c340e-f4f2-46ab-a0ac-bb1fea591a8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7aced85a5bb24ccbb947a8239d508ec7'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:41.421977 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-db8c340e-f4f2-46ab-a0ac-bb1fea591a8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7aced85a5bb24ccbb947a8239d508ec7'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:41.449238 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-db8c340e-f4f2-46ab-a0ac-bb1fea591a8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7aced85a5bb24ccbb947a8239d508ec7'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:41.450002 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-db8c340e-f4f2-46ab-a0ac-bb1fea591a8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7aced85a5bb24ccbb947a8239d508ec7'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:41.466556 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1213/2395] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:21:41 2022] DELETE /identity/v3/users/7aced85a5bb24ccbb947a8239d508ec7 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:21:41.471359 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b8667-1bba-43e6-9d75-b98e089d4d20 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:41.472566 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b8667-1bba-43e6-9d75-b98e089d4d20 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:41.472916 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b8667-1bba-43e6-9d75-b98e089d4d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:41.499033 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-e49b8667-1bba-43e6-9d75-b98e089d4d20 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:21:41.500546 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-e49b8667-1bba-43e6-9d75-b98e089d4d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:41.510323 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c340e-f4f2-46ab-a0ac-bb1fea591a8e admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:41.512301 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-db8c340e-f4f2-46ab-a0ac-bb1fea591a8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:41.529073 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:21:41.590305 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1183/2396] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:21:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:21:41.601768 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b8667-1bba-43e6-9d75-b98e089d4d20 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:41.603504 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c340e-f4f2-46ab-a0ac-bb1fea591a8e admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:41.603936 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-e49b8667-1bba-43e6-9d75-b98e089d4d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:41.608281 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd74c20-1270-406e-97df-763b63e31ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:41.608933 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd74c20-1270-406e-97df-763b63e31ad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:41.609209 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd74c20-1270-406e-97df-763b63e31ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:41.609505 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd74c20-1270-406e-97df-763b63e31ad5 admin admin] PATH_INFO: `/v3/projects/2d608beaa8254bc0a4e85fdbecaf5e6c` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:41.610664 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd74c20-1270-406e-97df-763b63e31ad5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d608beaa8254bc0a4e85fdbecaf5e6c)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:41.612900 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd74c20-1270-406e-97df-763b63e31ad5 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:41.632380 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:21:41.670876 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b8667-1bba-43e6-9d75-b98e089d4d20 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:41.674613 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-9bd74c20-1270-406e-97df-763b63e31ad5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d608beaa8254bc0a4e85fdbecaf5e6c', 'request_id': 'req-9bd74c20-1270-406e-97df-763b63e31ad5'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:41.681009 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-9bd74c20-1270-406e-97df-763b63e31ad5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d608beaa8254bc0a4e85fdbecaf5e6c', 'request_id': 'req-9bd74c20-1270-406e-97df-763b63e31ad5'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:41.687913 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-9bd74c20-1270-406e-97df-763b63e31ad5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d608beaa8254bc0a4e85fdbecaf5e6c', 'request_id': 'req-9bd74c20-1270-406e-97df-763b63e31ad5'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:41.709622 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-9bd74c20-1270-406e-97df-763b63e31ad5 admin admin] The token cache is being invalidate because project 2d608beaa8254bc0a4e85fdbecaf5e6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:21:41.709915 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-9bd74c20-1270-406e-97df-763b63e31ad5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:41.711242 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-9bd74c20-1270-406e-97df-763b63e31ad5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:41.713360 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1214/2397] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:21:41 2022] DELETE /identity/v3/projects/2d608beaa8254bc0a4e85fdbecaf5e6c => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:21:41.720148 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce02340-8032-4d00-83a1-e8c56b1c072f None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:41.720616 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce02340-8032-4d00-83a1-e8c56b1c072f None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:41.720897 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce02340-8032-4d00-83a1-e8c56b1c072f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:41.745317 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e51f9-be7e-4883-abd6-c4a6e70195b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:41.746567 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e51f9-be7e-4883-abd6-c4a6e70195b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:41.747071 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e51f9-be7e-4883-abd6-c4a6e70195b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:41.747917 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e51f9-be7e-4883-abd6-c4a6e70195b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:41.750308 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-875e51f9-be7e-4883-abd6-c4a6e70195b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:41.753970 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-cce02340-8032-4d00-83a1-e8c56b1c072f None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:21:41.756355 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-cce02340-8032-4d00-83a1-e8c56b1c072f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:41.837890 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e51f9-be7e-4883-abd6-c4a6e70195b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:41.839852 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e51f9-be7e-4883-abd6-c4a6e70195b5 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:41.845937 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1215/2398] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:21:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:21:41.854009 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1184/2399] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:21:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:21:41.854614 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec34383-d468-46ae-8d71-17d2c5052640 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:41.854976 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec34383-d468-46ae-8d71-17d2c5052640 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:41.855255 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec34383-d468-46ae-8d71-17d2c5052640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:41.878755 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-5ec34383-d468-46ae-8d71-17d2c5052640 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:21:41.878755 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-5ec34383-d468-46ae-8d71-17d2c5052640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:41.891124 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1216/2400] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:21:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:21:41.891900 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e51f9-be7e-4883-abd6-c4a6e70195b5 service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:41.906268 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e51f9-be7e-4883-abd6-c4a6e70195b5 service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:41.916912 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c47a203-0597-4986-b4ba-22d8af9e045d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:41.917880 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47a203-0597-4986-b4ba-22d8af9e045d admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:41.918154 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47a203-0597-4986-b4ba-22d8af9e045d admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:41.918426 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47a203-0597-4986-b4ba-22d8af9e045d admin admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:41.919436 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c47a203-0597-4986-b4ba-22d8af9e045d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:21:41.919846 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c47a203-0597-4986-b4ba-22d8af9e045d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:41.921575 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c47a203-0597-4986-b4ba-22d8af9e045d admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:41.937087 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1185/2401] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:21:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:21:41.941810 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec34383-d468-46ae-8d71-17d2c5052640 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:41.951679 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec34383-d468-46ae-8d71-17d2c5052640 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:41.956651 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f489f-2b9d-4652-b026-e0ec7214002a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:41.957297 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f489f-2b9d-4652-b026-e0ec7214002a admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:41.957563 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f489f-2b9d-4652-b026-e0ec7214002a admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:41.957830 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f489f-2b9d-4652-b026-e0ec7214002a admin admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:41.958661 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2f489f-2b9d-4652-b026-e0ec7214002a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:41.960665 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2f489f-2b9d-4652-b026-e0ec7214002a admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:42.003757 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1217/2402] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:21:41 2022] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:21:42.004289 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c47a203-0597-4986-b4ba-22d8af9e045d admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:42.018292 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c47a203-0597-4986-b4ba-22d8af9e045d admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:42.037295 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:21:42.101308 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b94f9fd-b79f-4e45-9e57-0a1a64ca691f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:42.101308 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94f9fd-b79f-4e45-9e57-0a1a64ca691f admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:42.101308 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94f9fd-b79f-4e45-9e57-0a1a64ca691f admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:42.101308 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94f9fd-b79f-4e45-9e57-0a1a64ca691f admin admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:42.101759 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b94f9fd-b79f-4e45-9e57-0a1a64ca691f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:42.103207 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f489f-2b9d-4652-b026-e0ec7214002a admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:42.103717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b94f9fd-b79f-4e45-9e57-0a1a64ca691f admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:42.105788 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-cd2f489f-2b9d-4652-b026-e0ec7214002a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:42.130351 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f489f-2b9d-4652-b026-e0ec7214002a admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:42.136480 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ddf55-98ad-4644-8f2a-27b2c837400d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:42.137558 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ddf55-98ad-4644-8f2a-27b2c837400d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:42.138056 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ddf55-98ad-4644-8f2a-27b2c837400d admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:42.138536 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ddf55-98ad-4644-8f2a-27b2c837400d admin admin] PATH_INFO: `/v3/projects/644822969a634c3ebfaf4bcd7293df20` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:42.140203 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075ddf55-98ad-4644-8f2a-27b2c837400d admin admin] RBAC: Authorizing `identity:delete_project(project_id=644822969a634c3ebfaf4bcd7293df20)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:42.144153 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1186/2403] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:21:42 2022] POST /identity/v3/users => generated 290 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:21:42.149912 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075ddf55-98ad-4644-8f2a-27b2c837400d admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:42.150497 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b94f9fd-b79f-4e45-9e57-0a1a64ca691f admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:42.171245 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b94f9fd-b79f-4e45-9e57-0a1a64ca691f admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:42.178153 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a2945-ebd1-4919-80c1-487680f0a3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:42.178957 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a2945-ebd1-4919-80c1-487680f0a3f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:42.179310 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a2945-ebd1-4919-80c1-487680f0a3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:42.179860 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a2945-ebd1-4919-80c1-487680f0a3f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:42.180616 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30a2945-ebd1-4919-80c1-487680f0a3f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:42.182253 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30a2945-ebd1-4919-80c1-487680f0a3f6 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:42.197016 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1187/2404] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:21:42.201113 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a2945-ebd1-4919-80c1-487680f0a3f6 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:42.227641 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a2945-ebd1-4919-80c1-487680f0a3f6 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:42.232492 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867fc186-caff-478a-a540-9a9731a3c172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:42.233119 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fc186-caff-478a-a540-9a9731a3c172 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:42.233391 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fc186-caff-478a-a540-9a9731a3c172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:42.233762 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fc186-caff-478a-a540-9a9731a3c172 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:42.234350 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867fc186-caff-478a-a540-9a9731a3c172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:42.236154 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867fc186-caff-478a-a540-9a9731a3c172 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:42.245994 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-075ddf55-98ad-4644-8f2a-27b2c837400d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '644822969a634c3ebfaf4bcd7293df20', 'request_id': 'req-075ddf55-98ad-4644-8f2a-27b2c837400d'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:42.250803 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1188/2405] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:21:42.251955 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867fc186-caff-478a-a540-9a9731a3c172 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:42.256277 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-075ddf55-98ad-4644-8f2a-27b2c837400d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '644822969a634c3ebfaf4bcd7293df20', 'request_id': 'req-075ddf55-98ad-4644-8f2a-27b2c837400d'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:42.262742 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867fc186-caff-478a-a540-9a9731a3c172 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:42.264583 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-075ddf55-98ad-4644-8f2a-27b2c837400d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '644822969a634c3ebfaf4bcd7293df20', 'request_id': 'req-075ddf55-98ad-4644-8f2a-27b2c837400d'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:42.275346 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:21:42.286579 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-075ddf55-98ad-4644-8f2a-27b2c837400d admin admin] The token cache is being invalidate because project 644822969a634c3ebfaf4bcd7293df20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:21:42.286868 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-075ddf55-98ad-4644-8f2a-27b2c837400d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:42.288228 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-075ddf55-98ad-4644-8f2a-27b2c837400d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:42.290545 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1218/2406] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:21:42 2022] DELETE /identity/v3/projects/644822969a634c3ebfaf4bcd7293df20 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:21:42.295505 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e38b8-bd3e-4408-8270-f35b145b2e8a None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:42.295783 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e38b8-bd3e-4408-8270-f35b145b2e8a None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:42.296121 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e38b8-bd3e-4408-8270-f35b145b2e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:42.316295 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-704e38b8-bd3e-4408-8270-f35b145b2e8a None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:21:42.317515 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-704e38b8-bd3e-4408-8270-f35b145b2e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:42.332180 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45648966-dab1-457d-a74c-900791ac8807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:42.332883 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45648966-dab1-457d-a74c-900791ac8807 admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:42.333162 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45648966-dab1-457d-a74c-900791ac8807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:42.333439 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45648966-dab1-457d-a74c-900791ac8807 admin admin] PATH_INFO: `/v3/projects/4ff4bedb5dd44ddca88945ee4004d277/users/5d801ef91137499c93d8241211f8a256/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:42.352107 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45648966-dab1-457d-a74c-900791ac8807 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ff4bedb5dd44ddca88945ee4004d277, user_id=5d801ef91137499c93d8241211f8a256, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:42.354867 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45648966-dab1-457d-a74c-900791ac8807 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:42.372261 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1189/2407] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:21:42 2022] PUT /identity/v3/projects/4ff4bedb5dd44ddca88945ee4004d277/users/5d801ef91137499c93d8241211f8a256/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:21:42.384377 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4f7fc-74cb-4ba7-9ea1-54becda118ae None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:42.384665 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4f7fc-74cb-4ba7-9ea1-54becda118ae None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:42.385314 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4f7fc-74cb-4ba7-9ea1-54becda118ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:42.392937 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1219/2408] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:21:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:21:42.401418 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66d223-dd2e-4c5a-852b-756d594c0d45 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:42.401629 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66d223-dd2e-4c5a-852b-756d594c0d45 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:42.401901 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66d223-dd2e-4c5a-852b-756d594c0d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:42.418929 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-f7f4f7fc-74cb-4ba7-9ea1-54becda118ae None None] MFA Rules not processed for user `5d801ef91137499c93d8241211f8a256`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:21:42.420435 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-f7f4f7fc-74cb-4ba7-9ea1-54becda118ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:42.422073 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-ad66d223-dd2e-4c5a-852b-756d594c0d45 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:21:42.423235 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-ad66d223-dd2e-4c5a-852b-756d594c0d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:42.508285 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1220/2409] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:21:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:21:42.509245 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:21:42.513196 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66d223-dd2e-4c5a-852b-756d594c0d45 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:42.524064 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66d223-dd2e-4c5a-852b-756d594c0d45 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:42.527670 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1190/2410] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:21:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:21:42.529727 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ccb8b7-d77c-401e-87bc-8ea25449a914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:42.530566 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ccb8b7-d77c-401e-87bc-8ea25449a914 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:42.530841 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ccb8b7-d77c-401e-87bc-8ea25449a914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:42.531134 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ccb8b7-d77c-401e-87bc-8ea25449a914 admin admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:42.531870 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ccb8b7-d77c-401e-87bc-8ea25449a914 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:21:42.532154 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ccb8b7-d77c-401e-87bc-8ea25449a914 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:42.534098 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ccb8b7-d77c-401e-87bc-8ea25449a914 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:42.535611 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f4f7fc-74cb-4ba7-9ea1-54becda118ae None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:42.537439 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-f7f4f7fc-74cb-4ba7-9ea1-54becda118ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:42.546678 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1221/2411] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:21:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:21:42.551016 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ccb8b7-d77c-401e-87bc-8ea25449a914 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:42.561137 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ccb8b7-d77c-401e-87bc-8ea25449a914 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:42.568208 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0d3af-198f-4612-827f-c881e49e5f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:42.568826 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0d3af-198f-4612-827f-c881e49e5f09 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:42.569106 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0d3af-198f-4612-827f-c881e49e5f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:42.569371 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0d3af-198f-4612-827f-c881e49e5f09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:42.570164 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0d3af-198f-4612-827f-c881e49e5f09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:42.572798 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0d3af-198f-4612-827f-c881e49e5f09 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:42.608182 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f4f7fc-74cb-4ba7-9ea1-54becda118ae None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:42.613492 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1222/2412] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:21:42 2022] POST /identity/v3/projects => generated 361 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:21:42.614612 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0d3af-198f-4612-827f-c881e49e5f09 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:42.671278 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ebd7d-d604-48f4-80eb-3edebc63c86e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:42.671945 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ebd7d-d604-48f4-80eb-3edebc63c86e service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:42.672676 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ebd7d-d604-48f4-80eb-3edebc63c86e service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:42.672676 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ebd7d-d604-48f4-80eb-3edebc63c86e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:42.693293 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0d3af-198f-4612-827f-c881e49e5f09 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:42.698474 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9aab98-493c-489b-8fbd-7f6fa1d3926f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:42.699100 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9aab98-493c-489b-8fbd-7f6fa1d3926f admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:42.699382 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9aab98-493c-489b-8fbd-7f6fa1d3926f admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:42.699688 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9aab98-493c-489b-8fbd-7f6fa1d3926f admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:42.700366 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9aab98-493c-489b-8fbd-7f6fa1d3926f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:42.702389 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9aab98-493c-489b-8fbd-7f6fa1d3926f admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:42.713974 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:21:42.733335 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1223/2413] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:21:42 2022] POST /identity/v3/users => generated 281 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:21:42.734458 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9aab98-493c-489b-8fbd-7f6fa1d3926f admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:42.743433 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9ebd7d-d604-48f4-80eb-3edebc63c86e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:42.744517 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9aab98-493c-489b-8fbd-7f6fa1d3926f admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:42.745510 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9ebd7d-d604-48f4-80eb-3edebc63c86e service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:42.750240 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27654d-aecf-4f7e-8ccf-8a974170adb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:42.750948 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27654d-aecf-4f7e-8ccf-8a974170adb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:42.751360 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27654d-aecf-4f7e-8ccf-8a974170adb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:42.751664 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27654d-aecf-4f7e-8ccf-8a974170adb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:42.752360 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc27654d-aecf-4f7e-8ccf-8a974170adb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:42.754100 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc27654d-aecf-4f7e-8ccf-8a974170adb7 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:42.756127 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1191/2414] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:21:42 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:21:42.769471 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1224/2415] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:21:42.770726 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ebd7d-d604-48f4-80eb-3edebc63c86e service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:42.774714 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27654d-aecf-4f7e-8ccf-8a974170adb7 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:42.776492 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-dc27654d-aecf-4f7e-8ccf-8a974170adb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:42.783147 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ebd7d-d604-48f4-80eb-3edebc63c86e service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:42.788371 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fab55e-f58d-48b4-a635-031bcdb096b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:42.789100 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fab55e-f58d-48b4-a635-031bcdb096b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:42.789411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fab55e-f58d-48b4-a635-031bcdb096b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:42.789688 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fab55e-f58d-48b4-a635-031bcdb096b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:42.790372 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27654d-aecf-4f7e-8ccf-8a974170adb7 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:42.790496 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fab55e-f58d-48b4-a635-031bcdb096b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:42.792654 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fab55e-f58d-48b4-a635-031bcdb096b1 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:42.795382 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb43b4d-753d-47ac-aab1-6e7baed0bd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:42.796149 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb43b4d-753d-47ac-aab1-6e7baed0bd10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:42.796535 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb43b4d-753d-47ac-aab1-6e7baed0bd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:42.796906 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb43b4d-753d-47ac-aab1-6e7baed0bd10 admin admin] PATH_INFO: `/v3/users/5d801ef91137499c93d8241211f8a256` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:42.798166 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb43b4d-753d-47ac-aab1-6e7baed0bd10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d801ef91137499c93d8241211f8a256)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:42.800445 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb43b4d-753d-47ac-aab1-6e7baed0bd10 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:42.803812 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1192/2416] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:21:42.808227 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fab55e-f58d-48b4-a635-031bcdb096b1 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:42.820132 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fab55e-f58d-48b4-a635-031bcdb096b1 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:42.828719 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db8793-bd4f-431b-b084-08ff066ce7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:42.828719 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db8793-bd4f-431b-b084-08ff066ce7c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:42.828719 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db8793-bd4f-431b-b084-08ff066ce7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:42.828719 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db8793-bd4f-431b-b084-08ff066ce7c5 admin admin] PATH_INFO: `/v3/projects/0e2555d95dfb411aaddf891e954b47fb/users/33d25c43a95d4f1ea1652d71847d61ce/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:42.845282 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db8793-bd4f-431b-b084-08ff066ce7c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e2555d95dfb411aaddf891e954b47fb, user_id=33d25c43a95d4f1ea1652d71847d61ce, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:42.848201 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db8793-bd4f-431b-b084-08ff066ce7c5 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:42.868876 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-3fb43b4d-753d-47ac-aab1-6e7baed0bd10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d801ef91137499c93d8241211f8a256'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:42.873321 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1193/2417] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:21:42 2022] PUT /identity/v3/projects/0e2555d95dfb411aaddf891e954b47fb/users/33d25c43a95d4f1ea1652d71847d61ce/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:21:42.877475 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-3fb43b4d-753d-47ac-aab1-6e7baed0bd10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d801ef91137499c93d8241211f8a256'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:42.878316 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-3fb43b4d-753d-47ac-aab1-6e7baed0bd10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d801ef91137499c93d8241211f8a256'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:42.885476 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a1dc4-3c1c-47be-bf77-e2808b441548 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:42.886373 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a1dc4-3c1c-47be-bf77-e2808b441548 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:42.886811 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a1dc4-3c1c-47be-bf77-e2808b441548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:42.892181 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-3fb43b4d-753d-47ac-aab1-6e7baed0bd10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d801ef91137499c93d8241211f8a256'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:42.893106 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-3fb43b4d-753d-47ac-aab1-6e7baed0bd10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d801ef91137499c93d8241211f8a256'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:42.915398 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1225/2418] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:21:42 2022] DELETE /identity/v3/users/5d801ef91137499c93d8241211f8a256 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:21:42.919201 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef7f8b-3194-47aa-94cf-5baa9a2c52d9 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:42.920174 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef7f8b-3194-47aa-94cf-5baa9a2c52d9 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:42.920546 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef7f8b-3194-47aa-94cf-5baa9a2c52d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:42.925247 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-f68a1dc4-3c1c-47be-bf77-e2808b441548 None None] MFA Rules not processed for user `33d25c43a95d4f1ea1652d71847d61ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:21:42.927761 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-f68a1dc4-3c1c-47be-bf77-e2808b441548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:42.945276 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-85ef7f8b-3194-47aa-94cf-5baa9a2c52d9 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:21:42.946706 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-85ef7f8b-3194-47aa-94cf-5baa9a2c52d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:42.954857 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:21:43.012350 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1194/2419] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:21:42 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:21:43.022977 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a1dc4-3c1c-47be-bf77-e2808b441548 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:43.026638 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1226/2420] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:21:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:21:43.027433 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-f68a1dc4-3c1c-47be-bf77-e2808b441548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:43.035165 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef7f8b-3194-47aa-94cf-5baa9a2c52d9 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:43.036992 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-85ef7f8b-3194-47aa-94cf-5baa9a2c52d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:43.105525 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a1dc4-3c1c-47be-bf77-e2808b441548 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:43.117203 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef7f8b-3194-47aa-94cf-5baa9a2c52d9 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:43.118572 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c490ea-5566-4c4d-a64d-7e233eb1310f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:43.118572 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c490ea-5566-4c4d-a64d-7e233eb1310f service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:43.118907 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c490ea-5566-4c4d-a64d-7e233eb1310f service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:43.119127 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c490ea-5566-4c4d-a64d-7e233eb1310f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:43.121460 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85f9f4-28b8-4d8d-b5c6-263206f332b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:43.122085 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85f9f4-28b8-4d8d-b5c6-263206f332b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:43.122731 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85f9f4-28b8-4d8d-b5c6-263206f332b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:43.123061 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85f9f4-28b8-4d8d-b5c6-263206f332b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:43.132752 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c490ea-5566-4c4d-a64d-7e233eb1310f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:43.134303 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c490ea-5566-4c4d-a64d-7e233eb1310f service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:43.135393 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e85f9f4-28b8-4d8d-b5c6-263206f332b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:43.136886 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e85f9f4-28b8-4d8d-b5c6-263206f332b1 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:43.142386 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:21:43.145442 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1195/2421] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:21:43 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:21:43.148442 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1227/2422] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:21:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:21:43.715228 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c490ea-5566-4c4d-a64d-7e233eb1310f service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:43.716764 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-09c490ea-5566-4c4d-a64d-7e233eb1310f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:43.743233 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c490ea-5566-4c4d-a64d-7e233eb1310f service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:43.755095 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839efbf-f322-4cc5-b4d1-6faa0448bdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:43.756191 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839efbf-f322-4cc5-b4d1-6faa0448bdee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:43.757482 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839efbf-f322-4cc5-b4d1-6faa0448bdee admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:43.757997 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839efbf-f322-4cc5-b4d1-6faa0448bdee admin admin] PATH_INFO: `/v3/projects/4ff4bedb5dd44ddca88945ee4004d277` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:43.759819 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5839efbf-f322-4cc5-b4d1-6faa0448bdee admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ff4bedb5dd44ddca88945ee4004d277)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:43.764782 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5839efbf-f322-4cc5-b4d1-6faa0448bdee admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:43.837513 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-5839efbf-f322-4cc5-b4d1-6faa0448bdee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ff4bedb5dd44ddca88945ee4004d277', 'request_id': 'req-5839efbf-f322-4cc5-b4d1-6faa0448bdee'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:43.845469 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-5839efbf-f322-4cc5-b4d1-6faa0448bdee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ff4bedb5dd44ddca88945ee4004d277', 'request_id': 'req-5839efbf-f322-4cc5-b4d1-6faa0448bdee'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:43.856194 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-5839efbf-f322-4cc5-b4d1-6faa0448bdee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ff4bedb5dd44ddca88945ee4004d277', 'request_id': 'req-5839efbf-f322-4cc5-b4d1-6faa0448bdee'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:43.878930 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-5839efbf-f322-4cc5-b4d1-6faa0448bdee admin admin] The token cache is being invalidate because project 4ff4bedb5dd44ddca88945ee4004d277 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:21:43.879167 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-5839efbf-f322-4cc5-b4d1-6faa0448bdee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:43.879831 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-5839efbf-f322-4cc5-b4d1-6faa0448bdee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:43.882868 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1196/2423] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:21:43 2022] DELETE /identity/v3/projects/4ff4bedb5dd44ddca88945ee4004d277 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:21:53.153873 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:21:53.776229 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85f9f4-28b8-4d8d-b5c6-263206f332b1 service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:53.777914 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-0e85f9f4-28b8-4d8d-b5c6-263206f332b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:53.792919 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85f9f4-28b8-4d8d-b5c6-263206f332b1 service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:53.861605 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e06864-84ed-4772-b779-c32616cdb4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:53.863063 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e06864-84ed-4772-b779-c32616cdb4dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:53.863063 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e06864-84ed-4772-b779-c32616cdb4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:53.863291 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e06864-84ed-4772-b779-c32616cdb4dc admin admin] PATH_INFO: `/v3/users/33d25c43a95d4f1ea1652d71847d61ce` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:53.865171 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e06864-84ed-4772-b779-c32616cdb4dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=33d25c43a95d4f1ea1652d71847d61ce)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:53.867200 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e06864-84ed-4772-b779-c32616cdb4dc admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:53.874687 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:21:53.932411 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-85e06864-84ed-4772-b779-c32616cdb4dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33d25c43a95d4f1ea1652d71847d61ce'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:53.942586 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-85e06864-84ed-4772-b779-c32616cdb4dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33d25c43a95d4f1ea1652d71847d61ce'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:53.943648 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-85e06864-84ed-4772-b779-c32616cdb4dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33d25c43a95d4f1ea1652d71847d61ce'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:53.959984 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-85e06864-84ed-4772-b779-c32616cdb4dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33d25c43a95d4f1ea1652d71847d61ce'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:53.960718 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-85e06864-84ed-4772-b779-c32616cdb4dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33d25c43a95d4f1ea1652d71847d61ce'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:53.978776 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1228/2424] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:21:53 2022] DELETE /identity/v3/users/33d25c43a95d4f1ea1652d71847d61ce => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:21:53.983110 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e1078-474e-4b6d-b0d5-8efc7f5e280f None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:53.983392 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e1078-474e-4b6d-b0d5-8efc7f5e280f None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:53.983721 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e1078-474e-4b6d-b0d5-8efc7f5e280f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:54.003623 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-2c7e1078-474e-4b6d-b0d5-8efc7f5e280f None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:21:54.004855 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-2c7e1078-474e-4b6d-b0d5-8efc7f5e280f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:54.069981 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1197/2425] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:21:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:21:54.080803 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e06864-84ed-4772-b779-c32616cdb4dc admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:54.082438 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-85e06864-84ed-4772-b779-c32616cdb4dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:54.144967 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e06864-84ed-4772-b779-c32616cdb4dc admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:54.148747 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168a00c-9949-4808-af23-c512ca85eae6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:54.149416 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168a00c-9949-4808-af23-c512ca85eae6 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:54.149692 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168a00c-9949-4808-af23-c512ca85eae6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:54.149963 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168a00c-9949-4808-af23-c512ca85eae6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:54.160543 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0168a00c-9949-4808-af23-c512ca85eae6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:54.162004 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0168a00c-9949-4808-af23-c512ca85eae6 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:54.174101 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1229/2426] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:21:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:21:54.367035 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e1078-474e-4b6d-b0d5-8efc7f5e280f None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:54.368723 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-2c7e1078-474e-4b6d-b0d5-8efc7f5e280f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:54.388799 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e1078-474e-4b6d-b0d5-8efc7f5e280f None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:54.393579 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd86da-438e-4263-9da9-3c78738e2d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:54.394229 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd86da-438e-4263-9da9-3c78738e2d9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:54.394507 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd86da-438e-4263-9da9-3c78738e2d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:54.394787 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd86da-438e-4263-9da9-3c78738e2d9d admin admin] PATH_INFO: `/v3/projects/0e2555d95dfb411aaddf891e954b47fb` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:54.396004 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd86da-438e-4263-9da9-3c78738e2d9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e2555d95dfb411aaddf891e954b47fb)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:54.397958 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd86da-438e-4263-9da9-3c78738e2d9d admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:54.449292 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-56bd86da-438e-4263-9da9-3c78738e2d9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e2555d95dfb411aaddf891e954b47fb', 'request_id': 'req-56bd86da-438e-4263-9da9-3c78738e2d9d'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:54.455524 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-56bd86da-438e-4263-9da9-3c78738e2d9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e2555d95dfb411aaddf891e954b47fb', 'request_id': 'req-56bd86da-438e-4263-9da9-3c78738e2d9d'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:54.462920 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-56bd86da-438e-4263-9da9-3c78738e2d9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e2555d95dfb411aaddf891e954b47fb', 'request_id': 'req-56bd86da-438e-4263-9da9-3c78738e2d9d'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:54.479819 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-56bd86da-438e-4263-9da9-3c78738e2d9d admin admin] The token cache is being invalidate because project 0e2555d95dfb411aaddf891e954b47fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:21:54.480137 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-56bd86da-438e-4263-9da9-3c78738e2d9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:54.480871 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-56bd86da-438e-4263-9da9-3c78738e2d9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:21:54.486006 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1198/2427] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:21:54 2022] DELETE /identity/v3/projects/0e2555d95dfb411aaddf891e954b47fb => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:21:54.487887 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470cf40-eadc-42eb-9328-9361e05cb7d3 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:54.488179 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470cf40-eadc-42eb-9328-9361e05cb7d3 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:54.488455 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470cf40-eadc-42eb-9328-9361e05cb7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:54.509780 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-0470cf40-eadc-42eb-9328-9361e05cb7d3 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:21:54.511002 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-0470cf40-eadc-42eb-9328-9361e05cb7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:54.533259 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:21:54.589918 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1230/2428] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:21:54.591930 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f359153-2ea7-4e5f-a436-67dab2de6638 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:54.591930 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f359153-2ea7-4e5f-a436-67dab2de6638 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:54.592156 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f359153-2ea7-4e5f-a436-67dab2de6638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:54.615677 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-6f359153-2ea7-4e5f-a436-67dab2de6638 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:21:54.617069 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-6f359153-2ea7-4e5f-a436-67dab2de6638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:54.629868 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1199/2429] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:21:54.631476 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470cf40-eadc-42eb-9328-9361e05cb7d3 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:54.644113 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470cf40-eadc-42eb-9328-9361e05cb7d3 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:54.649996 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9476eedd-e755-4dda-9439-713f0f856185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:54.650638 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476eedd-e755-4dda-9439-713f0f856185 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:54.650917 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476eedd-e755-4dda-9439-713f0f856185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:54.651197 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476eedd-e755-4dda-9439-713f0f856185 admin admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:54.651946 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9476eedd-e755-4dda-9439-713f0f856185 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:21:54.652252 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9476eedd-e755-4dda-9439-713f0f856185 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:54.653860 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9476eedd-e755-4dda-9439-713f0f856185 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:54.668295 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1231/2430] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:21:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:21:54.672597 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f359153-2ea7-4e5f-a436-67dab2de6638 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:54.682402 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f359153-2ea7-4e5f-a436-67dab2de6638 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:54.687217 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984e201-d475-46a4-b944-16f43f1fff09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:54.688907 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984e201-d475-46a4-b944-16f43f1fff09 admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:54.688907 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984e201-d475-46a4-b944-16f43f1fff09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:54.688907 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984e201-d475-46a4-b944-16f43f1fff09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:54.689181 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9984e201-d475-46a4-b944-16f43f1fff09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:54.691444 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9984e201-d475-46a4-b944-16f43f1fff09 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:54.725635 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1200/2431] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:21:54 2022] POST /identity/v3/projects => generated 391 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:21:54.729677 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9476eedd-e755-4dda-9439-713f0f856185 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:54.740090 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9476eedd-e755-4dda-9439-713f0f856185 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:54.813858 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc1093-61b0-4a72-a6d4-0fee8a97654c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:54.814502 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc1093-61b0-4a72-a6d4-0fee8a97654c admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:54.814834 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc1093-61b0-4a72-a6d4-0fee8a97654c admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:54.815265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc1093-61b0-4a72-a6d4-0fee8a97654c admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:54.816286 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc1093-61b0-4a72-a6d4-0fee8a97654c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:54.819171 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc1093-61b0-4a72-a6d4-0fee8a97654c admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:54.848255 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1232/2432] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:21:54 2022] POST /identity/v3/users => generated 296 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:21:54.849432 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984e201-d475-46a4-b944-16f43f1fff09 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:54.861344 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984e201-d475-46a4-b944-16f43f1fff09 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:54.866156 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0327eaa-0abb-45d6-8510-9698d0de7d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:54.866792 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0327eaa-0abb-45d6-8510-9698d0de7d74 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:54.867073 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0327eaa-0abb-45d6-8510-9698d0de7d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:54.867346 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0327eaa-0abb-45d6-8510-9698d0de7d74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:54.868240 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0327eaa-0abb-45d6-8510-9698d0de7d74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:54.869871 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0327eaa-0abb-45d6-8510-9698d0de7d74 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:54.884412 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1201/2433] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:21:54.885674 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc1093-61b0-4a72-a6d4-0fee8a97654c admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:54.897040 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc1093-61b0-4a72-a6d4-0fee8a97654c admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:54.901799 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949186d-f2b2-460c-9f39-461cac9b3ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:54.902551 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949186d-f2b2-460c-9f39-461cac9b3ddc admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:54.902787 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949186d-f2b2-460c-9f39-461cac9b3ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:54.902993 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949186d-f2b2-460c-9f39-461cac9b3ddc admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:54.903702 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949186d-f2b2-460c-9f39-461cac9b3ddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:54.905339 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949186d-f2b2-460c-9f39-461cac9b3ddc admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:54.917477 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1233/2434] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:21:54.922054 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0327eaa-0abb-45d6-8510-9698d0de7d74 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:54.940808 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0327eaa-0abb-45d6-8510-9698d0de7d74 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:54.948610 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64432282-86ec-4cdd-9a91-9d973e48bee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:54.949948 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64432282-86ec-4cdd-9a91-9d973e48bee7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:54.950585 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64432282-86ec-4cdd-9a91-9d973e48bee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:54.951255 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64432282-86ec-4cdd-9a91-9d973e48bee7 admin admin] PATH_INFO: `/v3/projects/864349f4622e4deab77afd3d19d6fe53/users/e54126de844549b4997620ad1845ce9e/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:54.971044 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64432282-86ec-4cdd-9a91-9d973e48bee7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=864349f4622e4deab77afd3d19d6fe53, user_id=e54126de844549b4997620ad1845ce9e, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:54.974371 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64432282-86ec-4cdd-9a91-9d973e48bee7 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:54.992159 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1202/2435] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:21:54 2022] PUT /identity/v3/projects/864349f4622e4deab77afd3d19d6fe53/users/e54126de844549b4997620ad1845ce9e/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:21:55.006561 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e6ea1-3b3e-4c3f-824c-3435e15ef00e None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:55.007108 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e6ea1-3b3e-4c3f-824c-3435e15ef00e None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:55.008185 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e6ea1-3b3e-4c3f-824c-3435e15ef00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:55.048996 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-987e6ea1-3b3e-4c3f-824c-3435e15ef00e None None] MFA Rules not processed for user `e54126de844549b4997620ad1845ce9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:21:55.050521 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-987e6ea1-3b3e-4c3f-824c-3435e15ef00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:55.141812 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64432282-86ec-4cdd-9a91-9d973e48bee7 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:55.145379 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1234/2436] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:21:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:21:55.181722 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:21:55.271454 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64432282-86ec-4cdd-9a91-9d973e48bee7 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:55.279082 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0569257-f524-4a3b-a4a3-b777832528b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:55.279850 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0569257-f524-4a3b-a4a3-b777832528b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:55.280197 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0569257-f524-4a3b-a4a3-b777832528b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:55.280543 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0569257-f524-4a3b-a4a3-b777832528b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:55.281381 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0569257-f524-4a3b-a4a3-b777832528b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:55.283871 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0569257-f524-4a3b-a4a3-b777832528b8 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:55.360160 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1203/2437] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:21:55 2022] POST /identity/v3/projects => generated 393 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:21:55.363961 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e6ea1-3b3e-4c3f-824c-3435e15ef00e None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:55.383461 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e6ea1-3b3e-4c3f-824c-3435e15ef00e None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:55.409693 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:21:55.475820 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f00d83-26d2-432c-83fc-dd366a629f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:55.476595 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f00d83-26d2-432c-83fc-dd366a629f90 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:55.477567 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f00d83-26d2-432c-83fc-dd366a629f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:55.477965 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f00d83-26d2-432c-83fc-dd366a629f90 admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:55.478781 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f00d83-26d2-432c-83fc-dd366a629f90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:55.482130 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f00d83-26d2-432c-83fc-dd366a629f90 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:55.515146 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1235/2438] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:21:55 2022] POST /identity/v3/users => generated 303 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:21:55.519159 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0569257-f524-4a3b-a4a3-b777832528b8 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:55.537635 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0569257-f524-4a3b-a4a3-b777832528b8 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:55.546135 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf8eae8-0b57-4bd5-9f7b-1ee31e25ba9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:55.547032 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8eae8-0b57-4bd5-9f7b-1ee31e25ba9c admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:55.547318 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8eae8-0b57-4bd5-9f7b-1ee31e25ba9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:55.547631 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8eae8-0b57-4bd5-9f7b-1ee31e25ba9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:55.548357 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf8eae8-0b57-4bd5-9f7b-1ee31e25ba9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:55.550093 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf8eae8-0b57-4bd5-9f7b-1ee31e25ba9c admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:55.569333 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1204/2439] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:21:55.573559 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f00d83-26d2-432c-83fc-dd366a629f90 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:55.584355 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f00d83-26d2-432c-83fc-dd366a629f90 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:55.589218 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508add93-1595-4160-a01f-a7dcbddd8e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:55.589921 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508add93-1595-4160-a01f-a7dcbddd8e82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:55.590202 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508add93-1595-4160-a01f-a7dcbddd8e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:55.590476 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508add93-1595-4160-a01f-a7dcbddd8e82 admin admin] PATH_INFO: `/v3/projects/3bf4b02be340496e91822b9dda7ddc22/users/18c3dc1f37af437788825676f3841960/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:55.609618 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508add93-1595-4160-a01f-a7dcbddd8e82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bf4b02be340496e91822b9dda7ddc22, user_id=18c3dc1f37af437788825676f3841960, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:55.613012 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508add93-1595-4160-a01f-a7dcbddd8e82 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:55.636252 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1236/2440] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:21:55 2022] PUT /identity/v3/projects/3bf4b02be340496e91822b9dda7ddc22/users/18c3dc1f37af437788825676f3841960/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:21:55.640120 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf8eae8-0b57-4bd5-9f7b-1ee31e25ba9c admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:55.651113 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf8eae8-0b57-4bd5-9f7b-1ee31e25ba9c admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:55.737795 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff660b-f0c4-4bdc-8b08-7fb932659faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:55.738547 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff660b-f0c4-4bdc-8b08-7fb932659faa admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:55.738893 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff660b-f0c4-4bdc-8b08-7fb932659faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:55.739232 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff660b-f0c4-4bdc-8b08-7fb932659faa admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:55.740107 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff660b-f0c4-4bdc-8b08-7fb932659faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:55.741854 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff660b-f0c4-4bdc-8b08-7fb932659faa admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:55.755730 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1205/2441] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:21:55.759729 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508add93-1595-4160-a01f-a7dcbddd8e82 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:55.771056 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508add93-1595-4160-a01f-a7dcbddd8e82 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:55.776009 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afcf23e-fa5a-49d2-acad-e96c20d713ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:55.776699 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afcf23e-fa5a-49d2-acad-e96c20d713ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:55.776982 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afcf23e-fa5a-49d2-acad-e96c20d713ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:55.777255 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afcf23e-fa5a-49d2-acad-e96c20d713ba admin admin] PATH_INFO: `/v3/projects/3bf4b02be340496e91822b9dda7ddc22/users/18c3dc1f37af437788825676f3841960/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:55.779723 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afcf23e-fa5a-49d2-acad-e96c20d713ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bf4b02be340496e91822b9dda7ddc22, user_id=18c3dc1f37af437788825676f3841960, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:55.782147 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afcf23e-fa5a-49d2-acad-e96c20d713ba admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:55.795065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1237/2442] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:21:55 2022] PUT /identity/v3/projects/3bf4b02be340496e91822b9dda7ddc22/users/18c3dc1f37af437788825676f3841960/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:21:55.806440 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41d1dc-01fa-4b87-9931-246a03898585 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:55.806727 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41d1dc-01fa-4b87-9931-246a03898585 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:55.807700 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41d1dc-01fa-4b87-9931-246a03898585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:55.839397 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-8e41d1dc-01fa-4b87-9931-246a03898585 None None] MFA Rules not processed for user `18c3dc1f37af437788825676f3841960`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:21:55.840775 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-8e41d1dc-01fa-4b87-9931-246a03898585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:55.992364 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1206/2443] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:21:55 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:21:56.006063 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afcf23e-fa5a-49d2-acad-e96c20d713ba admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:56.008537 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-0afcf23e-fa5a-49d2-acad-e96c20d713ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:56.117553 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afcf23e-fa5a-49d2-acad-e96c20d713ba admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:56.126003 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee307e4-7f3b-4258-88ad-0def559dca3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:56.126964 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee307e4-7f3b-4258-88ad-0def559dca3f service nova] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:56.128685 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee307e4-7f3b-4258-88ad-0def559dca3f service nova] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:56.129181 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee307e4-7f3b-4258-88ad-0def559dca3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:56.208525 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee307e4-7f3b-4258-88ad-0def559dca3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:56.213240 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee307e4-7f3b-4258-88ad-0def559dca3f service nova] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:56.224450 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1238/2444] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:21:56 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:21:59.998937 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e41d1dc-01fa-4b87-9931-246a03898585 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:22:00.001139 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-8e41d1dc-01fa-4b87-9931-246a03898585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:22:00.026309 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:22:00.078746 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e41d1dc-01fa-4b87-9931-246a03898585 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:22:00.083338 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec267c4-3ccd-4c3b-b380-3deeb9bdad8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:22:00.084026 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec267c4-3ccd-4c3b-b380-3deeb9bdad8a service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:00.084304 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec267c4-3ccd-4c3b-b380-3deeb9bdad8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:00.084579 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec267c4-3ccd-4c3b-b380-3deeb9bdad8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:00.094877 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec267c4-3ccd-4c3b-b380-3deeb9bdad8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:22:00.096567 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec267c4-3ccd-4c3b-b380-3deeb9bdad8a service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:22:00.107977 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1207/2445] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:21:59 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:22:04.392365 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dc9a8-4d61-44b2-8bb8-1e7b06903dd5 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:04.392961 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dc9a8-4d61-44b2-8bb8-1e7b06903dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:04.393457 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dc9a8-4d61-44b2-8bb8-1e7b06903dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:04.408083 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:22:04.422643 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-cc6dc9a8-4d61-44b2-8bb8-1e7b06903dd5 None None] MFA Rules not processed for user `e54126de844549b4997620ad1845ce9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:22:04.424394 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-cc6dc9a8-4d61-44b2-8bb8-1e7b06903dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:22:04.438266 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1239/2446] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:22:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:22:05.248484 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec267c4-3ccd-4c3b-b380-3deeb9bdad8a service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:22:05.261590 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec267c4-3ccd-4c3b-b380-3deeb9bdad8a service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:22:05.266778 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60174610-589b-470a-8708-c6d895ea532e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:22:05.267447 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60174610-589b-470a-8708-c6d895ea532e service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:05.268142 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60174610-589b-470a-8708-c6d895ea532e service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:05.268627 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60174610-589b-470a-8708-c6d895ea532e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:05.271466 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-60174610-589b-470a-8708-c6d895ea532e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:22:05.288895 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60174610-589b-470a-8708-c6d895ea532e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:22:05.291742 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60174610-589b-470a-8708-c6d895ea532e service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:22:05.308635 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1208/2447] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:22:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:22:06.397767 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6dc9a8-4d61-44b2-8bb8-1e7b06903dd5 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:22:06.439019 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6dc9a8-4d61-44b2-8bb8-1e7b06903dd5 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:22:06.451851 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a84d4-8feb-4f40-a52a-fa4890f5ce6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:22:06.452857 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a84d4-8feb-4f40-a52a-fa4890f5ce6d service nova] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:06.453324 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a84d4-8feb-4f40-a52a-fa4890f5ce6d service nova] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:06.453750 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a84d4-8feb-4f40-a52a-fa4890f5ce6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:06.455915 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-d99a84d4-8feb-4f40-a52a-fa4890f5ce6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:22:06.496048 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a84d4-8feb-4f40-a52a-fa4890f5ce6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:22:06.498810 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a84d4-8feb-4f40-a52a-fa4890f5ce6d service nova] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:22:06.514903 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1240/2448] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:22:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:22:15.214376 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60174610-589b-470a-8708-c6d895ea532e service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:22:15.218265 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-60174610-589b-470a-8708-c6d895ea532e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:22:15.301297 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60174610-589b-470a-8708-c6d895ea532e service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:22:15.306064 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d503d-e3bb-4b23-9fd2-14f8d95a6d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:22:15.306731 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d503d-e3bb-4b23-9fd2-14f8d95a6d4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:15.307008 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d503d-e3bb-4b23-9fd2-14f8d95a6d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:15.307282 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d503d-e3bb-4b23-9fd2-14f8d95a6d4d admin admin] PATH_INFO: `/v3/users/918c83000b924c55bb862db07d9becb6` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:15.308725 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8d503d-e3bb-4b23-9fd2-14f8d95a6d4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=918c83000b924c55bb862db07d9becb6)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:22:15.310700 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8d503d-e3bb-4b23-9fd2-14f8d95a6d4d admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:22:15.403960 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-bf8d503d-e3bb-4b23-9fd2-14f8d95a6d4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '918c83000b924c55bb862db07d9becb6'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:22:15.404713 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-bf8d503d-e3bb-4b23-9fd2-14f8d95a6d4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '918c83000b924c55bb862db07d9becb6'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:22:15.423570 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-bf8d503d-e3bb-4b23-9fd2-14f8d95a6d4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '918c83000b924c55bb862db07d9becb6'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:22:15.434596 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-bf8d503d-e3bb-4b23-9fd2-14f8d95a6d4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '918c83000b924c55bb862db07d9becb6'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:22:15.435404 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-bf8d503d-e3bb-4b23-9fd2-14f8d95a6d4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '918c83000b924c55bb862db07d9becb6'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:22:15.449344 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1209/2449] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:22:15 2022] DELETE /identity/v3/users/918c83000b924c55bb862db07d9becb6 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:22:15.454239 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5c9a2-58d9-479d-94d7-e8a6bd2d36ba None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:15.454846 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5c9a2-58d9-479d-94d7-e8a6bd2d36ba None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:15.454846 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5c9a2-58d9-479d-94d7-e8a6bd2d36ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:15.475461 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-6ef5c9a2-58d9-479d-94d7-e8a6bd2d36ba None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:22:15.476814 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-6ef5c9a2-58d9-479d-94d7-e8a6bd2d36ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:22:15.544667 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1241/2450] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:22:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:22:15.555203 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d503d-e3bb-4b23-9fd2-14f8d95a6d4d admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:22:15.556884 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-bf8d503d-e3bb-4b23-9fd2-14f8d95a6d4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:22:15.593227 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:22:15.637298 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d503d-e3bb-4b23-9fd2-14f8d95a6d4d admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:22:15.641195 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07fcc6-e105-4d93-a567-3f38fb0bfd0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:22:15.641920 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07fcc6-e105-4d93-a567-3f38fb0bfd0b service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:15.642328 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07fcc6-e105-4d93-a567-3f38fb0bfd0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:15.642746 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07fcc6-e105-4d93-a567-3f38fb0bfd0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:15.656400 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f07fcc6-e105-4d93-a567-3f38fb0bfd0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:22:15.658000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f07fcc6-e105-4d93-a567-3f38fb0bfd0b service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:22:15.668803 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1210/2451] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:22:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:22:15.852770 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5c9a2-58d9-479d-94d7-e8a6bd2d36ba None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:22:15.854501 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-6ef5c9a2-58d9-479d-94d7-e8a6bd2d36ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:22:15.875332 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5c9a2-58d9-479d-94d7-e8a6bd2d36ba None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:22:15.896578 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b4aaa-8be3-44ce-9d2d-a774c3bc7de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:22:15.896578 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b4aaa-8be3-44ce-9d2d-a774c3bc7de8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:15.896578 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b4aaa-8be3-44ce-9d2d-a774c3bc7de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:15.902590 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b4aaa-8be3-44ce-9d2d-a774c3bc7de8 admin admin] PATH_INFO: `/v3/projects/93e7d61b3f334a7a9b20912dfc71a0df` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:15.904187 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b4aaa-8be3-44ce-9d2d-a774c3bc7de8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93e7d61b3f334a7a9b20912dfc71a0df)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:22:15.914370 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b4aaa-8be3-44ce-9d2d-a774c3bc7de8 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:22:15.995849 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-514b4aaa-8be3-44ce-9d2d-a774c3bc7de8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93e7d61b3f334a7a9b20912dfc71a0df', 'request_id': 'req-514b4aaa-8be3-44ce-9d2d-a774c3bc7de8'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:22:16.003664 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-514b4aaa-8be3-44ce-9d2d-a774c3bc7de8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93e7d61b3f334a7a9b20912dfc71a0df', 'request_id': 'req-514b4aaa-8be3-44ce-9d2d-a774c3bc7de8'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:22:16.025264 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-514b4aaa-8be3-44ce-9d2d-a774c3bc7de8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93e7d61b3f334a7a9b20912dfc71a0df', 'request_id': 'req-514b4aaa-8be3-44ce-9d2d-a774c3bc7de8'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:22:16.052129 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-514b4aaa-8be3-44ce-9d2d-a774c3bc7de8 admin admin] The token cache is being invalidate because project 93e7d61b3f334a7a9b20912dfc71a0df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:22:16.052642 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-514b4aaa-8be3-44ce-9d2d-a774c3bc7de8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:22:16.053531 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-514b4aaa-8be3-44ce-9d2d-a774c3bc7de8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:22:16.056175 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1242/2452] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:22:15 2022] DELETE /identity/v3/projects/93e7d61b3f334a7a9b20912dfc71a0df => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:22:16.069392 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2fd5b-cc73-4bd6-bf46-6ed393ef5a6a None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:16.070658 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2fd5b-cc73-4bd6-bf46-6ed393ef5a6a None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:16.071573 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2fd5b-cc73-4bd6-bf46-6ed393ef5a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:16.112451 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-cbf2fd5b-cc73-4bd6-bf46-6ed393ef5a6a None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:22:16.113737 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-cbf2fd5b-cc73-4bd6-bf46-6ed393ef5a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:22:16.211677 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1211/2453] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:22:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:22:16.214873 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e007a53-a4de-444d-8216-4e364d954df7 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:16.215535 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e007a53-a4de-444d-8216-4e364d954df7 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:16.216673 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e007a53-a4de-444d-8216-4e364d954df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:16.244804 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-9e007a53-a4de-444d-8216-4e364d954df7 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:22:16.246196 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-9e007a53-a4de-444d-8216-4e364d954df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:22:16.256815 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1243/2454] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:22:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:22:16.260924 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf2fd5b-cc73-4bd6-bf46-6ed393ef5a6a None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:22:16.274080 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf2fd5b-cc73-4bd6-bf46-6ed393ef5a6a None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:22:16.281946 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24079d-9569-4136-80fd-409c78aaa549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:22:16.282729 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24079d-9569-4136-80fd-409c78aaa549 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:16.283891 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24079d-9569-4136-80fd-409c78aaa549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:16.284269 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24079d-9569-4136-80fd-409c78aaa549 admin admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:16.285646 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b24079d-9569-4136-80fd-409c78aaa549 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:22:16.286025 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b24079d-9569-4136-80fd-409c78aaa549 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:22:16.287824 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b24079d-9569-4136-80fd-409c78aaa549 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:22:16.301186 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1212/2455] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:22:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:22:16.306123 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e007a53-a4de-444d-8216-4e364d954df7 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:22:16.318229 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e007a53-a4de-444d-8216-4e364d954df7 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:22:16.325262 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7004d-a046-44b2-8440-2b121b1363fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:22:16.325920 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7004d-a046-44b2-8440-2b121b1363fd admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:16.326184 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7004d-a046-44b2-8440-2b121b1363fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:16.326459 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7004d-a046-44b2-8440-2b121b1363fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:16.327136 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b7004d-a046-44b2-8440-2b121b1363fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:22:16.329092 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b7004d-a046-44b2-8440-2b121b1363fd admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:22:16.368176 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1244/2456] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:22:16 2022] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:22:16.373207 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24079d-9569-4136-80fd-409c78aaa549 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:22:16.385878 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24079d-9569-4136-80fd-409c78aaa549 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:22:16.452138 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3de536-987f-4164-ae8c-e1ab11ded665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:22:16.452779 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3de536-987f-4164-ae8c-e1ab11ded665 admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:16.453054 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3de536-987f-4164-ae8c-e1ab11ded665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:16.453403 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3de536-987f-4164-ae8c-e1ab11ded665 admin admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:16.454116 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3de536-987f-4164-ae8c-e1ab11ded665 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:22:16.456880 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3de536-987f-4164-ae8c-e1ab11ded665 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:22:16.483479 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1213/2457] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:22:16 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:22:16.485007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7004d-a046-44b2-8440-2b121b1363fd admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:22:16.496185 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7004d-a046-44b2-8440-2b121b1363fd admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:22:16.501251 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c40fdd-ca4e-450b-877e-3c1c23ff84c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:22:16.501916 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c40fdd-ca4e-450b-877e-3c1c23ff84c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:16.502278 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c40fdd-ca4e-450b-877e-3c1c23ff84c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:16.502566 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c40fdd-ca4e-450b-877e-3c1c23ff84c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:16.503268 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c40fdd-ca4e-450b-877e-3c1c23ff84c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:22:16.505545 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c40fdd-ca4e-450b-877e-3c1c23ff84c8 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:22:16.516734 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1245/2458] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:22:16.521168 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3de536-987f-4164-ae8c-e1ab11ded665 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:22:16.531696 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3de536-987f-4164-ae8c-e1ab11ded665 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:22:16.536904 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b4b31-a2e6-4044-bcd6-9a74f86bb5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:22:16.537535 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b4b31-a2e6-4044-bcd6-9a74f86bb5fd admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:16.537842 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b4b31-a2e6-4044-bcd6-9a74f86bb5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:16.538089 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b4b31-a2e6-4044-bcd6-9a74f86bb5fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:16.538809 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b4b31-a2e6-4044-bcd6-9a74f86bb5fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:22:16.540485 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b4b31-a2e6-4044-bcd6-9a74f86bb5fd admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:22:16.552449 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1214/2459] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:22:16.556910 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c40fdd-ca4e-450b-877e-3c1c23ff84c8 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:22:16.567521 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c40fdd-ca4e-450b-877e-3c1c23ff84c8 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:22:16.572518 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d205a3-034a-41c4-9887-afed14cf69ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:22:16.573185 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d205a3-034a-41c4-9887-afed14cf69ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:16.573456 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d205a3-034a-41c4-9887-afed14cf69ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:16.573722 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d205a3-034a-41c4-9887-afed14cf69ca admin admin] PATH_INFO: `/v3/projects/8c579cceee0048dd9c09d031406fcfba/users/6c59c25b2c3b433c89ba6ae4ea1ef196/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:16.590026 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d205a3-034a-41c4-9887-afed14cf69ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c579cceee0048dd9c09d031406fcfba, user_id=6c59c25b2c3b433c89ba6ae4ea1ef196, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:22:16.592725 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d205a3-034a-41c4-9887-afed14cf69ca admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:22:16.606716 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1246/2460] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:22:16 2022] PUT /identity/v3/projects/8c579cceee0048dd9c09d031406fcfba/users/6c59c25b2c3b433c89ba6ae4ea1ef196/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:22:16.616861 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26427e26-92e0-4983-9c22-9a859b237d42 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:16.617148 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26427e26-92e0-4983-9c22-9a859b237d42 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:16.617442 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26427e26-92e0-4983-9c22-9a859b237d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:16.645272 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-26427e26-92e0-4983-9c22-9a859b237d42 None None] MFA Rules not processed for user `6c59c25b2c3b433c89ba6ae4ea1ef196`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:22:16.646486 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-26427e26-92e0-4983-9c22-9a859b237d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:22:16.667972 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:22:16.714654 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1215/2461] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:22:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:22:16.725045 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d205a3-034a-41c4-9887-afed14cf69ca admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:22:16.728003 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-c9d205a3-034a-41c4-9887-afed14cf69ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:22:16.742860 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:22:16.789941 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d205a3-034a-41c4-9887-afed14cf69ca admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:22:16.794018 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494d7f9-e7a1-4516-87a8-594a07ee69d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:22:16.794682 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494d7f9-e7a1-4516-87a8-594a07ee69d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:16.794968 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494d7f9-e7a1-4516-87a8-594a07ee69d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:16.795303 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494d7f9-e7a1-4516-87a8-594a07ee69d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:16.804482 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494d7f9-e7a1-4516-87a8-594a07ee69d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:22:16.805934 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494d7f9-e7a1-4516-87a8-594a07ee69d1 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:22:16.815602 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1247/2462] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:22:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:22:26.711389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=17 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:22:26.810984 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=23 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:22:27.021326 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb21e7-8109-43cd-8eeb-914cc2715dcb None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:27.021800 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb21e7-8109-43cd-8eeb-914cc2715dcb None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:27.022228 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb21e7-8109-43cd-8eeb-914cc2715dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:27.060286 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-9ecb21e7-8109-43cd-8eeb-914cc2715dcb None None] MFA Rules not processed for user `9e467b255bf54ded9815e902e99b41df`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:22:27.065859 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-9ecb21e7-8109-43cd-8eeb-914cc2715dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:22:27.149851 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1216/2463] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:22:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:22:36.067957 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494d7f9-e7a1-4516-87a8-594a07ee69d1 service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:22:36.145732 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494d7f9-e7a1-4516-87a8-594a07ee69d1 service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:22:36.150498 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc59596-1a9f-4adf-a62a-29845e21af45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:22:36.151260 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc59596-1a9f-4adf-a62a-29845e21af45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:36.151642 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc59596-1a9f-4adf-a62a-29845e21af45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:36.152064 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc59596-1a9f-4adf-a62a-29845e21af45 admin admin] PATH_INFO: `/v3/users/6c59c25b2c3b433c89ba6ae4ea1ef196` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:36.154051 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc59596-1a9f-4adf-a62a-29845e21af45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c59c25b2c3b433c89ba6ae4ea1ef196)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:22:36.155513 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc59596-1a9f-4adf-a62a-29845e21af45 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:22:36.228589 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-dbc59596-1a9f-4adf-a62a-29845e21af45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c59c25b2c3b433c89ba6ae4ea1ef196'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:22:36.235642 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-dbc59596-1a9f-4adf-a62a-29845e21af45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c59c25b2c3b433c89ba6ae4ea1ef196'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:22:36.236352 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-dbc59596-1a9f-4adf-a62a-29845e21af45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c59c25b2c3b433c89ba6ae4ea1ef196'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:22:36.249469 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-dbc59596-1a9f-4adf-a62a-29845e21af45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c59c25b2c3b433c89ba6ae4ea1ef196'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:22:36.250134 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-dbc59596-1a9f-4adf-a62a-29845e21af45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c59c25b2c3b433c89ba6ae4ea1ef196'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:22:36.264385 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1248/2464] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:22:36 2022] DELETE /identity/v3/users/6c59c25b2c3b433c89ba6ae4ea1ef196 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:22:36.268887 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b080f-220f-4eb3-8562-72b40be65c35 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:36.269373 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b080f-220f-4eb3-8562-72b40be65c35 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:36.269460 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b080f-220f-4eb3-8562-72b40be65c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:36.289481 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-ff4b080f-220f-4eb3-8562-72b40be65c35 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:22:36.290801 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-ff4b080f-220f-4eb3-8562-72b40be65c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:22:36.360392 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1217/2465] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:22:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:22:36.371553 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc59596-1a9f-4adf-a62a-29845e21af45 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:22:36.373487 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-dbc59596-1a9f-4adf-a62a-29845e21af45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:22:36.434296 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc59596-1a9f-4adf-a62a-29845e21af45 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:22:36.438084 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f1e81-450e-468a-a84b-c5c42dab2b28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:22:36.438911 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f1e81-450e-468a-a84b-c5c42dab2b28 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:36.439193 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f1e81-450e-468a-a84b-c5c42dab2b28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:36.439468 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f1e81-450e-468a-a84b-c5c42dab2b28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:36.449042 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0f1e81-450e-468a-a84b-c5c42dab2b28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:22:36.450571 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0f1e81-450e-468a-a84b-c5c42dab2b28 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:22:36.460909 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1249/2466] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:22:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:22:36.641669 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b080f-220f-4eb3-8562-72b40be65c35 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:22:36.643193 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-ff4b080f-220f-4eb3-8562-72b40be65c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:22:36.659308 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b080f-220f-4eb3-8562-72b40be65c35 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:22:36.664956 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5070142-170d-4e36-8827-73322640af38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:22:36.665719 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5070142-170d-4e36-8827-73322640af38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:36.666005 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5070142-170d-4e36-8827-73322640af38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:36.666282 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5070142-170d-4e36-8827-73322640af38 admin admin] PATH_INFO: `/v3/projects/8c579cceee0048dd9c09d031406fcfba` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:36.667589 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5070142-170d-4e36-8827-73322640af38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c579cceee0048dd9c09d031406fcfba)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:22:36.669592 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5070142-170d-4e36-8827-73322640af38 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:22:36.718610 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-c5070142-170d-4e36-8827-73322640af38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c579cceee0048dd9c09d031406fcfba', 'request_id': 'req-c5070142-170d-4e36-8827-73322640af38'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:22:36.724281 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-c5070142-170d-4e36-8827-73322640af38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c579cceee0048dd9c09d031406fcfba', 'request_id': 'req-c5070142-170d-4e36-8827-73322640af38'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:22:36.730620 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-c5070142-170d-4e36-8827-73322640af38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c579cceee0048dd9c09d031406fcfba', 'request_id': 'req-c5070142-170d-4e36-8827-73322640af38'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:22:36.745088 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-c5070142-170d-4e36-8827-73322640af38 admin admin] The token cache is being invalidate because project 8c579cceee0048dd9c09d031406fcfba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:22:36.745379 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-c5070142-170d-4e36-8827-73322640af38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:22:36.746064 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-c5070142-170d-4e36-8827-73322640af38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:22:36.748093 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1218/2467] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:22:36 2022] DELETE /identity/v3/projects/8c579cceee0048dd9c09d031406fcfba => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:22:36.753144 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39991a-8b22-462e-8bd1-3c33478f6fac None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:36.753372 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39991a-8b22-462e-8bd1-3c33478f6fac None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:36.753645 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39991a-8b22-462e-8bd1-3c33478f6fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:36.773301 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-7a39991a-8b22-462e-8bd1-3c33478f6fac None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:22:36.774507 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-7a39991a-8b22-462e-8bd1-3c33478f6fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:22:36.792209 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:22:36.836493 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1250/2468] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:22:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:22:36.845708 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90308bbb-468b-4359-bbaa-094734f99c13 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:36.845988 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90308bbb-468b-4359-bbaa-094734f99c13 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:36.846262 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90308bbb-468b-4359-bbaa-094734f99c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:36.873238 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-90308bbb-468b-4359-bbaa-094734f99c13 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:22:36.874493 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-90308bbb-468b-4359-bbaa-094734f99c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:22:36.883443 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1219/2469] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:22:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:22:36.889159 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39991a-8b22-462e-8bd1-3c33478f6fac None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:22:36.900068 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39991a-8b22-462e-8bd1-3c33478f6fac None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:22:36.905636 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32419780-98eb-4168-9c66-73bbc746e74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:22:36.906249 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32419780-98eb-4168-9c66-73bbc746e74e admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:36.906528 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32419780-98eb-4168-9c66-73bbc746e74e admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:36.906799 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32419780-98eb-4168-9c66-73bbc746e74e admin admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:36.907712 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32419780-98eb-4168-9c66-73bbc746e74e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:22:36.908019 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32419780-98eb-4168-9c66-73bbc746e74e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:22:36.909635 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32419780-98eb-4168-9c66-73bbc746e74e admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:22:36.922094 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1251/2470] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:22:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:22:36.926597 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90308bbb-468b-4359-bbaa-094734f99c13 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:22:36.936405 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90308bbb-468b-4359-bbaa-094734f99c13 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:22:36.942482 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c297304-bf19-4082-8911-d98296b57ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:22:36.943102 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c297304-bf19-4082-8911-d98296b57ec7 admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:36.943362 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c297304-bf19-4082-8911-d98296b57ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:36.943730 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c297304-bf19-4082-8911-d98296b57ec7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:36.944407 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c297304-bf19-4082-8911-d98296b57ec7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:22:36.946299 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c297304-bf19-4082-8911-d98296b57ec7 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:22:36.969889 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:22:36.978122 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1220/2471] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:22:36 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:22:36.982234 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32419780-98eb-4168-9c66-73bbc746e74e admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:22:36.992460 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32419780-98eb-4168-9c66-73bbc746e74e admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:22:37.052995 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ede71-aec6-42fe-9a46-6555fbe84293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:22:37.053543 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ede71-aec6-42fe-9a46-6555fbe84293 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:37.053824 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ede71-aec6-42fe-9a46-6555fbe84293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:37.054148 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ede71-aec6-42fe-9a46-6555fbe84293 admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:37.054847 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ede71-aec6-42fe-9a46-6555fbe84293 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:22:37.056898 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ede71-aec6-42fe-9a46-6555fbe84293 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:22:37.081107 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1252/2472] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:22:36 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:22:37.085264 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c297304-bf19-4082-8911-d98296b57ec7 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:22:37.097468 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c297304-bf19-4082-8911-d98296b57ec7 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:22:37.103902 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f503cf-5266-457d-80a9-434be1a0b8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:22:37.104526 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f503cf-5266-457d-80a9-434be1a0b8f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:37.104801 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f503cf-5266-457d-80a9-434be1a0b8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:37.105190 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f503cf-5266-457d-80a9-434be1a0b8f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:37.105919 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f503cf-5266-457d-80a9-434be1a0b8f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:22:37.107571 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f503cf-5266-457d-80a9-434be1a0b8f0 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:22:37.119278 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1221/2473] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:22:37.125449 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ede71-aec6-42fe-9a46-6555fbe84293 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:22:37.136127 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ede71-aec6-42fe-9a46-6555fbe84293 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:22:37.141089 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee04eb-0fec-4ec8-9999-648fd8fa1482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:22:37.141667 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee04eb-0fec-4ec8-9999-648fd8fa1482 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:37.142326 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee04eb-0fec-4ec8-9999-648fd8fa1482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:37.142605 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee04eb-0fec-4ec8-9999-648fd8fa1482 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:37.143312 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee04eb-0fec-4ec8-9999-648fd8fa1482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:22:37.144965 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee04eb-0fec-4ec8-9999-648fd8fa1482 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:22:37.156835 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1253/2474] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:22:37.161923 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f503cf-5266-457d-80a9-434be1a0b8f0 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:22:37.179855 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f503cf-5266-457d-80a9-434be1a0b8f0 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:22:37.187714 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234ef78-4372-4c5c-a383-4a34c4f61904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:22:37.188778 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234ef78-4372-4c5c-a383-4a34c4f61904 admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:37.189065 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234ef78-4372-4c5c-a383-4a34c4f61904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:37.189353 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234ef78-4372-4c5c-a383-4a34c4f61904 admin admin] PATH_INFO: `/v3/projects/593bb214d8504c1486ddfab80b5f44bf/users/bfdc01e6ab144ee8a786271500893089/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:37.204602 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b234ef78-4372-4c5c-a383-4a34c4f61904 admin admin] RBAC: Authorizing `identity:create_grant(project_id=593bb214d8504c1486ddfab80b5f44bf, user_id=bfdc01e6ab144ee8a786271500893089, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:22:37.207264 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b234ef78-4372-4c5c-a383-4a34c4f61904 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:22:37.221636 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1222/2475] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:22:37 2022] PUT /identity/v3/projects/593bb214d8504c1486ddfab80b5f44bf/users/bfdc01e6ab144ee8a786271500893089/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:22:37.231610 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c37a04-cd0c-4bff-a4dc-ae428fb5e161 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:37.231905 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c37a04-cd0c-4bff-a4dc-ae428fb5e161 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:37.232178 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c37a04-cd0c-4bff-a4dc-ae428fb5e161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:37.262082 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-d1c37a04-cd0c-4bff-a4dc-ae428fb5e161 None None] MFA Rules not processed for user `bfdc01e6ab144ee8a786271500893089`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:22:37.263304 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-d1c37a04-cd0c-4bff-a4dc-ae428fb5e161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:22:37.329710 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1254/2476] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:22:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:22:37.340556 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234ef78-4372-4c5c-a383-4a34c4f61904 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:22:37.342391 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-b234ef78-4372-4c5c-a383-4a34c4f61904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:22:37.405333 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234ef78-4372-4c5c-a383-4a34c4f61904 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:22:37.409059 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1f6b8-20da-4ff2-833e-472bbb76b587 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:22:37.409684 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1f6b8-20da-4ff2-833e-472bbb76b587 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:37.409959 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1f6b8-20da-4ff2-833e-472bbb76b587 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:37.410228 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1f6b8-20da-4ff2-833e-472bbb76b587 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:37.418515 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f1f6b8-20da-4ff2-833e-472bbb76b587 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:22:37.420004 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f1f6b8-20da-4ff2-833e-472bbb76b587 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:22:37.428937 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1223/2477] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:22:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:22:37.770985 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c37a04-cd0c-4bff-a4dc-ae428fb5e161 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:22:37.798075 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:22:37.844457 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c37a04-cd0c-4bff-a4dc-ae428fb5e161 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:22:37.849540 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5804814-e245-4e8d-b666-e74b9f734959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:22:37.850168 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5804814-e245-4e8d-b666-e74b9f734959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:37.850460 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5804814-e245-4e8d-b666-e74b9f734959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:37.850734 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5804814-e245-4e8d-b666-e74b9f734959 admin admin] PATH_INFO: `/v3/users/bfdc01e6ab144ee8a786271500893089` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:37.851964 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5804814-e245-4e8d-b666-e74b9f734959 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfdc01e6ab144ee8a786271500893089)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:22:37.853915 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5804814-e245-4e8d-b666-e74b9f734959 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:22:37.903103 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-d5804814-e245-4e8d-b666-e74b9f734959 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfdc01e6ab144ee8a786271500893089'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:22:37.910207 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-d5804814-e245-4e8d-b666-e74b9f734959 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfdc01e6ab144ee8a786271500893089'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:22:37.910896 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-d5804814-e245-4e8d-b666-e74b9f734959 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfdc01e6ab144ee8a786271500893089'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:22:37.922700 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-d5804814-e245-4e8d-b666-e74b9f734959 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfdc01e6ab144ee8a786271500893089'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:22:37.923368 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-d5804814-e245-4e8d-b666-e74b9f734959 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfdc01e6ab144ee8a786271500893089'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:22:37.936910 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1255/2478] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:22:37 2022] DELETE /identity/v3/users/bfdc01e6ab144ee8a786271500893089 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:22:37.942199 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba10e9d-305c-4136-948b-f33103c20555 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:37.942479 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba10e9d-305c-4136-948b-f33103c20555 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:37.942756 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba10e9d-305c-4136-948b-f33103c20555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:37.961819 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-0ba10e9d-305c-4136-948b-f33103c20555 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:22:37.963030 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-0ba10e9d-305c-4136-948b-f33103c20555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:22:38.025161 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1224/2479] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:22:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:22:38.035433 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5804814-e245-4e8d-b666-e74b9f734959 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:22:38.036999 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-d5804814-e245-4e8d-b666-e74b9f734959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:22:38.104196 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5804814-e245-4e8d-b666-e74b9f734959 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:22:38.108333 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90909caf-4841-4d46-9d35-19c7479e2af4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:22:38.108952 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90909caf-4841-4d46-9d35-19c7479e2af4 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:38.109225 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90909caf-4841-4d46-9d35-19c7479e2af4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:38.109489 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90909caf-4841-4d46-9d35-19c7479e2af4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:38.120279 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90909caf-4841-4d46-9d35-19c7479e2af4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:22:38.121718 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90909caf-4841-4d46-9d35-19c7479e2af4 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:22:38.131936 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1256/2480] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:22:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:22:38.419054 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba10e9d-305c-4136-948b-f33103c20555 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:22:38.420465 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-0ba10e9d-305c-4136-948b-f33103c20555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:22:38.432714 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba10e9d-305c-4136-948b-f33103c20555 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:22:38.438559 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46715ad5-656b-4136-8198-5ec289ca90a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:22:38.439452 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46715ad5-656b-4136-8198-5ec289ca90a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:38.439949 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46715ad5-656b-4136-8198-5ec289ca90a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:38.440207 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46715ad5-656b-4136-8198-5ec289ca90a6 admin admin] PATH_INFO: `/v3/projects/593bb214d8504c1486ddfab80b5f44bf` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:38.441426 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46715ad5-656b-4136-8198-5ec289ca90a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=593bb214d8504c1486ddfab80b5f44bf)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:22:38.443618 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46715ad5-656b-4136-8198-5ec289ca90a6 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:22:38.493987 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-46715ad5-656b-4136-8198-5ec289ca90a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '593bb214d8504c1486ddfab80b5f44bf', 'request_id': 'req-46715ad5-656b-4136-8198-5ec289ca90a6'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:22:38.501371 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-46715ad5-656b-4136-8198-5ec289ca90a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '593bb214d8504c1486ddfab80b5f44bf', 'request_id': 'req-46715ad5-656b-4136-8198-5ec289ca90a6'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:22:38.508085 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-46715ad5-656b-4136-8198-5ec289ca90a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '593bb214d8504c1486ddfab80b5f44bf', 'request_id': 'req-46715ad5-656b-4136-8198-5ec289ca90a6'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:22:38.509980 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:22:38.526266 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-46715ad5-656b-4136-8198-5ec289ca90a6 admin admin] The token cache is being invalidate because project 593bb214d8504c1486ddfab80b5f44bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:22:38.526700 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-46715ad5-656b-4136-8198-5ec289ca90a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:22:38.527391 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-46715ad5-656b-4136-8198-5ec289ca90a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:22:38.535167 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1225/2481] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:22:38 2022] DELETE /identity/v3/projects/593bb214d8504c1486ddfab80b5f44bf => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:22:48.127855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:22:48.525660 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=2 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:23:03.045469 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90909caf-4841-4d46-9d35-19c7479e2af4 service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:23:03.047202 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-90909caf-4841-4d46-9d35-19c7479e2af4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:23:03.125379 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90909caf-4841-4d46-9d35-19c7479e2af4 service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:23:03.194539 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d6d432-5da8-4d42-ae2c-92657af645c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:23:03.195165 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6d432-5da8-4d42-ae2c-92657af645c6 service nova] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:23:03.195440 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6d432-5da8-4d42-ae2c-92657af645c6 service nova] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:23:03.195743 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6d432-5da8-4d42-ae2c-92657af645c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:23:03.197745 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-f7d6d432-5da8-4d42-ae2c-92657af645c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:23:03.261456 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d6d432-5da8-4d42-ae2c-92657af645c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:23:03.262977 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d6d432-5da8-4d42-ae2c-92657af645c6 service nova] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:23:03.272654 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1257/2482] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:23:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:23:13.268255 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=84 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:23:14.479521 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46715ad5-656b-4136-8198-5ec289ca90a6 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:23:14.481586 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-46715ad5-656b-4136-8198-5ec289ca90a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:23:14.540677 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46715ad5-656b-4136-8198-5ec289ca90a6 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:23:14.544393 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d397d545-2758-4e3b-a033-769d0b4ca6f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:23:14.545015 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397d545-2758-4e3b-a033-769d0b4ca6f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:23:14.545291 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397d545-2758-4e3b-a033-769d0b4ca6f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:23:14.545557 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397d545-2758-4e3b-a033-769d0b4ca6f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:23:14.547370 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-d397d545-2758-4e3b-a033-769d0b4ca6f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:23:14.610880 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d397d545-2758-4e3b-a033-769d0b4ca6f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:23:14.612351 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d397d545-2758-4e3b-a033-769d0b4ca6f9 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:23:14.623255 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1226/2483] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:23:14 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:23:22.161634 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc29cd6-c800-4661-b3d2-8293f6fc61c0 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:23:22.162267 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc29cd6-c800-4661-b3d2-8293f6fc61c0 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:23:22.162267 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc29cd6-c800-4661-b3d2-8293f6fc61c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:23:22.205904 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-3bc29cd6-c800-4661-b3d2-8293f6fc61c0 None None] MFA Rules not processed for user `9e467b255bf54ded9815e902e99b41df`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:23:22.207852 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-3bc29cd6-c800-4661-b3d2-8293f6fc61c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:23:22.236954 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1258/2484] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:23:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:23:24.617749 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=50 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:23:32.233378 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=15 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:23:53.172131 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d397d545-2758-4e3b-a033-769d0b4ca6f9 service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:23:53.173922 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-d397d545-2758-4e3b-a033-769d0b4ca6f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:23:53.328009 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d397d545-2758-4e3b-a033-769d0b4ca6f9 service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:23:53.333839 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220892b6-158a-4e46-83e3-2f9b42267c9c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:23:53.334457 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220892b6-158a-4e46-83e3-2f9b42267c9c service placement] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:23:53.335228 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220892b6-158a-4e46-83e3-2f9b42267c9c service placement] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:23:53.335228 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220892b6-158a-4e46-83e3-2f9b42267c9c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:23:53.336914 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-220892b6-158a-4e46-83e3-2f9b42267c9c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:23:53.350780 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220892b6-158a-4e46-83e3-2f9b42267c9c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:23:53.352434 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220892b6-158a-4e46-83e3-2f9b42267c9c service placement] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:23:53.363924 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1227/2485] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:23:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:23:57.846422 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc29cd6-c800-4661-b3d2-8293f6fc61c0 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:23:57.847974 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-3bc29cd6-c800-4661-b3d2-8293f6fc61c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:23:57.961080 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc29cd6-c800-4661-b3d2-8293f6fc61c0 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:23:57.965975 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff1ce5-f413-4726-ada4-3472e4048d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:23:57.966961 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff1ce5-f413-4726-ada4-3472e4048d25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:23:57.967432 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff1ce5-f413-4726-ada4-3472e4048d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:23:57.968016 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff1ce5-f413-4726-ada4-3472e4048d25 admin admin] PATH_INFO: `/v3/users/e54126de844549b4997620ad1845ce9e` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:23:57.969561 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff1ce5-f413-4726-ada4-3472e4048d25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e54126de844549b4997620ad1845ce9e)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:23:57.971792 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff1ce5-f413-4726-ada4-3472e4048d25 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:23:58.022199 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-dcff1ce5-f413-4726-ada4-3472e4048d25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e54126de844549b4997620ad1845ce9e'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:58.028915 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-dcff1ce5-f413-4726-ada4-3472e4048d25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e54126de844549b4997620ad1845ce9e'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:58.029571 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-dcff1ce5-f413-4726-ada4-3472e4048d25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e54126de844549b4997620ad1845ce9e'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:58.041066 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-dcff1ce5-f413-4726-ada4-3472e4048d25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e54126de844549b4997620ad1845ce9e'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:58.041610 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-dcff1ce5-f413-4726-ada4-3472e4048d25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e54126de844549b4997620ad1845ce9e'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:58.055748 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1259/2486] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:23:57 2022] DELETE /identity/v3/users/e54126de844549b4997620ad1845ce9e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:23:58.060830 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21df38-f4eb-44e5-be6f-14e36c73e882 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:23:58.061278 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21df38-f4eb-44e5-be6f-14e36c73e882 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:23:58.061278 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21df38-f4eb-44e5-be6f-14e36c73e882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:23:58.092056 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-fe21df38-f4eb-44e5-be6f-14e36c73e882 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:23:58.093379 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-fe21df38-f4eb-44e5-be6f-14e36c73e882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:23:58.161876 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1228/2487] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:23:58.172438 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff1ce5-f413-4726-ada4-3472e4048d25 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:23:58.174863 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-dcff1ce5-f413-4726-ada4-3472e4048d25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:23:58.234619 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:23:58.263024 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff1ce5-f413-4726-ada4-3472e4048d25 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:23:58.267059 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bcf99b-f38b-4d8b-8815-b3be16ad670a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:23:58.267708 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcf99b-f38b-4d8b-8815-b3be16ad670a service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:23:58.267986 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcf99b-f38b-4d8b-8815-b3be16ad670a service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:23:58.268252 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcf99b-f38b-4d8b-8815-b3be16ad670a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:23:58.277469 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bcf99b-f38b-4d8b-8815-b3be16ad670a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:23:58.278940 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bcf99b-f38b-4d8b-8815-b3be16ad670a service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:23:58.288390 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1260/2488] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:23:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:23:58.460805 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21df38-f4eb-44e5-be6f-14e36c73e882 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:23:58.462252 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-fe21df38-f4eb-44e5-be6f-14e36c73e882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:23:58.474934 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21df38-f4eb-44e5-be6f-14e36c73e882 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:23:58.480810 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a786aea-fafc-4e8e-baa4-252e5366f5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:23:58.481593 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a786aea-fafc-4e8e-baa4-252e5366f5f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:23:58.481877 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a786aea-fafc-4e8e-baa4-252e5366f5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:23:58.482144 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a786aea-fafc-4e8e-baa4-252e5366f5f4 admin admin] PATH_INFO: `/v3/projects/864349f4622e4deab77afd3d19d6fe53` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:23:58.483399 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a786aea-fafc-4e8e-baa4-252e5366f5f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=864349f4622e4deab77afd3d19d6fe53)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:23:58.485355 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a786aea-fafc-4e8e-baa4-252e5366f5f4 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:23:58.497285 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:23:58.534878 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-0a786aea-fafc-4e8e-baa4-252e5366f5f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '864349f4622e4deab77afd3d19d6fe53', 'request_id': 'req-0a786aea-fafc-4e8e-baa4-252e5366f5f4'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:58.540374 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-0a786aea-fafc-4e8e-baa4-252e5366f5f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '864349f4622e4deab77afd3d19d6fe53', 'request_id': 'req-0a786aea-fafc-4e8e-baa4-252e5366f5f4'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:58.546844 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-0a786aea-fafc-4e8e-baa4-252e5366f5f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '864349f4622e4deab77afd3d19d6fe53', 'request_id': 'req-0a786aea-fafc-4e8e-baa4-252e5366f5f4'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:58.560952 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-0a786aea-fafc-4e8e-baa4-252e5366f5f4 admin admin] The token cache is being invalidate because project 864349f4622e4deab77afd3d19d6fe53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:23:58.561239 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-0a786aea-fafc-4e8e-baa4-252e5366f5f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:58.561878 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-0a786aea-fafc-4e8e-baa4-252e5366f5f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:58.563400 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1229/2489] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:23:58 2022] DELETE /identity/v3/projects/864349f4622e4deab77afd3d19d6fe53 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:23:58.567441 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bcf99b-f38b-4d8b-8815-b3be16ad670a service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:23:58.577045 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bcf99b-f38b-4d8b-8815-b3be16ad670a service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:23:58.637312 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f0f43-e466-45f3-b48e-1e76426abf76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:23:58.637982 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f0f43-e466-45f3-b48e-1e76426abf76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:23:58.638221 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f0f43-e466-45f3-b48e-1e76426abf76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:23:58.638626 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f0f43-e466-45f3-b48e-1e76426abf76 admin admin] PATH_INFO: `/v3/users/18c3dc1f37af437788825676f3841960` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:23:58.639892 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f0f43-e466-45f3-b48e-1e76426abf76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18c3dc1f37af437788825676f3841960)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:23:58.642031 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f0f43-e466-45f3-b48e-1e76426abf76 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:23:58.691651 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-899f0f43-e466-45f3-b48e-1e76426abf76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18c3dc1f37af437788825676f3841960'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:58.698504 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-899f0f43-e466-45f3-b48e-1e76426abf76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18c3dc1f37af437788825676f3841960'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:58.699206 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-899f0f43-e466-45f3-b48e-1e76426abf76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18c3dc1f37af437788825676f3841960'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:58.710608 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-899f0f43-e466-45f3-b48e-1e76426abf76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18c3dc1f37af437788825676f3841960'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:58.711240 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-899f0f43-e466-45f3-b48e-1e76426abf76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18c3dc1f37af437788825676f3841960'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:58.726424 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1261/2490] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:23:58 2022] DELETE /identity/v3/users/18c3dc1f37af437788825676f3841960 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:23:59.011729 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a786aea-fafc-4e8e-baa4-252e5366f5f4 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:23:59.013322 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-0a786aea-fafc-4e8e-baa4-252e5366f5f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:23:59.027253 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a786aea-fafc-4e8e-baa4-252e5366f5f4 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:23:59.085398 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d9b9a-2914-4a75-addd-502c95021840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:23:59.086071 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d9b9a-2914-4a75-addd-502c95021840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:23:59.086320 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d9b9a-2914-4a75-addd-502c95021840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:23:59.086590 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d9b9a-2914-4a75-addd-502c95021840 admin admin] PATH_INFO: `/v3/projects/3bf4b02be340496e91822b9dda7ddc22` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:23:59.087796 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d9b9a-2914-4a75-addd-502c95021840 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bf4b02be340496e91822b9dda7ddc22)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:23:59.089701 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d9b9a-2914-4a75-addd-502c95021840 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:23:59.144162 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-b57d9b9a-2914-4a75-addd-502c95021840 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bf4b02be340496e91822b9dda7ddc22', 'request_id': 'req-b57d9b9a-2914-4a75-addd-502c95021840'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:59.150031 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-b57d9b9a-2914-4a75-addd-502c95021840 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bf4b02be340496e91822b9dda7ddc22', 'request_id': 'req-b57d9b9a-2914-4a75-addd-502c95021840'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:59.156445 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-b57d9b9a-2914-4a75-addd-502c95021840 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bf4b02be340496e91822b9dda7ddc22', 'request_id': 'req-b57d9b9a-2914-4a75-addd-502c95021840'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:59.171012 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-b57d9b9a-2914-4a75-addd-502c95021840 admin admin] The token cache is being invalidate because project 3bf4b02be340496e91822b9dda7ddc22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:23:59.171323 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-b57d9b9a-2914-4a75-addd-502c95021840 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:59.171956 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-b57d9b9a-2914-4a75-addd-502c95021840 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:59.173549 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1230/2491] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:23:59 2022] DELETE /identity/v3/projects/3bf4b02be340496e91822b9dda7ddc22 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:23:59.178750 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b8156-6e92-44cc-bd75-5292ccbde71a None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:23:59.179262 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b8156-6e92-44cc-bd75-5292ccbde71a None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:23:59.179386 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b8156-6e92-44cc-bd75-5292ccbde71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:23:59.229933 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-103b8156-6e92-44cc-bd75-5292ccbde71a None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:23:59.231055 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-103b8156-6e92-44cc-bd75-5292ccbde71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:23:59.256231 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:23:59.294856 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1262/2492] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:23:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:23:59.303651 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16dfa1c-470d-43aa-baa8-81f7e5df2aaa None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:23:59.303935 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16dfa1c-470d-43aa-baa8-81f7e5df2aaa None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:23:59.304205 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16dfa1c-470d-43aa-baa8-81f7e5df2aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:23:59.324779 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-a16dfa1c-470d-43aa-baa8-81f7e5df2aaa None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:23:59.326142 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-a16dfa1c-470d-43aa-baa8-81f7e5df2aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:23:59.334859 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1231/2493] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:23:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:23:59.339185 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b8156-6e92-44cc-bd75-5292ccbde71a None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:23:59.349449 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b8156-6e92-44cc-bd75-5292ccbde71a None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:23:59.355257 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcf959-4093-4a3d-bddc-35c0caa3701a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:23:59.355910 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcf959-4093-4a3d-bddc-35c0caa3701a admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:23:59.356189 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcf959-4093-4a3d-bddc-35c0caa3701a admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:23:59.356456 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcf959-4093-4a3d-bddc-35c0caa3701a admin admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:23:59.357153 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fcf959-4093-4a3d-bddc-35c0caa3701a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:23:59.357452 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fcf959-4093-4a3d-bddc-35c0caa3701a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:23:59.359061 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fcf959-4093-4a3d-bddc-35c0caa3701a admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:23:59.372122 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1263/2494] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:23:59.376714 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16dfa1c-470d-43aa-baa8-81f7e5df2aaa None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:23:59.386159 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16dfa1c-470d-43aa-baa8-81f7e5df2aaa None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:23:59.391132 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7050a928-16bc-4051-8cb2-68fc5292fd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:23:59.391804 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050a928-16bc-4051-8cb2-68fc5292fd11 admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:23:59.392091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050a928-16bc-4051-8cb2-68fc5292fd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:23:59.392363 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050a928-16bc-4051-8cb2-68fc5292fd11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:23:59.393024 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7050a928-16bc-4051-8cb2-68fc5292fd11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:23:59.394912 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7050a928-16bc-4051-8cb2-68fc5292fd11 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:23:59.418737 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:23:59.427065 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1232/2495] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:23:59 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:23:59.431646 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcf959-4093-4a3d-bddc-35c0caa3701a admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:23:59.444628 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcf959-4093-4a3d-bddc-35c0caa3701a admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:23:59.503040 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f5913-a565-4854-a259-f21ce92b39ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:23:59.503771 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f5913-a565-4854-a259-f21ce92b39ed admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:23:59.504115 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f5913-a565-4854-a259-f21ce92b39ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:23:59.504441 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f5913-a565-4854-a259-f21ce92b39ed admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:23:59.505258 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68f5913-a565-4854-a259-f21ce92b39ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:23:59.507174 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68f5913-a565-4854-a259-f21ce92b39ed admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:23:59.530656 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1264/2496] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:23:59 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:23:59.534970 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7050a928-16bc-4051-8cb2-68fc5292fd11 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:23:59.545892 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7050a928-16bc-4051-8cb2-68fc5292fd11 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:23:59.551327 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47222c5-18d9-454a-ab80-1f880912af7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:23:59.551985 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47222c5-18d9-454a-ab80-1f880912af7e admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:23:59.552264 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47222c5-18d9-454a-ab80-1f880912af7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:23:59.552556 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47222c5-18d9-454a-ab80-1f880912af7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:23:59.553249 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47222c5-18d9-454a-ab80-1f880912af7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:23:59.554859 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47222c5-18d9-454a-ab80-1f880912af7e admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:23:59.565346 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1233/2497] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:23:59.569314 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f5913-a565-4854-a259-f21ce92b39ed admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:23:59.579765 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f5913-a565-4854-a259-f21ce92b39ed admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:23:59.585263 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606282d-b837-4ef5-8a7f-edb49bc08568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:23:59.585926 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606282d-b837-4ef5-8a7f-edb49bc08568 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:23:59.586198 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606282d-b837-4ef5-8a7f-edb49bc08568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:23:59.586462 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606282d-b837-4ef5-8a7f-edb49bc08568 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:23:59.587153 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5606282d-b837-4ef5-8a7f-edb49bc08568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:23:59.588889 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5606282d-b837-4ef5-8a7f-edb49bc08568 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:23:59.599912 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1265/2498] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:23:59.604139 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47222c5-18d9-454a-ab80-1f880912af7e admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:23:59.614766 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47222c5-18d9-454a-ab80-1f880912af7e admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:23:59.620382 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2e1f1-76fe-4a5f-b1dc-89a82827047d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:23:59.621374 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2e1f1-76fe-4a5f-b1dc-89a82827047d admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:23:59.621650 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2e1f1-76fe-4a5f-b1dc-89a82827047d admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:23:59.621919 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2e1f1-76fe-4a5f-b1dc-89a82827047d admin admin] PATH_INFO: `/v3/projects/c3e614851f7b4aceb577963a394f0943/users/97e6d5b2829043c7b7d24e1e42b4bc16/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:23:59.637220 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c2e1f1-76fe-4a5f-b1dc-89a82827047d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3e614851f7b4aceb577963a394f0943, user_id=97e6d5b2829043c7b7d24e1e42b4bc16, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:23:59.639902 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c2e1f1-76fe-4a5f-b1dc-89a82827047d admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:23:59.654888 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1234/2499] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:23:59 2022] PUT /identity/v3/projects/c3e614851f7b4aceb577963a394f0943/users/97e6d5b2829043c7b7d24e1e42b4bc16/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:23:59.660063 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed40cf-b818-48f2-96ea-6f68501e37d8 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:23:59.660342 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed40cf-b818-48f2-96ea-6f68501e37d8 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:23:59.660632 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed40cf-b818-48f2-96ea-6f68501e37d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:23:59.679995 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-22ed40cf-b818-48f2-96ea-6f68501e37d8 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:23:59.682073 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-22ed40cf-b818-48f2-96ea-6f68501e37d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:23:59.739985 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1266/2500] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:23:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:23:59.750296 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2e1f1-76fe-4a5f-b1dc-89a82827047d admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:23:59.752118 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-80c2e1f1-76fe-4a5f-b1dc-89a82827047d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:23:59.814391 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2e1f1-76fe-4a5f-b1dc-89a82827047d admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:23:59.818982 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155058c-8a38-4571-8271-8562190c14f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:23:59.819630 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155058c-8a38-4571-8271-8562190c14f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:23:59.819909 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155058c-8a38-4571-8271-8562190c14f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:23:59.820178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155058c-8a38-4571-8271-8562190c14f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:23:59.830891 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f155058c-8a38-4571-8271-8562190c14f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:23:59.832440 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f155058c-8a38-4571-8271-8562190c14f6 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:23:59.842869 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1235/2501] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:23:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:24:00.513270 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4d110-80e1-4bc1-bdc7-4047773b0e85 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:24:00.513771 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4d110-80e1-4bc1-bdc7-4047773b0e85 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:24:00.513771 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4d110-80e1-4bc1-bdc7-4047773b0e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:24:00.542694 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-60b4d110-80e1-4bc1-bdc7-4047773b0e85 None None] MFA Rules not processed for user `97e6d5b2829043c7b7d24e1e42b4bc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:24:00.544002 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-60b4d110-80e1-4bc1-bdc7-4047773b0e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:24:00.570304 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:24:00.614898 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1267/2502] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:24:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:24:00.619756 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155058c-8a38-4571-8271-8562190c14f6 service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:24:00.629696 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155058c-8a38-4571-8271-8562190c14f6 service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:24:00.634241 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1dd9b-d575-4cc9-aeb8-68f3115e7836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:24:00.634856 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1dd9b-d575-4cc9-aeb8-68f3115e7836 admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:24:00.635134 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1dd9b-d575-4cc9-aeb8-68f3115e7836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:24:00.635406 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1dd9b-d575-4cc9-aeb8-68f3115e7836 admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:24:00.636137 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece1dd9b-d575-4cc9-aeb8-68f3115e7836 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:24:00.638066 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece1dd9b-d575-4cc9-aeb8-68f3115e7836 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:24:00.665043 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1236/2503] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:24:00 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:24:00.669187 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b4d110-80e1-4bc1-bdc7-4047773b0e85 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:24:00.681934 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b4d110-80e1-4bc1-bdc7-4047773b0e85 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:24:00.736807 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34425e9-a0fa-4840-b5eb-4ad524ba1248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:24:00.737427 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34425e9-a0fa-4840-b5eb-4ad524ba1248 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:24:00.737707 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34425e9-a0fa-4840-b5eb-4ad524ba1248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:24:00.737985 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34425e9-a0fa-4840-b5eb-4ad524ba1248 admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:24:00.738649 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34425e9-a0fa-4840-b5eb-4ad524ba1248 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:24:00.740602 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34425e9-a0fa-4840-b5eb-4ad524ba1248 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:24:00.764236 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1268/2504] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:24:00 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:24:00.768311 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1dd9b-d575-4cc9-aeb8-68f3115e7836 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:24:00.778554 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1dd9b-d575-4cc9-aeb8-68f3115e7836 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:24:00.783442 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b323447-7556-437c-906c-61e31ec16ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:24:00.784106 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b323447-7556-437c-906c-61e31ec16ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:24:00.784379 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b323447-7556-437c-906c-61e31ec16ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:24:00.784653 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b323447-7556-437c-906c-61e31ec16ca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:24:00.785365 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b323447-7556-437c-906c-61e31ec16ca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:24:00.786968 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b323447-7556-437c-906c-61e31ec16ca4 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:24:00.798827 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1237/2505] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:24:00.802854 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34425e9-a0fa-4840-b5eb-4ad524ba1248 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:24:00.814185 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34425e9-a0fa-4840-b5eb-4ad524ba1248 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:24:00.819519 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda68f0-8fbc-4bdf-a2da-bc9357563488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:24:00.820255 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda68f0-8fbc-4bdf-a2da-bc9357563488 admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:24:00.820573 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda68f0-8fbc-4bdf-a2da-bc9357563488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:24:00.820857 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda68f0-8fbc-4bdf-a2da-bc9357563488 admin admin] PATH_INFO: `/v3/projects/4c222491435341318c8a79b9304ecf39/users/bd1f1c1d7d0d4fdd91ac3d15f717cb02/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:24:00.836537 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfda68f0-8fbc-4bdf-a2da-bc9357563488 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c222491435341318c8a79b9304ecf39, user_id=bd1f1c1d7d0d4fdd91ac3d15f717cb02, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:24:00.839224 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfda68f0-8fbc-4bdf-a2da-bc9357563488 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:24:00.854364 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1269/2506] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:24:00 2022] PUT /identity/v3/projects/4c222491435341318c8a79b9304ecf39/users/bd1f1c1d7d0d4fdd91ac3d15f717cb02/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:24:00.859023 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b323447-7556-437c-906c-61e31ec16ca4 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:24:00.875927 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b323447-7556-437c-906c-61e31ec16ca4 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:24:00.937920 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df430fe-626c-463c-a8b4-e030ece453c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:24:00.938554 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df430fe-626c-463c-a8b4-e030ece453c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:24:00.938923 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df430fe-626c-463c-a8b4-e030ece453c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:24:00.939197 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df430fe-626c-463c-a8b4-e030ece453c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:24:00.939941 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df430fe-626c-463c-a8b4-e030ece453c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:24:00.941549 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df430fe-626c-463c-a8b4-e030ece453c5 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:24:00.951425 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1238/2507] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:24:00.955890 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda68f0-8fbc-4bdf-a2da-bc9357563488 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:24:00.966555 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda68f0-8fbc-4bdf-a2da-bc9357563488 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:24:00.971967 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b3bd6-7c38-421c-aaeb-4f9246c43d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:24:00.972650 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b3bd6-7c38-421c-aaeb-4f9246c43d13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:24:00.972927 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b3bd6-7c38-421c-aaeb-4f9246c43d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:24:00.973194 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b3bd6-7c38-421c-aaeb-4f9246c43d13 admin admin] PATH_INFO: `/v3/projects/4c222491435341318c8a79b9304ecf39/users/bd1f1c1d7d0d4fdd91ac3d15f717cb02/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:24:00.975395 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b3bd6-7c38-421c-aaeb-4f9246c43d13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c222491435341318c8a79b9304ecf39, user_id=bd1f1c1d7d0d4fdd91ac3d15f717cb02, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:24:00.978048 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b3bd6-7c38-421c-aaeb-4f9246c43d13 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:24:00.990066 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1270/2508] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:24:00 2022] PUT /identity/v3/projects/4c222491435341318c8a79b9304ecf39/users/bd1f1c1d7d0d4fdd91ac3d15f717cb02/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:24:01.710227 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f01e4f-5b11-4906-90cb-5e41d8191eac None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:24:01.710800 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f01e4f-5b11-4906-90cb-5e41d8191eac None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:24:01.710800 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f01e4f-5b11-4906-90cb-5e41d8191eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:24:01.739717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-13f01e4f-5b11-4906-90cb-5e41d8191eac None None] MFA Rules not processed for user `bd1f1c1d7d0d4fdd91ac3d15f717cb02`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:24:01.740968 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-13f01e4f-5b11-4906-90cb-5e41d8191eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:24:01.760078 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:24:01.814571 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1239/2509] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:24:01 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:24:01.825394 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a995ed9-07a3-494b-a5fd-81814b9409c3 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:24:01.825980 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a995ed9-07a3-494b-a5fd-81814b9409c3 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:24:01.825980 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a995ed9-07a3-494b-a5fd-81814b9409c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:24:01.845236 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-5a995ed9-07a3-494b-a5fd-81814b9409c3 None None] MFA Rules not processed for user `97e6d5b2829043c7b7d24e1e42b4bc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:24:01.846391 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-5a995ed9-07a3-494b-a5fd-81814b9409c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:24:01.905047 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1271/2510] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:24:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:24:01.916803 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f01e4f-5b11-4906-90cb-5e41d8191eac None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:24:01.918272 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-13f01e4f-5b11-4906-90cb-5e41d8191eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:24:02.030953 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f01e4f-5b11-4906-90cb-5e41d8191eac None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:24:02.037329 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b56f42-c1b9-47d1-8710-7d9fa7c3672f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:24:02.037974 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b56f42-c1b9-47d1-8710-7d9fa7c3672f service nova] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:24:02.038231 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b56f42-c1b9-47d1-8710-7d9fa7c3672f service nova] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:24:02.038496 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b56f42-c1b9-47d1-8710-7d9fa7c3672f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:24:02.046458 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b56f42-c1b9-47d1-8710-7d9fa7c3672f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:24:02.048128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b56f42-c1b9-47d1-8710-7d9fa7c3672f service nova] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:24:02.057460 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1240/2511] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:24:01 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:24:11.896987 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=85,keystone:INSERT=5 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:24:12.053033 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=66 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:24:25.893444 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b175b45-37d9-4004-9f8a-b5b8f41a0748 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:24:25.894029 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b175b45-37d9-4004-9f8a-b5b8f41a0748 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:24:25.894029 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b175b45-37d9-4004-9f8a-b5b8f41a0748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:24:25.936022 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-4b175b45-37d9-4004-9f8a-b5b8f41a0748 None None] MFA Rules not processed for user `9e467b255bf54ded9815e902e99b41df`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:24:25.937568 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-4b175b45-37d9-4004-9f8a-b5b8f41a0748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:24:26.008696 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1272/2512] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:24:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:24:26.688556 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25933099-dbd4-4ceb-a946-5f4aadcf8d51 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:24:26.689009 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25933099-dbd4-4ceb-a946-5f4aadcf8d51 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:24:26.689844 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25933099-dbd4-4ceb-a946-5f4aadcf8d51 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:24:26.691281 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1241/2513] 10.222.0.60 () {54 vars in 921 bytes} [Sun Jul 31 01:24:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:24:26.697112 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793caf9d-52da-4dad-9855-e461ae83a286 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:24:26.697470 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793caf9d-52da-4dad-9855-e461ae83a286 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:24:26.697810 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793caf9d-52da-4dad-9855-e461ae83a286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:24:26.737672 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-793caf9d-52da-4dad-9855-e461ae83a286 None None] MFA Rules not processed for user `04591cd035ef4961b8b7a93e294eb881`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:24:26.739242 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-793caf9d-52da-4dad-9855-e461ae83a286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:24:26.756457 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1273/2514] 10.222.0.60 () {58 vars in 1018 bytes} [Sun Jul 31 01:24:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:24:26.761643 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25933099-dbd4-4ceb-a946-5f4aadcf8d51 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:24:26.819428 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25933099-dbd4-4ceb-a946-5f4aadcf8d51 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:24:26.823246 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fdbef-321b-48bd-9aea-7ae3589acfd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:24:26.823929 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fdbef-321b-48bd-9aea-7ae3589acfd3 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:24:26.824206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fdbef-321b-48bd-9aea-7ae3589acfd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:24:26.824470 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fdbef-321b-48bd-9aea-7ae3589acfd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:24:26.835218 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3fdbef-321b-48bd-9aea-7ae3589acfd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:24:26.836689 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3fdbef-321b-48bd-9aea-7ae3589acfd3 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:24:26.847756 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1242/2515] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:24:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:24:27.545717 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793caf9d-52da-4dad-9855-e461ae83a286 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:24:27.618103 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793caf9d-52da-4dad-9855-e461ae83a286 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:24:27.623389 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f06fa0-c6ae-4666-bcdc-aadceefb57a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:24:27.624143 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f06fa0-c6ae-4666-bcdc-aadceefb57a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:24:27.624426 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f06fa0-c6ae-4666-bcdc-aadceefb57a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:24:27.624703 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f06fa0-c6ae-4666-bcdc-aadceefb57a5 admin admin] PATH_INFO: `/v3/users/97e6d5b2829043c7b7d24e1e42b4bc16` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:24:27.625882 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f06fa0-c6ae-4666-bcdc-aadceefb57a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97e6d5b2829043c7b7d24e1e42b4bc16)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:24:27.627846 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f06fa0-c6ae-4666-bcdc-aadceefb57a5 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:24:27.676684 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-65f06fa0-c6ae-4666-bcdc-aadceefb57a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97e6d5b2829043c7b7d24e1e42b4bc16'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:24:27.684052 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-65f06fa0-c6ae-4666-bcdc-aadceefb57a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97e6d5b2829043c7b7d24e1e42b4bc16'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:24:27.685107 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-65f06fa0-c6ae-4666-bcdc-aadceefb57a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97e6d5b2829043c7b7d24e1e42b4bc16'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:24:27.697926 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-65f06fa0-c6ae-4666-bcdc-aadceefb57a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97e6d5b2829043c7b7d24e1e42b4bc16'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:24:27.698640 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-65f06fa0-c6ae-4666-bcdc-aadceefb57a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97e6d5b2829043c7b7d24e1e42b4bc16'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:24:27.713502 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1274/2516] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:24:27 2022] DELETE /identity/v3/users/97e6d5b2829043c7b7d24e1e42b4bc16 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:24:27.903226 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fdbef-321b-48bd-9aea-7ae3589acfd3 service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:24:27.923653 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fdbef-321b-48bd-9aea-7ae3589acfd3 service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:24:27.986256 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba833e9-1d80-43e5-96d9-a5f971b899e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:24:27.987051 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba833e9-1d80-43e5-96d9-a5f971b899e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:24:27.987392 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba833e9-1d80-43e5-96d9-a5f971b899e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:24:27.987867 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba833e9-1d80-43e5-96d9-a5f971b899e5 admin admin] PATH_INFO: `/v3/projects/c3e614851f7b4aceb577963a394f0943` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:24:27.989302 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba833e9-1d80-43e5-96d9-a5f971b899e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3e614851f7b4aceb577963a394f0943)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:24:27.991379 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba833e9-1d80-43e5-96d9-a5f971b899e5 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:24:28.042036 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-4ba833e9-1d80-43e5-96d9-a5f971b899e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3e614851f7b4aceb577963a394f0943', 'request_id': 'req-4ba833e9-1d80-43e5-96d9-a5f971b899e5'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:24:28.047938 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-4ba833e9-1d80-43e5-96d9-a5f971b899e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3e614851f7b4aceb577963a394f0943', 'request_id': 'req-4ba833e9-1d80-43e5-96d9-a5f971b899e5'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:24:28.054615 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-4ba833e9-1d80-43e5-96d9-a5f971b899e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3e614851f7b4aceb577963a394f0943', 'request_id': 'req-4ba833e9-1d80-43e5-96d9-a5f971b899e5'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:24:28.073139 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-4ba833e9-1d80-43e5-96d9-a5f971b899e5 admin admin] The token cache is being invalidate because project c3e614851f7b4aceb577963a394f0943 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:24:28.073413 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-4ba833e9-1d80-43e5-96d9-a5f971b899e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:24:28.074191 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-4ba833e9-1d80-43e5-96d9-a5f971b899e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:24:28.075811 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1243/2517] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:24:27 2022] DELETE /identity/v3/projects/c3e614851f7b4aceb577963a394f0943 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:24:28.080555 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f06fa0-c6ae-4666-bcdc-aadceefb57a5 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:24:28.082377 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-65f06fa0-c6ae-4666-bcdc-aadceefb57a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:24:28.108058 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f06fa0-c6ae-4666-bcdc-aadceefb57a5 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:24:28.113839 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:24:28.166402 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0c19d-3128-4f45-b39f-f57972262a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:24:28.167049 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0c19d-3128-4f45-b39f-f57972262a41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:24:28.167326 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0c19d-3128-4f45-b39f-f57972262a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:24:28.167633 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0c19d-3128-4f45-b39f-f57972262a41 admin admin] PATH_INFO: `/v3/users/bd1f1c1d7d0d4fdd91ac3d15f717cb02` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:24:28.168791 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf0c19d-3128-4f45-b39f-f57972262a41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd1f1c1d7d0d4fdd91ac3d15f717cb02)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:24:28.170740 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf0c19d-3128-4f45-b39f-f57972262a41 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:24:28.221505 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-3cf0c19d-3128-4f45-b39f-f57972262a41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd1f1c1d7d0d4fdd91ac3d15f717cb02'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:24:28.228884 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-3cf0c19d-3128-4f45-b39f-f57972262a41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd1f1c1d7d0d4fdd91ac3d15f717cb02'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:24:28.229576 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-3cf0c19d-3128-4f45-b39f-f57972262a41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd1f1c1d7d0d4fdd91ac3d15f717cb02'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:24:28.243291 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-3cf0c19d-3128-4f45-b39f-f57972262a41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd1f1c1d7d0d4fdd91ac3d15f717cb02'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:24:28.244153 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-3cf0c19d-3128-4f45-b39f-f57972262a41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd1f1c1d7d0d4fdd91ac3d15f717cb02'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:24:28.258957 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1275/2518] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:24:28 2022] DELETE /identity/v3/users/bd1f1c1d7d0d4fdd91ac3d15f717cb02 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:24:28.440181 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba833e9-1d80-43e5-96d9-a5f971b899e5 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:24:28.441772 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-4ba833e9-1d80-43e5-96d9-a5f971b899e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:24:28.456708 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba833e9-1d80-43e5-96d9-a5f971b899e5 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:24:28.492733 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:24:28.530681 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630247b1-9040-4bd3-a331-8ed1e70d44e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:24:28.531536 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630247b1-9040-4bd3-a331-8ed1e70d44e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:24:28.531828 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630247b1-9040-4bd3-a331-8ed1e70d44e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:24:28.532104 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630247b1-9040-4bd3-a331-8ed1e70d44e5 admin admin] PATH_INFO: `/v3/projects/4c222491435341318c8a79b9304ecf39` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:24:28.533981 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630247b1-9040-4bd3-a331-8ed1e70d44e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c222491435341318c8a79b9304ecf39)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:24:28.536194 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630247b1-9040-4bd3-a331-8ed1e70d44e5 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:24:28.584977 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-630247b1-9040-4bd3-a331-8ed1e70d44e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c222491435341318c8a79b9304ecf39', 'request_id': 'req-630247b1-9040-4bd3-a331-8ed1e70d44e5'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:24:28.590858 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-630247b1-9040-4bd3-a331-8ed1e70d44e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c222491435341318c8a79b9304ecf39', 'request_id': 'req-630247b1-9040-4bd3-a331-8ed1e70d44e5'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:24:28.597224 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-630247b1-9040-4bd3-a331-8ed1e70d44e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c222491435341318c8a79b9304ecf39', 'request_id': 'req-630247b1-9040-4bd3-a331-8ed1e70d44e5'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:24:28.611173 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-630247b1-9040-4bd3-a331-8ed1e70d44e5 admin admin] The token cache is being invalidate because project 4c222491435341318c8a79b9304ecf39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:24:28.611288 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-630247b1-9040-4bd3-a331-8ed1e70d44e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:24:28.612028 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-630247b1-9040-4bd3-a331-8ed1e70d44e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:24:28.621767 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1244/2519] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:24:28 2022] DELETE /identity/v3/projects/4c222491435341318c8a79b9304ecf39 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:24:38.255464 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=49,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:24:38.607789 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=36,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:24:44.346179 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a6743-42c7-44b0-bf76-fa8fb1e55319 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:24:44.347111 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a6743-42c7-44b0-bf76-fa8fb1e55319 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:24:44.347111 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a6743-42c7-44b0-bf76-fa8fb1e55319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:24:44.369357 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-799a6743-42c7-44b0-bf76-fa8fb1e55319 None None] MFA Rules not processed for user `9e467b255bf54ded9815e902e99b41df`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:24:44.370951 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-799a6743-42c7-44b0-bf76-fa8fb1e55319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:24:44.430642 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1276/2520] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:24:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:24:45.043815 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a772b1-011d-4939-9144-d168be18ac98 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:24:45.044441 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a772b1-011d-4939-9144-d168be18ac98 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:24:45.044441 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a772b1-011d-4939-9144-d168be18ac98 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:24:45.045994 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1245/2521] 10.222.0.60 () {54 vars in 921 bytes} [Sun Jul 31 01:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:24:45.051685 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220a95a-9b6e-4da4-a52a-dd75e960d501 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:24:45.051974 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220a95a-9b6e-4da4-a52a-dd75e960d501 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:24:45.052268 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220a95a-9b6e-4da4-a52a-dd75e960d501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:24:45.072715 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-1220a95a-9b6e-4da4-a52a-dd75e960d501 None None] MFA Rules not processed for user `04591cd035ef4961b8b7a93e294eb881`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:24:45.074014 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-1220a95a-9b6e-4da4-a52a-dd75e960d501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:24:45.142931 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1277/2522] 10.222.0.60 () {58 vars in 1018 bytes} [Sun Jul 31 01:24:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:24:45.153896 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a772b1-011d-4939-9144-d168be18ac98 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:24:45.155727 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-27a772b1-011d-4939-9144-d168be18ac98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:24:45.220250 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a772b1-011d-4939-9144-d168be18ac98 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:24:45.226254 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc6f7f-b366-4eb9-b9e7-8cce4f545745 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:24:45.227137 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc6f7f-b366-4eb9-b9e7-8cce4f545745 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:24:45.227418 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc6f7f-b366-4eb9-b9e7-8cce4f545745 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:24:45.227793 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc6f7f-b366-4eb9-b9e7-8cce4f545745 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:24:45.243308 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc6f7f-b366-4eb9-b9e7-8cce4f545745 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:24:45.244774 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc6f7f-b366-4eb9-b9e7-8cce4f545745 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:24:45.255980 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1246/2523] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:24:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:24:55.133375 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=56 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:24:55.251411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=26 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:25:11.214654 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50a60c-1b46-4195-aecf-a479922fc6f0 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:11.215195 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50a60c-1b46-4195-aecf-a479922fc6f0 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:11.215325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50a60c-1b46-4195-aecf-a479922fc6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:11.235873 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-0f50a60c-1b46-4195-aecf-a479922fc6f0 None None] MFA Rules not processed for user `9e467b255bf54ded9815e902e99b41df`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:25:11.237134 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-0f50a60c-1b46-4195-aecf-a479922fc6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:25:11.244449 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1278/2524] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:25:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:25:21.230070 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:25:34.682587 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc6f7f-b366-4eb9-b9e7-8cce4f545745 service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:34.684219 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-a4fc6f7f-b366-4eb9-b9e7-8cce4f545745 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:25:34.696919 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc6f7f-b366-4eb9-b9e7-8cce4f545745 service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:34.702672 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00622b46-8286-43aa-9956-6cb86a5cc4bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:34.703621 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00622b46-8286-43aa-9956-6cb86a5cc4bc service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:34.703922 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00622b46-8286-43aa-9956-6cb86a5cc4bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:34.704273 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00622b46-8286-43aa-9956-6cb86a5cc4bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:34.707206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-00622b46-8286-43aa-9956-6cb86a5cc4bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:25:34.719898 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00622b46-8286-43aa-9956-6cb86a5cc4bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:34.721497 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00622b46-8286-43aa-9956-6cb86a5cc4bc service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:34.730047 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1247/2525] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:25:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:25:44.726524 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=6 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:26:02.710966 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50a60c-1b46-4195-aecf-a479922fc6f0 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:26:02.722062 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50a60c-1b46-4195-aecf-a479922fc6f0 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:26:02.725768 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e6513-15a5-4768-930b-76c737abc5e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:26:02.726376 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e6513-15a5-4768-930b-76c737abc5e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:26:02.726650 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e6513-15a5-4768-930b-76c737abc5e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:26:02.726915 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e6513-15a5-4768-930b-76c737abc5e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:26:02.728700 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-0a5e6513-15a5-4768-930b-76c737abc5e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:26:02.742590 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e6513-15a5-4768-930b-76c737abc5e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:26:02.744097 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e6513-15a5-4768-930b-76c737abc5e3 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:26:02.755926 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1279/2526] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:26:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:26:03.938665 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00622b46-8286-43aa-9956-6cb86a5cc4bc service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:26:03.947476 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00622b46-8286-43aa-9956-6cb86a5cc4bc service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:26:03.951227 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f917439-08b1-40b6-9577-5e0f5eb7cb59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:26:03.951890 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f917439-08b1-40b6-9577-5e0f5eb7cb59 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:26:03.952169 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f917439-08b1-40b6-9577-5e0f5eb7cb59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:26:03.952441 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f917439-08b1-40b6-9577-5e0f5eb7cb59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:26:03.954187 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-3f917439-08b1-40b6-9577-5e0f5eb7cb59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:26:03.968113 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f917439-08b1-40b6-9577-5e0f5eb7cb59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:26:03.969552 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f917439-08b1-40b6-9577-5e0f5eb7cb59 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:26:03.981209 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1248/2527] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:26:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:26:04.711917 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e6513-15a5-4768-930b-76c737abc5e3 service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:26:04.713611 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-0a5e6513-15a5-4768-930b-76c737abc5e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:26:04.728503 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e6513-15a5-4768-930b-76c737abc5e3 service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:26:04.735104 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57383d6-fec7-437f-ad0a-78c1b758b6d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:26:04.735778 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57383d6-fec7-437f-ad0a-78c1b758b6d1 service nova] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:26:04.736078 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57383d6-fec7-437f-ad0a-78c1b758b6d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:26:04.736345 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57383d6-fec7-437f-ad0a-78c1b758b6d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:26:04.738282 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-b57383d6-fec7-437f-ad0a-78c1b758b6d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:26:04.753168 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57383d6-fec7-437f-ad0a-78c1b758b6d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:26:04.754817 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57383d6-fec7-437f-ad0a-78c1b758b6d1 service nova] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:26:04.765899 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1280/2528] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:26:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:26:09.557266 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f917439-08b1-40b6-9577-5e0f5eb7cb59 service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:26:09.558995 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-3f917439-08b1-40b6-9577-5e0f5eb7cb59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:26:09.648096 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f917439-08b1-40b6-9577-5e0f5eb7cb59 service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:26:09.653394 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a01ef-f5e9-4a8c-9d90-689d8364f8fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:26:09.654026 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a01ef-f5e9-4a8c-9d90-689d8364f8fb service placement] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:26:09.654324 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a01ef-f5e9-4a8c-9d90-689d8364f8fb service placement] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:26:09.654583 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a01ef-f5e9-4a8c-9d90-689d8364f8fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:26:09.656448 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-711a01ef-f5e9-4a8c-9d90-689d8364f8fb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:26:09.668326 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a01ef-f5e9-4a8c-9d90-689d8364f8fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:26:09.669937 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a01ef-f5e9-4a8c-9d90-689d8364f8fb service placement] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:26:09.679953 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1249/2529] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:26:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:26:14.761060 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=12 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:26:15.952617 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc14cf-adc2-4b4d-9d4c-8faa47b52ae3 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:26:15.953303 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc14cf-adc2-4b4d-9d4c-8faa47b52ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:26:15.953303 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc14cf-adc2-4b4d-9d4c-8faa47b52ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:26:15.973265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-4efc14cf-adc2-4b4d-9d4c-8faa47b52ae3 None None] MFA Rules not processed for user `9e467b255bf54ded9815e902e99b41df`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:26:15.974476 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-4efc14cf-adc2-4b4d-9d4c-8faa47b52ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:26:15.982201 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1281/2530] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:26:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:26:16.670877 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a01ef-f5e9-4a8c-9d90-689d8364f8fb service placement] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:26:16.685248 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a01ef-f5e9-4a8c-9d90-689d8364f8fb service placement] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:26:16.690870 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ee90b-70a2-4355-acd3-c2562cb40b2b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:26:16.691541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ee90b-70a2-4355-acd3-c2562cb40b2b service placement] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:26:16.691822 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ee90b-70a2-4355-acd3-c2562cb40b2b service placement] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:26:16.692089 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ee90b-70a2-4355-acd3-c2562cb40b2b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:26:16.693962 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-ef7ee90b-70a2-4355-acd3-c2562cb40b2b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:26:16.707976 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7ee90b-70a2-4355-acd3-c2562cb40b2b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:26:16.709988 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7ee90b-70a2-4355-acd3-c2562cb40b2b service placement] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:26:16.726503 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1250/2531] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:26:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:26:25.968918 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:26:26.716198 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=44 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:28:19.070859 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc14cf-adc2-4b4d-9d4c-8faa47b52ae3 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:28:19.084560 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc14cf-adc2-4b4d-9d4c-8faa47b52ae3 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:28:19.091230 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bbf342-46e8-4e81-a8fa-9818d165bc96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:28:19.091889 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbf342-46e8-4e81-a8fa-9818d165bc96 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:28:19.092172 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbf342-46e8-4e81-a8fa-9818d165bc96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:28:19.092440 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbf342-46e8-4e81-a8fa-9818d165bc96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:28:19.094679 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-31bbf342-46e8-4e81-a8fa-9818d165bc96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:28:19.132389 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bbf342-46e8-4e81-a8fa-9818d165bc96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:28:19.133817 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bbf342-46e8-4e81-a8fa-9818d165bc96 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:28:19.153109 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1282/2532] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:28:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:28:29.150288 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=19 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:29:03.180500 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ee90b-70a2-4355-acd3-c2562cb40b2b service placement] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:29:03.195950 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ee90b-70a2-4355-acd3-c2562cb40b2b service placement] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:29:03.202692 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54faf82-67f0-4f35-8b41-3ae452dc9075 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:29:03.203420 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54faf82-67f0-4f35-8b41-3ae452dc9075 service nova] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:29:03.203816 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54faf82-67f0-4f35-8b41-3ae452dc9075 service nova] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:29:03.204152 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54faf82-67f0-4f35-8b41-3ae452dc9075 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:29:03.206015 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-c54faf82-67f0-4f35-8b41-3ae452dc9075 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:29:03.222184 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54faf82-67f0-4f35-8b41-3ae452dc9075 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:29:03.223815 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54faf82-67f0-4f35-8b41-3ae452dc9075 service nova] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:29:03.242832 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1251/2533] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:29:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:29:06.699353 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bbf342-46e8-4e81-a8fa-9818d165bc96 service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:29:06.701027 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-31bbf342-46e8-4e81-a8fa-9818d165bc96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:29:06.717867 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bbf342-46e8-4e81-a8fa-9818d165bc96 service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:29:06.723081 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13149acb-36b9-4e45-b349-0f5c256ba92c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:29:06.723729 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13149acb-36b9-4e45-b349-0f5c256ba92c service placement] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:29:06.724003 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13149acb-36b9-4e45-b349-0f5c256ba92c service placement] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:29:06.724270 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13149acb-36b9-4e45-b349-0f5c256ba92c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:29:06.726138 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-13149acb-36b9-4e45-b349-0f5c256ba92c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:29:06.738018 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13149acb-36b9-4e45-b349-0f5c256ba92c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:29:06.739979 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13149acb-36b9-4e45-b349-0f5c256ba92c service placement] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:29:06.751473 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1283/2534] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:29:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:29:11.068547 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54faf82-67f0-4f35-8b41-3ae452dc9075 service nova] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:29:11.080685 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54faf82-67f0-4f35-8b41-3ae452dc9075 service nova] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:29:11.086630 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08eab5e-83a4-4117-b34c-94c5b119a96c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:29:11.087402 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08eab5e-83a4-4117-b34c-94c5b119a96c service placement] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:29:11.087729 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08eab5e-83a4-4117-b34c-94c5b119a96c service placement] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:29:11.088009 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08eab5e-83a4-4117-b34c-94c5b119a96c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:29:11.089854 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-b08eab5e-83a4-4117-b34c-94c5b119a96c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:29:11.102159 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08eab5e-83a4-4117-b34c-94c5b119a96c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:29:11.104046 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08eab5e-83a4-4117-b34c-94c5b119a96c service placement] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:29:11.115788 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1252/2535] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:29:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:29:12.827120 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13149acb-36b9-4e45-b349-0f5c256ba92c service placement] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:29:12.836932 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13149acb-36b9-4e45-b349-0f5c256ba92c service placement] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:29:12.840854 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694994ec-75c9-476f-886d-638947f62f13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:29:12.841463 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694994ec-75c9-476f-886d-638947f62f13 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:29:12.841738 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694994ec-75c9-476f-886d-638947f62f13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:29:12.842007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694994ec-75c9-476f-886d-638947f62f13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:29:12.844007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-694994ec-75c9-476f-886d-638947f62f13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:29:12.928293 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694994ec-75c9-476f-886d-638947f62f13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:29:12.929809 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694994ec-75c9-476f-886d-638947f62f13 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:29:12.949983 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1284/2536] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:29:12 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:29:17.353503 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539b9fe-9ac8-457e-8583-76eef3ed0520 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:29:17.354000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539b9fe-9ac8-457e-8583-76eef3ed0520 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:29:17.354104 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539b9fe-9ac8-457e-8583-76eef3ed0520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:29:17.386156 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-2539b9fe-9ac8-457e-8583-76eef3ed0520 None None] MFA Rules not processed for user `9e467b255bf54ded9815e902e99b41df`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:29:17.387395 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-2539b9fe-9ac8-457e-8583-76eef3ed0520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:29:17.394548 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1253/2537] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:29:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:29:17.723104 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694994ec-75c9-476f-886d-638947f62f13 service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:29:17.732508 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694994ec-75c9-476f-886d-638947f62f13 service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:29:17.736854 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42dc9b6-a094-458b-8da2-e549b10c4fa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:29:17.737553 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42dc9b6-a094-458b-8da2-e549b10c4fa6 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:29:17.737826 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42dc9b6-a094-458b-8da2-e549b10c4fa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:29:17.738571 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42dc9b6-a094-458b-8da2-e549b10c4fa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:29:17.740447 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-a42dc9b6-a094-458b-8da2-e549b10c4fa6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:29:17.757572 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42dc9b6-a094-458b-8da2-e549b10c4fa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:29:17.759361 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42dc9b6-a094-458b-8da2-e549b10c4fa6 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:29:17.769625 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1285/2538] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:29:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:29:25.988493 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2539b9fe-9ac8-457e-8583-76eef3ed0520 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:29:26.003583 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2539b9fe-9ac8-457e-8583-76eef3ed0520 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:29:26.010819 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e2964-8d4c-41c1-aebe-0e6eac56744f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:29:26.011465 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e2964-8d4c-41c1-aebe-0e6eac56744f service nova] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:29:26.011774 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e2964-8d4c-41c1-aebe-0e6eac56744f service nova] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:29:26.012045 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e2964-8d4c-41c1-aebe-0e6eac56744f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:29:26.014136 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-1e3e2964-8d4c-41c1-aebe-0e6eac56744f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:29:26.027800 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3e2964-8d4c-41c1-aebe-0e6eac56744f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:29:26.029552 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3e2964-8d4c-41c1-aebe-0e6eac56744f service nova] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:29:26.040654 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1254/2539] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:29:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:29:27.765140 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=55 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:29:31.279375 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ee3e0-9706-4756-a63b-2b7a10ae155b None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:29:31.280032 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ee3e0-9706-4756-a63b-2b7a10ae155b None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:29:31.280032 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ee3e0-9706-4756-a63b-2b7a10ae155b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:29:31.298632 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-822ee3e0-9706-4756-a63b-2b7a10ae155b None None] MFA Rules not processed for user `9e467b255bf54ded9815e902e99b41df`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:29:31.299884 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-822ee3e0-9706-4756-a63b-2b7a10ae155b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:29:31.307474 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1286/2540] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:29:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:29:31.645835 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e2964-8d4c-41c1-aebe-0e6eac56744f service nova] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:29:31.652428 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=25 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:29:31.659466 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e2964-8d4c-41c1-aebe-0e6eac56744f service nova] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:29:31.663702 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00b0ec-69be-47c4-8df1-f50b591816e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:29:31.664315 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00b0ec-69be-47c4-8df1-f50b591816e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:29:31.664593 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00b0ec-69be-47c4-8df1-f50b591816e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:29:31.664861 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00b0ec-69be-47c4-8df1-f50b591816e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:29:31.667088 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-2e00b0ec-69be-47c4-8df1-f50b591816e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:29:31.679257 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e00b0ec-69be-47c4-8df1-f50b591816e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:29:31.681784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e00b0ec-69be-47c4-8df1-f50b591816e7 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:29:31.690134 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1255/2541] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:29:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:29:41.293499 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:29:41.686516 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=5 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:30:44.883871 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e991f95-1bbb-4608-bba5-8017b43fd088 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:30:44.884484 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e991f95-1bbb-4608-bba5-8017b43fd088 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:30:44.884484 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e991f95-1bbb-4608-bba5-8017b43fd088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:30:44.904953 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-5e991f95-1bbb-4608-bba5-8017b43fd088 None None] MFA Rules not processed for user `9e467b255bf54ded9815e902e99b41df`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:30:44.906185 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-5e991f95-1bbb-4608-bba5-8017b43fd088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:30:44.924538 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1287/2542] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:30:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:30:47.510021 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00b0ec-69be-47c4-8df1-f50b591816e7 service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:30:47.519411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00b0ec-69be-47c4-8df1-f50b591816e7 service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:30:47.523519 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e13a115-0545-492d-bf0a-d165d81b2184 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:30:47.524290 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13a115-0545-492d-bf0a-d165d81b2184 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:30:47.524569 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13a115-0545-492d-bf0a-d165d81b2184 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:30:47.524821 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13a115-0545-492d-bf0a-d165d81b2184 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:30:47.533187 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e13a115-0545-492d-bf0a-d165d81b2184 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:30:47.534632 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e13a115-0545-492d-bf0a-d165d81b2184 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:30:47.543175 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1256/2543] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:30:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:30:54.899831 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:30:57.539428 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=6 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:31:36.477052 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e991f95-1bbb-4608-bba5-8017b43fd088 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:31:36.487585 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e991f95-1bbb-4608-bba5-8017b43fd088 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:31:36.491453 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc05ceb-d6e1-4780-bff1-dbae23104456 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:31:36.492294 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc05ceb-d6e1-4780-bff1-dbae23104456 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:31:36.492743 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc05ceb-d6e1-4780-bff1-dbae23104456 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:31:36.493177 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc05ceb-d6e1-4780-bff1-dbae23104456 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:31:36.504935 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc05ceb-d6e1-4780-bff1-dbae23104456 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:31:36.506376 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc05ceb-d6e1-4780-bff1-dbae23104456 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:31:36.518641 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1288/2544] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:31:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:31:37.715943 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e13a115-0545-492d-bf0a-d165d81b2184 service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:31:37.725029 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e13a115-0545-492d-bf0a-d165d81b2184 service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:31:37.729037 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c707f17-ef7c-4134-b289-282bbbad4140 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:31:37.729673 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c707f17-ef7c-4134-b289-282bbbad4140 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:31:37.729953 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c707f17-ef7c-4134-b289-282bbbad4140 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:31:37.730250 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c707f17-ef7c-4134-b289-282bbbad4140 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:31:37.741196 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c707f17-ef7c-4134-b289-282bbbad4140 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:31:37.742633 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c707f17-ef7c-4134-b289-282bbbad4140 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:31:37.753779 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1257/2545] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:31:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:31:38.458716 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc05ceb-d6e1-4780-bff1-dbae23104456 service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:31:38.461053 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-2cc05ceb-d6e1-4780-bff1-dbae23104456 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:31:38.476838 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc05ceb-d6e1-4780-bff1-dbae23104456 service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:31:38.482642 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c0163f-40aa-4358-9420-306beab4abe8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:31:38.483337 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0163f-40aa-4358-9420-306beab4abe8 service nova] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:31:38.483616 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0163f-40aa-4358-9420-306beab4abe8 service nova] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:31:38.483908 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0163f-40aa-4358-9420-306beab4abe8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:31:38.493423 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c0163f-40aa-4358-9420-306beab4abe8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:31:38.495014 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c0163f-40aa-4358-9420-306beab4abe8 service nova] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:31:38.506640 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1289/2546] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:31:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:31:42.430095 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c707f17-ef7c-4134-b289-282bbbad4140 service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:31:42.431767 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-0c707f17-ef7c-4134-b289-282bbbad4140 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:31:42.496928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c707f17-ef7c-4134-b289-282bbbad4140 service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:31:42.501474 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50473973-3bd1-4dc9-9010-c9f2a849889f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:31:42.502118 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50473973-3bd1-4dc9-9010-c9f2a849889f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:31:42.502396 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50473973-3bd1-4dc9-9010-c9f2a849889f admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:31:42.502667 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50473973-3bd1-4dc9-9010-c9f2a849889f admin admin] PATH_INFO: `/v3/users/9e467b255bf54ded9815e902e99b41df` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:31:42.503854 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50473973-3bd1-4dc9-9010-c9f2a849889f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e467b255bf54ded9815e902e99b41df)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:31:42.505901 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50473973-3bd1-4dc9-9010-c9f2a849889f admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:31:42.555838 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-50473973-3bd1-4dc9-9010-c9f2a849889f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e467b255bf54ded9815e902e99b41df'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:31:42.556407 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-50473973-3bd1-4dc9-9010-c9f2a849889f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e467b255bf54ded9815e902e99b41df'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:31:42.568408 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-50473973-3bd1-4dc9-9010-c9f2a849889f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e467b255bf54ded9815e902e99b41df'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:31:42.577114 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-50473973-3bd1-4dc9-9010-c9f2a849889f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e467b255bf54ded9815e902e99b41df'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:31:42.577716 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-50473973-3bd1-4dc9-9010-c9f2a849889f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e467b255bf54ded9815e902e99b41df'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:31:42.590152 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1258/2547] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:31:42 2022] DELETE /identity/v3/users/9e467b255bf54ded9815e902e99b41df => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:31:42.594849 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99951239-7562-4b28-9195-667c2381d398 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:31:42.595364 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99951239-7562-4b28-9195-667c2381d398 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:31:42.595509 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99951239-7562-4b28-9195-667c2381d398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:31:42.615069 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-99951239-7562-4b28-9195-667c2381d398 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:31:42.616359 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-99951239-7562-4b28-9195-667c2381d398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:31:42.677571 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1290/2548] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:31:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:31:42.688664 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50473973-3bd1-4dc9-9010-c9f2a849889f admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:31:42.690345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-50473973-3bd1-4dc9-9010-c9f2a849889f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:31:42.749484 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50473973-3bd1-4dc9-9010-c9f2a849889f admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:31:42.753228 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d375fa-5551-4e74-a714-2c54978e5735 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:31:42.753850 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d375fa-5551-4e74-a714-2c54978e5735 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:31:42.754128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d375fa-5551-4e74-a714-2c54978e5735 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:31:42.754396 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d375fa-5551-4e74-a714-2c54978e5735 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:31:42.763440 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d375fa-5551-4e74-a714-2c54978e5735 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:31:42.764913 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d375fa-5551-4e74-a714-2c54978e5735 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:31:42.774545 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1259/2549] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:31:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:31:42.964630 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99951239-7562-4b28-9195-667c2381d398 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:31:42.966179 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-99951239-7562-4b28-9195-667c2381d398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:31:42.979216 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99951239-7562-4b28-9195-667c2381d398 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:31:42.983768 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58605cbf-3274-444b-ac1d-d926bf3798e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:31:42.984436 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58605cbf-3274-444b-ac1d-d926bf3798e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:31:42.984711 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58605cbf-3274-444b-ac1d-d926bf3798e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:31:42.984981 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58605cbf-3274-444b-ac1d-d926bf3798e5 admin admin] PATH_INFO: `/v3/projects/8ec7f181b4e645638ca006d6311cc7e3` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:31:42.986404 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58605cbf-3274-444b-ac1d-d926bf3798e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ec7f181b4e645638ca006d6311cc7e3)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:31:42.988701 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58605cbf-3274-444b-ac1d-d926bf3798e5 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:31:43.045370 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-58605cbf-3274-444b-ac1d-d926bf3798e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ec7f181b4e645638ca006d6311cc7e3', 'request_id': 'req-58605cbf-3274-444b-ac1d-d926bf3798e5'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:31:43.051192 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-58605cbf-3274-444b-ac1d-d926bf3798e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ec7f181b4e645638ca006d6311cc7e3', 'request_id': 'req-58605cbf-3274-444b-ac1d-d926bf3798e5'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:31:43.058122 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-58605cbf-3274-444b-ac1d-d926bf3798e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ec7f181b4e645638ca006d6311cc7e3', 'request_id': 'req-58605cbf-3274-444b-ac1d-d926bf3798e5'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:31:43.072096 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-58605cbf-3274-444b-ac1d-d926bf3798e5 admin admin] The token cache is being invalidate because project 8ec7f181b4e645638ca006d6311cc7e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:31:43.072311 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-58605cbf-3274-444b-ac1d-d926bf3798e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:31:43.072988 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-58605cbf-3274-444b-ac1d-d926bf3798e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:31:43.074577 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1291/2550] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:31:42 2022] DELETE /identity/v3/projects/8ec7f181b4e645638ca006d6311cc7e3 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:31:43.078687 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d375fa-5551-4e74-a714-2c54978e5735 service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:31:43.088920 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d375fa-5551-4e74-a714-2c54978e5735 service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:31:43.093944 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:31:43.151298 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13323069-9c66-4159-9bd3-993116261126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:31:43.151960 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13323069-9c66-4159-9bd3-993116261126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:31:43.152260 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13323069-9c66-4159-9bd3-993116261126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:31:43.152528 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13323069-9c66-4159-9bd3-993116261126 admin admin] PATH_INFO: `/v3/users/647397d2645d4553b22e75219cee8ec5` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:31:43.153745 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13323069-9c66-4159-9bd3-993116261126 admin admin] RBAC: Authorizing `identity:delete_user(user_id=647397d2645d4553b22e75219cee8ec5)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:31:43.155701 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13323069-9c66-4159-9bd3-993116261126 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:31:43.203255 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-13323069-9c66-4159-9bd3-993116261126 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '647397d2645d4553b22e75219cee8ec5'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:31:43.203928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-13323069-9c66-4159-9bd3-993116261126 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '647397d2645d4553b22e75219cee8ec5'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:31:43.215648 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-13323069-9c66-4159-9bd3-993116261126 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '647397d2645d4553b22e75219cee8ec5'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:31:43.224354 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-13323069-9c66-4159-9bd3-993116261126 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '647397d2645d4553b22e75219cee8ec5'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:31:43.225017 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-13323069-9c66-4159-9bd3-993116261126 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '647397d2645d4553b22e75219cee8ec5'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:31:43.238879 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1260/2551] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:31:43 2022] DELETE /identity/v3/users/647397d2645d4553b22e75219cee8ec5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:31:43.530689 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58605cbf-3274-444b-ac1d-d926bf3798e5 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:31:43.532192 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-58605cbf-3274-444b-ac1d-d926bf3798e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:31:43.549965 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58605cbf-3274-444b-ac1d-d926bf3798e5 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:31:43.601849 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:31:43.608805 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8fa1cd-573d-40bf-891f-d103564691ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:31:43.609740 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fa1cd-573d-40bf-891f-d103564691ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:31:43.610142 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fa1cd-573d-40bf-891f-d103564691ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:31:43.610753 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fa1cd-573d-40bf-891f-d103564691ea admin admin] PATH_INFO: `/v3/projects/2efc4e5a30774a44b8fa9ebcb6ad103d` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:31:43.612270 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8fa1cd-573d-40bf-891f-d103564691ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=2efc4e5a30774a44b8fa9ebcb6ad103d)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:31:43.614358 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8fa1cd-573d-40bf-891f-d103564691ea admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:31:43.664648 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-8d8fa1cd-573d-40bf-891f-d103564691ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2efc4e5a30774a44b8fa9ebcb6ad103d', 'request_id': 'req-8d8fa1cd-573d-40bf-891f-d103564691ea'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:31:43.670423 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-8d8fa1cd-573d-40bf-891f-d103564691ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2efc4e5a30774a44b8fa9ebcb6ad103d', 'request_id': 'req-8d8fa1cd-573d-40bf-891f-d103564691ea'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:31:43.676745 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-8d8fa1cd-573d-40bf-891f-d103564691ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2efc4e5a30774a44b8fa9ebcb6ad103d', 'request_id': 'req-8d8fa1cd-573d-40bf-891f-d103564691ea'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:31:43.691842 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-8d8fa1cd-573d-40bf-891f-d103564691ea admin admin] The token cache is being invalidate because project 2efc4e5a30774a44b8fa9ebcb6ad103d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:31:43.692153 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-8d8fa1cd-573d-40bf-891f-d103564691ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:31:43.692801 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-8d8fa1cd-573d-40bf-891f-d103564691ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:31:43.694474 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1292/2552] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:31:43 2022] DELETE /identity/v3/projects/2efc4e5a30774a44b8fa9ebcb6ad103d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:31:43.699925 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1be9b-a312-4564-adf8-4b01daeb0541 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:31:43.700690 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1be9b-a312-4564-adf8-4b01daeb0541 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:31:43.700876 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1be9b-a312-4564-adf8-4b01daeb0541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:31:43.722869 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-fdf1be9b-a312-4564-adf8-4b01daeb0541 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:31:43.724090 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-fdf1be9b-a312-4564-adf8-4b01daeb0541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:31:43.795362 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1261/2553] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:31:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:31:43.804288 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bf14d-930b-4795-861c-98f0b966c56c None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:31:43.804543 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bf14d-930b-4795-861c-98f0b966c56c None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:31:43.804836 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bf14d-930b-4795-861c-98f0b966c56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:31:43.827991 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-bc7bf14d-930b-4795-861c-98f0b966c56c None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:31:43.829244 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-bc7bf14d-930b-4795-861c-98f0b966c56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:31:43.838858 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1293/2554] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:31:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:31:43.843284 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1be9b-a312-4564-adf8-4b01daeb0541 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:31:43.853320 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1be9b-a312-4564-adf8-4b01daeb0541 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:31:43.858009 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad89bf-70ae-4c32-bbd2-f8e4a47bab9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:31:43.858707 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad89bf-70ae-4c32-bbd2-f8e4a47bab9d admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:31:43.858978 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad89bf-70ae-4c32-bbd2-f8e4a47bab9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:31:43.859249 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad89bf-70ae-4c32-bbd2-f8e4a47bab9d admin admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:31:43.860140 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad89bf-70ae-4c32-bbd2-f8e4a47bab9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:31:43.860442 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad89bf-70ae-4c32-bbd2-f8e4a47bab9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:31:43.862026 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad89bf-70ae-4c32-bbd2-f8e4a47bab9d admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:31:43.874364 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1262/2555] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:31:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:31:43.878613 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7bf14d-930b-4795-861c-98f0b966c56c None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:31:43.888449 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7bf14d-930b-4795-861c-98f0b966c56c None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:31:43.894285 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa10f3-4a01-4851-a4a6-171bf89d74b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:31:43.894897 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa10f3-4a01-4851-a4a6-171bf89d74b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:31:43.895177 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa10f3-4a01-4851-a4a6-171bf89d74b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:31:43.895448 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa10f3-4a01-4851-a4a6-171bf89d74b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:31:43.896153 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa10f3-4a01-4851-a4a6-171bf89d74b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:31:43.898107 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa10f3-4a01-4851-a4a6-171bf89d74b7 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:31:43.939678 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1294/2556] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:31:43 2022] POST /identity/v3/projects => generated 379 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:31:43.944326 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad89bf-70ae-4c32-bbd2-f8e4a47bab9d admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:31:43.954504 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad89bf-70ae-4c32-bbd2-f8e4a47bab9d admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:31:43.966158 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:31:44.015401 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17344afe-252f-4603-8a73-b75c415b9f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:31:44.016086 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17344afe-252f-4603-8a73-b75c415b9f81 admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:31:44.016366 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17344afe-252f-4603-8a73-b75c415b9f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:31:44.016637 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17344afe-252f-4603-8a73-b75c415b9f81 admin admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:31:44.017307 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17344afe-252f-4603-8a73-b75c415b9f81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:31:44.019194 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17344afe-252f-4603-8a73-b75c415b9f81 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:31:44.043257 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1263/2557] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:31:43 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:31:44.048318 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa10f3-4a01-4851-a4a6-171bf89d74b7 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:31:44.064353 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa10f3-4a01-4851-a4a6-171bf89d74b7 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:31:44.071689 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc919dc0-9755-46b9-bcb3-fbcb54377427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:31:44.072599 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc919dc0-9755-46b9-bcb3-fbcb54377427 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:31:44.072958 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc919dc0-9755-46b9-bcb3-fbcb54377427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:31:44.073323 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc919dc0-9755-46b9-bcb3-fbcb54377427 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:31:44.074398 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc919dc0-9755-46b9-bcb3-fbcb54377427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:31:44.076903 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc919dc0-9755-46b9-bcb3-fbcb54377427 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:31:44.089808 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1295/2558] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:31:44.094077 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17344afe-252f-4603-8a73-b75c415b9f81 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:31:44.104879 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17344afe-252f-4603-8a73-b75c415b9f81 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:31:44.111783 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c3aa7-1733-45a2-82dd-01dee9261317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:31:44.112539 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c3aa7-1733-45a2-82dd-01dee9261317 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:31:44.112862 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c3aa7-1733-45a2-82dd-01dee9261317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:31:44.113195 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c3aa7-1733-45a2-82dd-01dee9261317 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:31:44.113981 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c3aa7-1733-45a2-82dd-01dee9261317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:31:44.115815 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c3aa7-1733-45a2-82dd-01dee9261317 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:31:44.128643 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1264/2559] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:31:44.134679 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc919dc0-9755-46b9-bcb3-fbcb54377427 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:31:44.149124 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc919dc0-9755-46b9-bcb3-fbcb54377427 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:31:44.154931 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d117a19-4aa0-4bb3-84d6-bc1c4e14eb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:31:44.155663 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d117a19-4aa0-4bb3-84d6-bc1c4e14eb32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:31:44.155911 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d117a19-4aa0-4bb3-84d6-bc1c4e14eb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:31:44.156161 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d117a19-4aa0-4bb3-84d6-bc1c4e14eb32 admin admin] PATH_INFO: `/v3/projects/29cc6b54ae36404389648689e6a01b70/users/c4caf6983e454e18b0f6a8b135a598df/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:31:44.171708 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d117a19-4aa0-4bb3-84d6-bc1c4e14eb32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29cc6b54ae36404389648689e6a01b70, user_id=c4caf6983e454e18b0f6a8b135a598df, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:31:44.174353 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d117a19-4aa0-4bb3-84d6-bc1c4e14eb32 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:31:44.194802 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1296/2560] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:31:44 2022] PUT /identity/v3/projects/29cc6b54ae36404389648689e6a01b70/users/c4caf6983e454e18b0f6a8b135a598df/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:31:44.201792 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588c12f-1a83-4c6f-aadb-4827eca6804f None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:31:44.202074 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588c12f-1a83-4c6f-aadb-4827eca6804f None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:31:44.202342 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588c12f-1a83-4c6f-aadb-4827eca6804f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:31:44.224043 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-0588c12f-1a83-4c6f-aadb-4827eca6804f None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:31:44.225314 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-0588c12f-1a83-4c6f-aadb-4827eca6804f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:31:44.301600 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1265/2561] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:31:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:31:44.311565 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d117a19-4aa0-4bb3-84d6-bc1c4e14eb32 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:31:44.313378 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-2d117a19-4aa0-4bb3-84d6-bc1c4e14eb32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:31:44.373678 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d117a19-4aa0-4bb3-84d6-bc1c4e14eb32 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:31:44.377493 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b92e7c-1a38-4266-a485-4dc27976d64b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:31:44.378119 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b92e7c-1a38-4266-a485-4dc27976d64b service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:31:44.378398 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b92e7c-1a38-4266-a485-4dc27976d64b service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:31:44.378667 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b92e7c-1a38-4266-a485-4dc27976d64b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:31:44.387948 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b92e7c-1a38-4266-a485-4dc27976d64b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:31:44.389394 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b92e7c-1a38-4266-a485-4dc27976d64b service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:31:44.399028 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1297/2562] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:31:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:31:48.492575 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727dd7f-3e81-4ba2-821f-7b2f59ed5cb2 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:31:48.493173 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727dd7f-3e81-4ba2-821f-7b2f59ed5cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:31:48.493173 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727dd7f-3e81-4ba2-821f-7b2f59ed5cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:31:48.525987 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-5727dd7f-3e81-4ba2-821f-7b2f59ed5cb2 None None] MFA Rules not processed for user `c4caf6983e454e18b0f6a8b135a598df`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:31:48.529172 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-5727dd7f-3e81-4ba2-821f-7b2f59ed5cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:31:48.611973 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1266/2563] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:31:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:31:48.616611 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b92e7c-1a38-4266-a485-4dc27976d64b service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:31:48.626987 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b92e7c-1a38-4266-a485-4dc27976d64b service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:31:48.631793 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b4ed81-7650-4111-ba86-38e4b3a83730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:31:48.632425 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4ed81-7650-4111-ba86-38e4b3a83730 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:31:48.632702 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4ed81-7650-4111-ba86-38e4b3a83730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:31:48.632976 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4ed81-7650-4111-ba86-38e4b3a83730 admin admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:31:48.633646 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b4ed81-7650-4111-ba86-38e4b3a83730 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:31:48.635587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b4ed81-7650-4111-ba86-38e4b3a83730 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:31:48.653570 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:31:48.669683 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1298/2564] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:31:48 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:31:48.674181 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727dd7f-3e81-4ba2-821f-7b2f59ed5cb2 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:31:48.687054 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727dd7f-3e81-4ba2-821f-7b2f59ed5cb2 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:31:48.708616 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:31:48.747719 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba9683-9cfd-41d1-abbd-d37b221fc6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:31:48.748366 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba9683-9cfd-41d1-abbd-d37b221fc6e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:31:48.748637 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba9683-9cfd-41d1-abbd-d37b221fc6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:31:48.748903 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba9683-9cfd-41d1-abbd-d37b221fc6e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:31:48.749642 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba9683-9cfd-41d1-abbd-d37b221fc6e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:31:48.751621 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba9683-9cfd-41d1-abbd-d37b221fc6e2 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:31:48.776798 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1267/2565] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:31:48 2022] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:31:48.780974 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b4ed81-7650-4111-ba86-38e4b3a83730 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:31:48.795190 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b4ed81-7650-4111-ba86-38e4b3a83730 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:31:48.800323 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf60dd67-26ef-4c74-98c6-a73cb997b4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:31:48.801203 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60dd67-26ef-4c74-98c6-a73cb997b4a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:31:48.801481 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60dd67-26ef-4c74-98c6-a73cb997b4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:31:48.801749 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60dd67-26ef-4c74-98c6-a73cb997b4a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:31:48.802453 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf60dd67-26ef-4c74-98c6-a73cb997b4a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:31:48.804227 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf60dd67-26ef-4c74-98c6-a73cb997b4a8 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:31:48.815764 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1299/2566] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:31:48.820191 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba9683-9cfd-41d1-abbd-d37b221fc6e2 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:31:48.830598 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba9683-9cfd-41d1-abbd-d37b221fc6e2 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:31:48.835596 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01526d-9aad-4b6b-acb3-8a5871b647ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:31:48.836282 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01526d-9aad-4b6b-acb3-8a5871b647ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:31:48.836561 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01526d-9aad-4b6b-acb3-8a5871b647ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:31:48.836863 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01526d-9aad-4b6b-acb3-8a5871b647ba admin admin] PATH_INFO: `/v3/projects/e9087f4fabf247e7b29d859b0ec0579d/users/ea3aa23a4a0a4aa6a1456c5a89afc910/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:31:48.853061 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01526d-9aad-4b6b-acb3-8a5871b647ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9087f4fabf247e7b29d859b0ec0579d, user_id=ea3aa23a4a0a4aa6a1456c5a89afc910, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:31:48.855767 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01526d-9aad-4b6b-acb3-8a5871b647ba admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:31:48.871924 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1268/2567] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:31:48 2022] PUT /identity/v3/projects/e9087f4fabf247e7b29d859b0ec0579d/users/ea3aa23a4a0a4aa6a1456c5a89afc910/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:31:48.876084 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf60dd67-26ef-4c74-98c6-a73cb997b4a8 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:31:48.886610 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf60dd67-26ef-4c74-98c6-a73cb997b4a8 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:31:48.946750 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875d235-9e7f-4175-8773-017d67e1a074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:31:48.947373 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875d235-9e7f-4175-8773-017d67e1a074 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:31:48.948103 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875d235-9e7f-4175-8773-017d67e1a074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:31:48.948103 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875d235-9e7f-4175-8773-017d67e1a074 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:31:48.948625 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f875d235-9e7f-4175-8773-017d67e1a074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:31:48.951775 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f875d235-9e7f-4175-8773-017d67e1a074 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:31:48.979626 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1300/2568] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:31:48.983892 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01526d-9aad-4b6b-acb3-8a5871b647ba admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:31:48.994546 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01526d-9aad-4b6b-acb3-8a5871b647ba admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:31:49.002334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51cc8cb-aa6a-4d9b-8924-743681a1d7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:31:49.003075 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cc8cb-aa6a-4d9b-8924-743681a1d7a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:31:49.003324 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cc8cb-aa6a-4d9b-8924-743681a1d7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:31:49.003617 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cc8cb-aa6a-4d9b-8924-743681a1d7a2 admin admin] PATH_INFO: `/v3/projects/e9087f4fabf247e7b29d859b0ec0579d/users/ea3aa23a4a0a4aa6a1456c5a89afc910/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:31:49.007665 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51cc8cb-aa6a-4d9b-8924-743681a1d7a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9087f4fabf247e7b29d859b0ec0579d, user_id=ea3aa23a4a0a4aa6a1456c5a89afc910, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:31:49.010348 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51cc8cb-aa6a-4d9b-8924-743681a1d7a2 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:31:49.021553 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1269/2569] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:31:48 2022] PUT /identity/v3/projects/e9087f4fabf247e7b29d859b0ec0579d/users/ea3aa23a4a0a4aa6a1456c5a89afc910/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:31:53.330971 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab757855-2e79-4e46-8a0d-281fd7855ed0 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:31:53.331609 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab757855-2e79-4e46-8a0d-281fd7855ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:31:53.331609 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab757855-2e79-4e46-8a0d-281fd7855ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:31:53.360009 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-ab757855-2e79-4e46-8a0d-281fd7855ed0 None None] MFA Rules not processed for user `ea3aa23a4a0a4aa6a1456c5a89afc910`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:31:53.361409 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-ab757855-2e79-4e46-8a0d-281fd7855ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:31:53.434467 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1301/2570] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:31:53 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:31:53.451243 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51cc8cb-aa6a-4d9b-8924-743681a1d7a2 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:31:53.453727 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-f51cc8cb-aa6a-4d9b-8924-743681a1d7a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:31:53.538540 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51cc8cb-aa6a-4d9b-8924-743681a1d7a2 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:31:53.544581 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05034fdf-02ce-4214-a5be-8c18d637a455 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:31:53.545210 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05034fdf-02ce-4214-a5be-8c18d637a455 service nova] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:31:53.545483 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05034fdf-02ce-4214-a5be-8c18d637a455 service nova] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:31:53.545754 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05034fdf-02ce-4214-a5be-8c18d637a455 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:31:53.603878 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05034fdf-02ce-4214-a5be-8c18d637a455 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:31:53.605519 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05034fdf-02ce-4214-a5be-8c18d637a455 service nova] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:31:53.614701 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1270/2571] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:31:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:32:03.431499 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=70 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:32:03.610434 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=89,keystone:INSERT=5 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:32:11.376630 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1786d9-9558-4257-93ed-c5684b7185fa None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:32:11.377142 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1786d9-9558-4257-93ed-c5684b7185fa None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:32:11.377142 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1786d9-9558-4257-93ed-c5684b7185fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:32:11.397399 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-fa1786d9-9558-4257-93ed-c5684b7185fa None None] MFA Rules not processed for user `c4caf6983e454e18b0f6a8b135a598df`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:32:11.398628 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-fa1786d9-9558-4257-93ed-c5684b7185fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:32:11.405920 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1302/2572] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:32:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:32:12.275689 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05034fdf-02ce-4214-a5be-8c18d637a455 service nova] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:32:12.277279 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-05034fdf-02ce-4214-a5be-8c18d637a455 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:32:12.354467 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05034fdf-02ce-4214-a5be-8c18d637a455 service nova] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:32:12.359513 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd949816-a837-41e3-998d-1d81d02fb84d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:32:12.360663 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd949816-a837-41e3-998d-1d81d02fb84d service placement] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:32:12.360942 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd949816-a837-41e3-998d-1d81d02fb84d service placement] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:32:12.361217 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd949816-a837-41e3-998d-1d81d02fb84d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:32:12.367798 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-fd949816-a837-41e3-998d-1d81d02fb84d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:32:12.381173 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd949816-a837-41e3-998d-1d81d02fb84d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:32:12.382919 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd949816-a837-41e3-998d-1d81d02fb84d service placement] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:32:12.394251 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1271/2573] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:32:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:32:21.391753 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:32:22.390193 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=32 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:32:31.574801 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1786d9-9558-4257-93ed-c5684b7185fa None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:32:31.643443 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1786d9-9558-4257-93ed-c5684b7185fa None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:32:31.653200 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e2937-313a-4c3c-8f9d-0fd2cd1a0848 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:32:31.653937 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e2937-313a-4c3c-8f9d-0fd2cd1a0848 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:32:31.654219 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e2937-313a-4c3c-8f9d-0fd2cd1a0848 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:32:31.654491 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e2937-313a-4c3c-8f9d-0fd2cd1a0848 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:32:31.666653 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e2937-313a-4c3c-8f9d-0fd2cd1a0848 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:32:31.668248 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e2937-313a-4c3c-8f9d-0fd2cd1a0848 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:32:31.678076 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1303/2574] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:32:31 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:32:41.673878 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=26 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:34:38.078127 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd949816-a837-41e3-998d-1d81d02fb84d service placement] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:34:38.142252 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd949816-a837-41e3-998d-1d81d02fb84d service placement] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:34:38.147370 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e28d68-c5ff-497d-a239-dcedd30eaa56 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:34:38.148029 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e28d68-c5ff-497d-a239-dcedd30eaa56 service placement] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:34:38.148306 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e28d68-c5ff-497d-a239-dcedd30eaa56 service placement] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:34:38.148579 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e28d68-c5ff-497d-a239-dcedd30eaa56 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:34:38.150374 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-59e28d68-c5ff-497d-a239-dcedd30eaa56 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:34:38.182623 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e28d68-c5ff-497d-a239-dcedd30eaa56 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:34:38.184263 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e28d68-c5ff-497d-a239-dcedd30eaa56 service placement] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:34:38.194025 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1272/2575] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:34:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:34:39.196397 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b59497-c77e-4410-be02-84ef53f0866e None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:34:39.196928 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b59497-c77e-4410-be02-84ef53f0866e None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:34:39.196928 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b59497-c77e-4410-be02-84ef53f0866e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:34:39.216649 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-77b59497-c77e-4410-be02-84ef53f0866e None None] MFA Rules not processed for user `c4caf6983e454e18b0f6a8b135a598df`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:34:39.217835 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-77b59497-c77e-4410-be02-84ef53f0866e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:34:39.225140 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1304/2576] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:34:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:34:39.552156 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e28d68-c5ff-497d-a239-dcedd30eaa56 service placement] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:34:39.571824 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e28d68-c5ff-497d-a239-dcedd30eaa56 service placement] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:34:39.576445 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c4829-66a7-446c-a499-862411b4c47a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:34:39.577063 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c4829-66a7-446c-a499-862411b4c47a service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:34:39.577337 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c4829-66a7-446c-a499-862411b4c47a service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:34:39.577614 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c4829-66a7-446c-a499-862411b4c47a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:34:39.579617 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-218c4829-66a7-446c-a499-862411b4c47a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:34:39.603117 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c4829-66a7-446c-a499-862411b4c47a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:34:39.604584 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c4829-66a7-446c-a499-862411b4c47a service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:34:39.613266 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1273/2577] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:34:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:34:49.211389 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:34:49.609573 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=51 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:34:57.792037 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b59497-c77e-4410-be02-84ef53f0866e None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:34:57.824332 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b59497-c77e-4410-be02-84ef53f0866e None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:34:57.831150 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af981a88-fbbd-4475-8129-a602f9456bfa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:34:57.831856 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af981a88-fbbd-4475-8129-a602f9456bfa service nova] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:34:57.832160 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af981a88-fbbd-4475-8129-a602f9456bfa service nova] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:34:57.832520 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af981a88-fbbd-4475-8129-a602f9456bfa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:34:57.834610 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-af981a88-fbbd-4475-8129-a602f9456bfa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:34:57.861750 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af981a88-fbbd-4475-8129-a602f9456bfa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:34:57.863353 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af981a88-fbbd-4475-8129-a602f9456bfa service nova] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:34:57.874175 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1305/2578] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:34:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:35:07.869582 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=18 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:36:40.102117 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27306c83-ee9b-4546-b549-0c152db7a811 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:36:40.102649 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27306c83-ee9b-4546-b549-0c152db7a811 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:36:40.102649 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27306c83-ee9b-4546-b549-0c152db7a811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:36:40.123943 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-27306c83-ee9b-4546-b549-0c152db7a811 None None] MFA Rules not processed for user `c4caf6983e454e18b0f6a8b135a598df`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:36:40.125151 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-27306c83-ee9b-4546-b549-0c152db7a811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:36:40.132639 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1274/2579] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:36:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:36:40.181813 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af981a88-fbbd-4475-8129-a602f9456bfa service nova] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:36:40.183555 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-af981a88-fbbd-4475-8129-a602f9456bfa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:36:40.266031 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af981a88-fbbd-4475-8129-a602f9456bfa service nova] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:36:40.270465 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a8d10-b840-4f8e-8dd7-cf162a1f544d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1943ab629b6411d81327a845b77c8c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:36:40.271088 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a8d10-b840-4f8e-8dd7-cf162a1f544d service cinder] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:36:40.271368 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a8d10-b840-4f8e-8dd7-cf162a1f544d service cinder] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:36:40.271662 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a8d10-b840-4f8e-8dd7-cf162a1f544d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:36:40.273850 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-4a7a8d10-b840-4f8e-8dd7-cf162a1f544d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:36:40.288915 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7a8d10-b840-4f8e-8dd7-cf162a1f544d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:36:40.290344 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7a8d10-b840-4f8e-8dd7-cf162a1f544d service cinder] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:36:40.302663 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1306/2580] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:36:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:36:41.069047 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27306c83-ee9b-4546-b549-0c152db7a811 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:36:41.070503 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-27306c83-ee9b-4546-b549-0c152db7a811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:36:41.083121 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27306c83-ee9b-4546-b549-0c152db7a811 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:36:41.086629 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e4a1f-06d8-4d3a-8489-cda6fff9c070 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:36:41.087249 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e4a1f-06d8-4d3a-8489-cda6fff9c070 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:36:41.087628 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e4a1f-06d8-4d3a-8489-cda6fff9c070 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:36:41.087903 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e4a1f-06d8-4d3a-8489-cda6fff9c070 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:36:41.089591 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-cd6e4a1f-06d8-4d3a-8489-cda6fff9c070 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:36:41.102881 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e4a1f-06d8-4d3a-8489-cda6fff9c070 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:36:41.104347 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e4a1f-06d8-4d3a-8489-cda6fff9c070 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:36:41.115987 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1275/2581] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:36:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:36:42.834428 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a8d10-b840-4f8e-8dd7-cf162a1f544d service cinder] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:36:42.846033 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a8d10-b840-4f8e-8dd7-cf162a1f544d service cinder] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:36:42.850242 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166bd7d8-a324-4744-bc36-18943e1a249c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:36:42.851242 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166bd7d8-a324-4744-bc36-18943e1a249c service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:36:42.853072 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166bd7d8-a324-4744-bc36-18943e1a249c service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:36:42.854040 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166bd7d8-a324-4744-bc36-18943e1a249c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:36:42.856801 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-166bd7d8-a324-4744-bc36-18943e1a249c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:36:42.868512 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166bd7d8-a324-4744-bc36-18943e1a249c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:36:42.869977 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166bd7d8-a324-4744-bc36-18943e1a249c service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:36:42.879963 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1307/2582] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:36:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:36:44.229952 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e4a1f-06d8-4d3a-8489-cda6fff9c070 service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:36:44.231557 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-cd6e4a1f-06d8-4d3a-8489-cda6fff9c070 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:36:44.253159 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e4a1f-06d8-4d3a-8489-cda6fff9c070 service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:36:44.262796 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5e022-539c-40b0-941d-446d192b6a2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:36:44.264369 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5e022-539c-40b0-941d-446d192b6a2b service nova] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:36:44.265316 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5e022-539c-40b0-941d-446d192b6a2b service nova] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:36:44.265583 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5e022-539c-40b0-941d-446d192b6a2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:36:44.269892 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-6db5e022-539c-40b0-941d-446d192b6a2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:36:44.284974 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db5e022-539c-40b0-941d-446d192b6a2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:36:44.286577 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db5e022-539c-40b0-941d-446d192b6a2b service nova] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:36:44.300282 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1276/2583] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:36:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:36:52.875953 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=41 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:36:54.294434 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=15 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:36:54.346841 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166bd7d8-a324-4744-bc36-18943e1a249c service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:36:54.365687 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166bd7d8-a324-4744-bc36-18943e1a249c service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:36:54.373245 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be207727-4a43-4ee3-9af2-1ecde0be49ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:36:54.373874 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be207727-4a43-4ee3-9af2-1ecde0be49ef service nova] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:36:54.374148 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be207727-4a43-4ee3-9af2-1ecde0be49ef service nova] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:36:54.374415 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be207727-4a43-4ee3-9af2-1ecde0be49ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:36:54.383200 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be207727-4a43-4ee3-9af2-1ecde0be49ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:36:54.384848 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be207727-4a43-4ee3-9af2-1ecde0be49ef service nova] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:36:54.393853 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1308/2584] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:36:54 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:37:02.555305 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5e022-539c-40b0-941d-446d192b6a2b service nova] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:37:02.571577 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5e022-539c-40b0-941d-446d192b6a2b service nova] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:37:02.578255 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00170d4-901e-4ec5-ae8a-14aea1707e00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:37:02.579193 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00170d4-901e-4ec5-ae8a-14aea1707e00 service nova] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:37:02.579473 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00170d4-901e-4ec5-ae8a-14aea1707e00 service nova] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:37:02.579790 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00170d4-901e-4ec5-ae8a-14aea1707e00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:37:02.581805 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-b00170d4-901e-4ec5-ae8a-14aea1707e00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:37:02.594882 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00170d4-901e-4ec5-ae8a-14aea1707e00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:37:02.596510 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00170d4-901e-4ec5-ae8a-14aea1707e00 service nova] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:37:02.607317 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1277/2585] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:37:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:37:04.389819 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=6 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:37:12.603118 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=6 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:38:56.599995 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be207727-4a43-4ee3-9af2-1ecde0be49ef service nova] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:38:56.609834 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be207727-4a43-4ee3-9af2-1ecde0be49ef service nova] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:38:56.613477 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a841b6-4da1-4786-a770-3c586b866311 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:38:56.614097 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a841b6-4da1-4786-a770-3c586b866311 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:38:56.614402 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a841b6-4da1-4786-a770-3c586b866311 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:38:56.614675 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a841b6-4da1-4786-a770-3c586b866311 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:38:56.687338 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a841b6-4da1-4786-a770-3c586b866311 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:38:56.688844 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a841b6-4da1-4786-a770-3c586b866311 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:38:56.708077 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1309/2586] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:38:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:38:59.880073 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00170d4-901e-4ec5-ae8a-14aea1707e00 service nova] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:38:59.895163 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00170d4-901e-4ec5-ae8a-14aea1707e00 service nova] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:38:59.905888 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d4f02-ac28-41be-850b-b7db25e29948 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:38:59.906631 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d4f02-ac28-41be-850b-b7db25e29948 service placement] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:38:59.906974 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d4f02-ac28-41be-850b-b7db25e29948 service placement] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:38:59.907448 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d4f02-ac28-41be-850b-b7db25e29948 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:38:59.909443 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-5a8d4f02-ac28-41be-850b-b7db25e29948 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:38:59.922032 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8d4f02-ac28-41be-850b-b7db25e29948 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:38:59.923667 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8d4f02-ac28-41be-850b-b7db25e29948 service placement] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:38:59.935086 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1278/2587] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:38:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:39:02.950879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a841b6-4da1-4786-a770-3c586b866311 service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:39:02.962860 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a841b6-4da1-4786-a770-3c586b866311 service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:39:02.969069 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed968c-4483-4654-804f-205794854b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:39:02.969734 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed968c-4483-4654-804f-205794854b4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:02.970060 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed968c-4483-4654-804f-205794854b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:02.970409 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed968c-4483-4654-804f-205794854b4c admin admin] PATH_INFO: `/v3/users/c4caf6983e454e18b0f6a8b135a598df` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:02.971893 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed968c-4483-4654-804f-205794854b4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4caf6983e454e18b0f6a8b135a598df)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:39:02.973900 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed968c-4483-4654-804f-205794854b4c admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:39:03.021977 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-e2ed968c-4483-4654-804f-205794854b4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4caf6983e454e18b0f6a8b135a598df'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:39:03.029217 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-e2ed968c-4483-4654-804f-205794854b4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4caf6983e454e18b0f6a8b135a598df'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:39:03.029876 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-e2ed968c-4483-4654-804f-205794854b4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4caf6983e454e18b0f6a8b135a598df'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:39:03.042564 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-e2ed968c-4483-4654-804f-205794854b4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4caf6983e454e18b0f6a8b135a598df'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:39:03.043282 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-e2ed968c-4483-4654-804f-205794854b4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4caf6983e454e18b0f6a8b135a598df'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:39:03.058079 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1310/2588] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:39:02 2022] DELETE /identity/v3/users/c4caf6983e454e18b0f6a8b135a598df => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:39:03.236636 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d4f02-ac28-41be-850b-b7db25e29948 service placement] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:39:03.248205 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d4f02-ac28-41be-850b-b7db25e29948 service placement] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:39:03.307476 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ce05b-1d9f-49a9-88e0-ed1cced29285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:39:03.308154 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ce05b-1d9f-49a9-88e0-ed1cced29285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:03.308427 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ce05b-1d9f-49a9-88e0-ed1cced29285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:03.308697 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ce05b-1d9f-49a9-88e0-ed1cced29285 admin admin] PATH_INFO: `/v3/projects/29cc6b54ae36404389648689e6a01b70` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:03.309877 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ce05b-1d9f-49a9-88e0-ed1cced29285 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29cc6b54ae36404389648689e6a01b70)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:39:03.311855 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ce05b-1d9f-49a9-88e0-ed1cced29285 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:39:03.359091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-968ce05b-1d9f-49a9-88e0-ed1cced29285 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29cc6b54ae36404389648689e6a01b70', 'request_id': 'req-968ce05b-1d9f-49a9-88e0-ed1cced29285'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:39:03.364837 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-968ce05b-1d9f-49a9-88e0-ed1cced29285 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29cc6b54ae36404389648689e6a01b70', 'request_id': 'req-968ce05b-1d9f-49a9-88e0-ed1cced29285'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:39:03.371993 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-968ce05b-1d9f-49a9-88e0-ed1cced29285 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29cc6b54ae36404389648689e6a01b70', 'request_id': 'req-968ce05b-1d9f-49a9-88e0-ed1cced29285'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:39:03.401086 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-968ce05b-1d9f-49a9-88e0-ed1cced29285 admin admin] The token cache is being invalidate because project 29cc6b54ae36404389648689e6a01b70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:39:03.401382 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-968ce05b-1d9f-49a9-88e0-ed1cced29285 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:39:03.402041 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-968ce05b-1d9f-49a9-88e0-ed1cced29285 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:39:03.403666 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1279/2589] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:39:03 2022] DELETE /identity/v3/projects/29cc6b54ae36404389648689e6a01b70 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:39:03.407883 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed968c-4483-4654-804f-205794854b4c admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:39:03.409347 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-e2ed968c-4483-4654-804f-205794854b4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:39:03.422621 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed968c-4483-4654-804f-205794854b4c admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:39:03.468259 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:39:03.481991 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b7b49-6413-41bd-9434-a0724093f98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:39:03.482662 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b7b49-6413-41bd-9434-a0724093f98b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:03.482937 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b7b49-6413-41bd-9434-a0724093f98b admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:03.483203 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b7b49-6413-41bd-9434-a0724093f98b admin admin] PATH_INFO: `/v3/users/ea3aa23a4a0a4aa6a1456c5a89afc910` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:03.484386 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b7b49-6413-41bd-9434-a0724093f98b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea3aa23a4a0a4aa6a1456c5a89afc910)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:39:03.486294 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b7b49-6413-41bd-9434-a0724093f98b admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:39:03.535649 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-782b7b49-6413-41bd-9434-a0724093f98b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea3aa23a4a0a4aa6a1456c5a89afc910'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:39:03.542269 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-782b7b49-6413-41bd-9434-a0724093f98b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea3aa23a4a0a4aa6a1456c5a89afc910'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:39:03.542921 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-782b7b49-6413-41bd-9434-a0724093f98b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea3aa23a4a0a4aa6a1456c5a89afc910'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:39:03.554247 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-782b7b49-6413-41bd-9434-a0724093f98b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea3aa23a4a0a4aa6a1456c5a89afc910'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:39:03.554857 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-782b7b49-6413-41bd-9434-a0724093f98b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea3aa23a4a0a4aa6a1456c5a89afc910'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:39:03.569103 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1311/2590] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:39:03 2022] DELETE /identity/v3/users/ea3aa23a4a0a4aa6a1456c5a89afc910 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:39:03.754983 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ce05b-1d9f-49a9-88e0-ed1cced29285 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:39:03.756457 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-968ce05b-1d9f-49a9-88e0-ed1cced29285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:39:03.769910 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ce05b-1d9f-49a9-88e0-ed1cced29285 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:39:03.828786 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df7eeb-72db-45f6-a99b-c93e33d73739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:39:03.829433 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df7eeb-72db-45f6-a99b-c93e33d73739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:03.829712 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df7eeb-72db-45f6-a99b-c93e33d73739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:03.829978 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df7eeb-72db-45f6-a99b-c93e33d73739 admin admin] PATH_INFO: `/v3/projects/e9087f4fabf247e7b29d859b0ec0579d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:03.831140 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72df7eeb-72db-45f6-a99b-c93e33d73739 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9087f4fabf247e7b29d859b0ec0579d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:39:03.833083 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72df7eeb-72db-45f6-a99b-c93e33d73739 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:39:03.841629 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:39:03.882101 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-72df7eeb-72db-45f6-a99b-c93e33d73739 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9087f4fabf247e7b29d859b0ec0579d', 'request_id': 'req-72df7eeb-72db-45f6-a99b-c93e33d73739'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:39:03.888298 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-72df7eeb-72db-45f6-a99b-c93e33d73739 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9087f4fabf247e7b29d859b0ec0579d', 'request_id': 'req-72df7eeb-72db-45f6-a99b-c93e33d73739'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:39:03.894647 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-72df7eeb-72db-45f6-a99b-c93e33d73739 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9087f4fabf247e7b29d859b0ec0579d', 'request_id': 'req-72df7eeb-72db-45f6-a99b-c93e33d73739'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:39:03.908965 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-72df7eeb-72db-45f6-a99b-c93e33d73739 admin admin] The token cache is being invalidate because project e9087f4fabf247e7b29d859b0ec0579d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:39:03.909252 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-72df7eeb-72db-45f6-a99b-c93e33d73739 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:39:03.909900 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-72df7eeb-72db-45f6-a99b-c93e33d73739 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:39:03.911508 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1280/2591] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:39:03 2022] DELETE /identity/v3/projects/e9087f4fabf247e7b29d859b0ec0579d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:39:09.934613 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed1332-0b14-44e1-92c9-b2cccb4bd14f None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:09.935203 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed1332-0b14-44e1-92c9-b2cccb4bd14f None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:09.935203 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed1332-0b14-44e1-92c9-b2cccb4bd14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:09.993018 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-b4ed1332-0b14-44e1-92c9-b2cccb4bd14f None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:39:09.994219 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-b4ed1332-0b14-44e1-92c9-b2cccb4bd14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:39:10.053968 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1312/2592] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:39:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:39:10.064349 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05034171-3c20-4ce0-a86c-c5a6eb05c15a None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:10.065139 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05034171-3c20-4ce0-a86c-c5a6eb05c15a None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:10.065302 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05034171-3c20-4ce0-a86c-c5a6eb05c15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:10.092796 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-05034171-3c20-4ce0-a86c-c5a6eb05c15a None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:39:10.094023 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-05034171-3c20-4ce0-a86c-c5a6eb05c15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:39:10.103310 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1281/2593] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:39:10.108383 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed1332-0b14-44e1-92c9-b2cccb4bd14f None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:39:10.118625 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed1332-0b14-44e1-92c9-b2cccb4bd14f None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:39:10.124870 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e854e7-5606-4b7e-a613-78be7c84e93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:39:10.125487 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e854e7-5606-4b7e-a613-78be7c84e93b admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:10.125768 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e854e7-5606-4b7e-a613-78be7c84e93b admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:10.126041 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e854e7-5606-4b7e-a613-78be7c84e93b admin admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:10.126744 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e854e7-5606-4b7e-a613-78be7c84e93b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:39:10.127049 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e854e7-5606-4b7e-a613-78be7c84e93b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:39:10.128689 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e854e7-5606-4b7e-a613-78be7c84e93b admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:39:10.140919 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1313/2594] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:39:10.149060 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05034171-3c20-4ce0-a86c-c5a6eb05c15a None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:39:10.158683 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05034171-3c20-4ce0-a86c-c5a6eb05c15a None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:39:10.164446 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d240a947-1873-402a-938a-57368fd72f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:39:10.165064 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240a947-1873-402a-938a-57368fd72f40 admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:10.165343 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240a947-1873-402a-938a-57368fd72f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:10.165610 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240a947-1873-402a-938a-57368fd72f40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:10.166273 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d240a947-1873-402a-938a-57368fd72f40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:39:10.168358 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d240a947-1873-402a-938a-57368fd72f40 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:39:10.201255 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1282/2595] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:39:10 2022] POST /identity/v3/projects => generated 391 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:39:10.206257 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e854e7-5606-4b7e-a613-78be7c84e93b admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:39:10.221581 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e854e7-5606-4b7e-a613-78be7c84e93b admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:39:10.246913 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:39:10.285782 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bdecb7-b173-479d-a827-690e039e86d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:39:10.286406 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bdecb7-b173-479d-a827-690e039e86d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:10.286713 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bdecb7-b173-479d-a827-690e039e86d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:10.287013 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bdecb7-b173-479d-a827-690e039e86d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:10.287744 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bdecb7-b173-479d-a827-690e039e86d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:39:10.290003 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bdecb7-b173-479d-a827-690e039e86d4 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:39:10.311502 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1314/2596] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:39:10 2022] POST /identity/v3/users => generated 296 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:39:10.315741 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d240a947-1873-402a-938a-57368fd72f40 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:39:10.326959 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d240a947-1873-402a-938a-57368fd72f40 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:39:10.332258 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc6474-d2c0-4449-b0ea-2d082e3caf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:39:10.332877 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc6474-d2c0-4449-b0ea-2d082e3caf2b admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:10.333189 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc6474-d2c0-4449-b0ea-2d082e3caf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:10.333465 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc6474-d2c0-4449-b0ea-2d082e3caf2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:10.334169 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc6474-d2c0-4449-b0ea-2d082e3caf2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:39:10.335805 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc6474-d2c0-4449-b0ea-2d082e3caf2b admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:39:10.346179 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1283/2597] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:39:10.350536 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bdecb7-b173-479d-a827-690e039e86d4 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:39:10.364628 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bdecb7-b173-479d-a827-690e039e86d4 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:39:10.367141 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd4dbf-5592-4808-a379-24be12295118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:39:10.367677 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd4dbf-5592-4808-a379-24be12295118 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:10.367958 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd4dbf-5592-4808-a379-24be12295118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:10.368227 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd4dbf-5592-4808-a379-24be12295118 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:10.368929 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd4dbf-5592-4808-a379-24be12295118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:39:10.371009 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd4dbf-5592-4808-a379-24be12295118 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:39:10.382075 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1315/2598] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:39:10.386366 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc6474-d2c0-4449-b0ea-2d082e3caf2b admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:39:10.396699 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc6474-d2c0-4449-b0ea-2d082e3caf2b admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:39:10.402501 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a908ff-b38c-4d28-905f-379ea673abbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:39:10.403176 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a908ff-b38c-4d28-905f-379ea673abbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:10.403456 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a908ff-b38c-4d28-905f-379ea673abbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:10.403858 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a908ff-b38c-4d28-905f-379ea673abbe admin admin] PATH_INFO: `/v3/projects/19366a0a96d64154abfecd2b62e0950a/users/0af99668e5874c39a340ed943f90cb11/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:10.420110 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a908ff-b38c-4d28-905f-379ea673abbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=19366a0a96d64154abfecd2b62e0950a, user_id=0af99668e5874c39a340ed943f90cb11, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:39:10.422782 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a908ff-b38c-4d28-905f-379ea673abbe admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:39:10.438483 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1284/2599] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:39:10 2022] PUT /identity/v3/projects/19366a0a96d64154abfecd2b62e0950a/users/0af99668e5874c39a340ed943f90cb11/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:39:10.458518 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bcabda-7208-44b0-8178-055e78a0c1fe None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:10.458770 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bcabda-7208-44b0-8178-055e78a0c1fe None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:10.459154 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bcabda-7208-44b0-8178-055e78a0c1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:10.489148 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-26bcabda-7208-44b0-8178-055e78a0c1fe None None] MFA Rules not processed for user `0af99668e5874c39a340ed943f90cb11`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:39:10.490343 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-26bcabda-7208-44b0-8178-055e78a0c1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:39:10.559500 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1316/2600] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:39:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:39:10.564145 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a908ff-b38c-4d28-905f-379ea673abbe admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:39:10.631183 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a908ff-b38c-4d28-905f-379ea673abbe admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:39:10.637186 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04609d-cbaa-4edf-931e-32daf4283ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:39:10.637814 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04609d-cbaa-4edf-931e-32daf4283ad3 admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:10.638093 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04609d-cbaa-4edf-931e-32daf4283ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:10.638330 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04609d-cbaa-4edf-931e-32daf4283ad3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:10.639018 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef04609d-cbaa-4edf-931e-32daf4283ad3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:39:10.640948 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef04609d-cbaa-4edf-931e-32daf4283ad3 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:39:10.679238 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1285/2601] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:39:10 2022] POST /identity/v3/projects => generated 393 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:39:10.683607 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bcabda-7208-44b0-8178-055e78a0c1fe None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:39:10.694806 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bcabda-7208-44b0-8178-055e78a0c1fe None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:39:10.757272 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f43f1-f47a-4e92-9e0d-8fc6710aceb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:39:10.758542 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f43f1-f47a-4e92-9e0d-8fc6710aceb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:10.758894 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f43f1-f47a-4e92-9e0d-8fc6710aceb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:10.759285 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f43f1-f47a-4e92-9e0d-8fc6710aceb8 admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:10.760448 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f43f1-f47a-4e92-9e0d-8fc6710aceb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:39:10.762369 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f43f1-f47a-4e92-9e0d-8fc6710aceb8 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:39:10.784101 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1317/2602] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:39:10 2022] POST /identity/v3/users => generated 303 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:39:10.788199 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04609d-cbaa-4edf-931e-32daf4283ad3 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:39:10.798720 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04609d-cbaa-4edf-931e-32daf4283ad3 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:39:10.804494 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6dd459-8886-4f59-ac5a-3f416514c43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:39:10.805106 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6dd459-8886-4f59-ac5a-3f416514c43f admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:10.805386 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6dd459-8886-4f59-ac5a-3f416514c43f admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:10.805644 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6dd459-8886-4f59-ac5a-3f416514c43f admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:10.806364 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6dd459-8886-4f59-ac5a-3f416514c43f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:39:10.808039 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6dd459-8886-4f59-ac5a-3f416514c43f admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:39:10.818825 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1286/2603] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:39:10.823171 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f43f1-f47a-4e92-9e0d-8fc6710aceb8 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:39:10.833369 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f43f1-f47a-4e92-9e0d-8fc6710aceb8 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:39:10.838726 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77682b-e5f7-47ff-bdf4-746dd556972d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:39:10.839402 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77682b-e5f7-47ff-bdf4-746dd556972d admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:10.839692 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77682b-e5f7-47ff-bdf4-746dd556972d admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:10.839956 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77682b-e5f7-47ff-bdf4-746dd556972d admin admin] PATH_INFO: `/v3/projects/7fdeb663c7d04a98b95f273d5317f3c4/users/5595b4cd927c46a4bf025a107939f298/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:10.986756 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c77682b-e5f7-47ff-bdf4-746dd556972d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fdeb663c7d04a98b95f273d5317f3c4, user_id=5595b4cd927c46a4bf025a107939f298, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:39:10.989377 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c77682b-e5f7-47ff-bdf4-746dd556972d admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:39:11.000450 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:39:11.006499 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1318/2604] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:39:10 2022] PUT /identity/v3/projects/7fdeb663c7d04a98b95f273d5317f3c4/users/5595b4cd927c46a4bf025a107939f298/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:39:11.011103 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6dd459-8886-4f59-ac5a-3f416514c43f admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:39:11.026727 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6dd459-8886-4f59-ac5a-3f416514c43f admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:39:11.030950 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:39:11.086940 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29631445-7824-4f9e-b260-d7520d68e55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:39:11.087673 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29631445-7824-4f9e-b260-d7520d68e55a admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:11.087830 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29631445-7824-4f9e-b260-d7520d68e55a admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:11.088099 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29631445-7824-4f9e-b260-d7520d68e55a admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:11.088859 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29631445-7824-4f9e-b260-d7520d68e55a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:39:11.090445 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29631445-7824-4f9e-b260-d7520d68e55a admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:39:11.100283 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1287/2605] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:39:11.104776 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77682b-e5f7-47ff-bdf4-746dd556972d admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:39:11.115776 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77682b-e5f7-47ff-bdf4-746dd556972d admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:39:11.121726 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda1cf3-d4bb-4eb2-9ad9-3c98f06a5f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:39:11.122373 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda1cf3-d4bb-4eb2-9ad9-3c98f06a5f29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:11.122649 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda1cf3-d4bb-4eb2-9ad9-3c98f06a5f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:11.123017 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda1cf3-d4bb-4eb2-9ad9-3c98f06a5f29 admin admin] PATH_INFO: `/v3/projects/7fdeb663c7d04a98b95f273d5317f3c4/users/5595b4cd927c46a4bf025a107939f298/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:11.125087 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda1cf3-d4bb-4eb2-9ad9-3c98f06a5f29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fdeb663c7d04a98b95f273d5317f3c4, user_id=5595b4cd927c46a4bf025a107939f298, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:39:11.127774 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda1cf3-d4bb-4eb2-9ad9-3c98f06a5f29 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:39:11.138298 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1319/2606] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:39:11 2022] PUT /identity/v3/projects/7fdeb663c7d04a98b95f273d5317f3c4/users/5595b4cd927c46a4bf025a107939f298/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:39:11.149162 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79da96-44ac-48cb-85ee-11ee5edddce6 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:11.149446 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79da96-44ac-48cb-85ee-11ee5edddce6 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:11.149721 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79da96-44ac-48cb-85ee-11ee5edddce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:11.178242 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-7f79da96-44ac-48cb-85ee-11ee5edddce6 None None] MFA Rules not processed for user `5595b4cd927c46a4bf025a107939f298`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:39:11.179466 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-7f79da96-44ac-48cb-85ee-11ee5edddce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:39:11.378034 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1288/2607] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:39:11 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:39:11.391527 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94db7d5-f077-4703-b14a-28e3945a24e0 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:11.391829 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94db7d5-f077-4703-b14a-28e3945a24e0 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:11.392098 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94db7d5-f077-4703-b14a-28e3945a24e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:11.411646 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-a94db7d5-f077-4703-b14a-28e3945a24e0 None None] MFA Rules not processed for user `0af99668e5874c39a340ed943f90cb11`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:39:11.412825 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-a94db7d5-f077-4703-b14a-28e3945a24e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:39:11.465892 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1320/2608] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:39:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:39:11.479173 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f79da96-44ac-48cb-85ee-11ee5edddce6 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:39:11.481080 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-7f79da96-44ac-48cb-85ee-11ee5edddce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:39:11.555771 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f79da96-44ac-48cb-85ee-11ee5edddce6 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:39:11.562001 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9429776-2078-4e6e-9423-29d5a08b6ad2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:39:11.562622 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9429776-2078-4e6e-9423-29d5a08b6ad2 service nova] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:11.562895 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9429776-2078-4e6e-9423-29d5a08b6ad2 service nova] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:11.563177 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9429776-2078-4e6e-9423-29d5a08b6ad2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:11.571676 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9429776-2078-4e6e-9423-29d5a08b6ad2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:39:11.573365 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9429776-2078-4e6e-9423-29d5a08b6ad2 service nova] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:39:11.582398 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1289/2609] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:39:11 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:39:12.324164 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94db7d5-f077-4703-b14a-28e3945a24e0 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:39:12.325596 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-a94db7d5-f077-4703-b14a-28e3945a24e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:39:12.399304 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94db7d5-f077-4703-b14a-28e3945a24e0 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:39:12.404250 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb93f4-5978-40b9-9877-3bdff836cd81 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:39:12.404872 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb93f4-5978-40b9-9877-3bdff836cd81 service placement] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:12.405143 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb93f4-5978-40b9-9877-3bdff836cd81 service placement] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:12.405410 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb93f4-5978-40b9-9877-3bdff836cd81 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:12.407272 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-b9cb93f4-5978-40b9-9877-3bdff836cd81 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:39:12.418532 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb93f4-5978-40b9-9877-3bdff836cd81 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:39:12.420151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb93f4-5978-40b9-9877-3bdff836cd81 service placement] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:39:12.429884 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1321/2610] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:39:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:39:21.578485 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=94 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:39:22.426037 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=63,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:39:22.932488 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9429776-2078-4e6e-9423-29d5a08b6ad2 service nova] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:39:22.934244 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-a9429776-2078-4e6e-9423-29d5a08b6ad2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:39:22.949330 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9429776-2078-4e6e-9423-29d5a08b6ad2 service nova] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:39:22.955915 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe622a9-62ad-4f9b-9c4e-cdcdb8ab055a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:39:22.956526 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe622a9-62ad-4f9b-9c4e-cdcdb8ab055a service nova] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:22.956801 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe622a9-62ad-4f9b-9c4e-cdcdb8ab055a service nova] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:22.957067 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe622a9-62ad-4f9b-9c4e-cdcdb8ab055a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:22.965809 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe622a9-62ad-4f9b-9c4e-cdcdb8ab055a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:39:22.967387 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe622a9-62ad-4f9b-9c4e-cdcdb8ab055a service nova] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:39:22.976882 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1290/2611] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:39:22 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:39:22.992893 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9230f0-fcca-473a-82ae-4a9c3a67eeaa None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:22.993187 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9230f0-fcca-473a-82ae-4a9c3a67eeaa None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:22.993462 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9230f0-fcca-473a-82ae-4a9c3a67eeaa None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:22.995255 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1322/2612] 10.222.0.60 () {54 vars in 912 bytes} [Sun Jul 31 01:39:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:39:23.000012 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe622a9-62ad-4f9b-9c4e-cdcdb8ab055a service nova] Authenticating service token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 31 01:39:23.011052 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-cbe622a9-62ad-4f9b-9c4e-cdcdb8ab055a service nova] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Jul 31 01:39:23.011338 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe622a9-62ad-4f9b-9c4e-cdcdb8ab055a service nova] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:39:23.019559 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe622a9-62ad-4f9b-9c4e-cdcdb8ab055a service nova] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:39:23.025023 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d641e-c1e8-45c4-a55c-dbe205100c9d tempest-ServersAdminNegativeTestJSON-1846900128 tempest-ServersAdminNegativeTestJSON-1846900128-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5595b4cd927c46a4bf025a107939f298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdeb663c7d04a98b95f273d5317f3c4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:39:23.025982 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d641e-c1e8-45c4-a55c-dbe205100c9d tempest-ServersAdminNegativeTestJSON-1846900128 tempest-ServersAdminNegativeTestJSON-1846900128-project-admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:23.026289 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d641e-c1e8-45c4-a55c-dbe205100c9d tempest-ServersAdminNegativeTestJSON-1846900128 tempest-ServersAdminNegativeTestJSON-1846900128-project-admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:23.026671 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d641e-c1e8-45c4-a55c-dbe205100c9d tempest-ServersAdminNegativeTestJSON-1846900128 tempest-ServersAdminNegativeTestJSON-1846900128-project-admin] PATH_INFO: `/v3/projects/7fdeb663c7d04a98b95f273d5317f3c4` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:23.028590 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5d641e-c1e8-45c4-a55c-dbe205100c9d tempest-ServersAdminNegativeTestJSON-1846900128 tempest-ServersAdminNegativeTestJSON-1846900128-project-admin] RBAC: Authorizing `identity:get_project(project_id=7fdeb663c7d04a98b95f273d5317f3c4)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:39:23.031344 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5d641e-c1e8-45c4-a55c-dbe205100c9d tempest-ServersAdminNegativeTestJSON-1846900128 tempest-ServersAdminNegativeTestJSON-1846900128-project-admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:39:23.033782 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1291/2613] 10.222.0.60 () {58 vars in 1443 bytes} [Sun Jul 31 01:39:22 2022] GET /identity/v3/projects/7fdeb663c7d04a98b95f273d5317f3c4 => generated 393 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:39:23.197849 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9230f0-fcca-473a-82ae-4a9c3a67eeaa None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:39:23.199631 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-ff9230f0-fcca-473a-82ae-4a9c3a67eeaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:39:23.260006 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9230f0-fcca-473a-82ae-4a9c3a67eeaa None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:39:23.264720 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07eec7-4024-4934-8f59-512862a510bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:39:23.265637 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07eec7-4024-4934-8f59-512862a510bb service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:23.266042 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07eec7-4024-4934-8f59-512862a510bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:23.266309 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07eec7-4024-4934-8f59-512862a510bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:23.268591 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-fb07eec7-4024-4934-8f59-512862a510bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:39:23.282318 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07eec7-4024-4934-8f59-512862a510bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:39:23.283755 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07eec7-4024-4934-8f59-512862a510bb service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:39:23.291739 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1323/2614] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:39:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:39:23.487656 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba23af9-f9cc-49b9-b260-78d0e393d72e None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:23.487936 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba23af9-f9cc-49b9-b260-78d0e393d72e None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:23.488204 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba23af9-f9cc-49b9-b260-78d0e393d72e None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:23.489546 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1292/2615] 10.222.0.60 () {54 vars in 912 bytes} [Sun Jul 31 01:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:39:23.494769 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07eec7-4024-4934-8f59-512862a510bb service neutron] Authenticating service token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 31 01:39:23.509571 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-fb07eec7-4024-4934-8f59-512862a510bb service neutron] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Jul 31 01:39:23.509871 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07eec7-4024-4934-8f59-512862a510bb service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:39:23.521464 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07eec7-4024-4934-8f59-512862a510bb service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:39:23.526266 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70998bda-a50b-4230-8582-88fe0db1b91a tempest-ServersAdminNegativeTestJSON-1846900128 tempest-ServersAdminNegativeTestJSON-1846900128-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5595b4cd927c46a4bf025a107939f298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdeb663c7d04a98b95f273d5317f3c4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:39:23.526907 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70998bda-a50b-4230-8582-88fe0db1b91a tempest-ServersAdminNegativeTestJSON-1846900128 tempest-ServersAdminNegativeTestJSON-1846900128-project-admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:23.527185 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70998bda-a50b-4230-8582-88fe0db1b91a tempest-ServersAdminNegativeTestJSON-1846900128 tempest-ServersAdminNegativeTestJSON-1846900128-project-admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:23.527455 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70998bda-a50b-4230-8582-88fe0db1b91a tempest-ServersAdminNegativeTestJSON-1846900128 tempest-ServersAdminNegativeTestJSON-1846900128-project-admin] PATH_INFO: `/v3/projects/7fdeb663c7d04a98b95f273d5317f3c4` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:23.528643 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70998bda-a50b-4230-8582-88fe0db1b91a tempest-ServersAdminNegativeTestJSON-1846900128 tempest-ServersAdminNegativeTestJSON-1846900128-project-admin] RBAC: Authorizing `identity:get_project(project_id=7fdeb663c7d04a98b95f273d5317f3c4)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:39:23.530414 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70998bda-a50b-4230-8582-88fe0db1b91a tempest-ServersAdminNegativeTestJSON-1846900128 tempest-ServersAdminNegativeTestJSON-1846900128-project-admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:39:23.532201 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1324/2616] 10.222.0.60 () {58 vars in 1443 bytes} [Sun Jul 31 01:39:23 2022] GET /identity/v3/projects/7fdeb663c7d04a98b95f273d5317f3c4 => generated 393 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:39:27.546188 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba23af9-f9cc-49b9-b260-78d0e393d72e None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:39:27.612360 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba23af9-f9cc-49b9-b260-78d0e393d72e None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:39:27.618337 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d298688-0c14-4f5c-9601-8e5876f3e302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:39:27.618948 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d298688-0c14-4f5c-9601-8e5876f3e302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:27.619219 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d298688-0c14-4f5c-9601-8e5876f3e302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:27.619824 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d298688-0c14-4f5c-9601-8e5876f3e302 admin admin] PATH_INFO: `/v3/users/0af99668e5874c39a340ed943f90cb11` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:27.621160 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d298688-0c14-4f5c-9601-8e5876f3e302 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0af99668e5874c39a340ed943f90cb11)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:39:27.623081 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d298688-0c14-4f5c-9601-8e5876f3e302 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:39:27.679671 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-5d298688-0c14-4f5c-9601-8e5876f3e302 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0af99668e5874c39a340ed943f90cb11'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:39:27.680430 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-5d298688-0c14-4f5c-9601-8e5876f3e302 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0af99668e5874c39a340ed943f90cb11'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:39:27.693177 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-5d298688-0c14-4f5c-9601-8e5876f3e302 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0af99668e5874c39a340ed943f90cb11'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:39:27.703336 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-5d298688-0c14-4f5c-9601-8e5876f3e302 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0af99668e5874c39a340ed943f90cb11'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:39:27.704077 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-5d298688-0c14-4f5c-9601-8e5876f3e302 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0af99668e5874c39a340ed943f90cb11'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:39:27.717752 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1293/2617] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:39:27 2022] DELETE /identity/v3/users/0af99668e5874c39a340ed943f90cb11 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:39:27.722559 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567a785-c8cc-4589-9a6b-17db43172f64 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:27.723055 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567a785-c8cc-4589-9a6b-17db43172f64 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:27.723055 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567a785-c8cc-4589-9a6b-17db43172f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:27.742252 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-d567a785-c8cc-4589-9a6b-17db43172f64 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:39:27.743452 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-d567a785-c8cc-4589-9a6b-17db43172f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:39:27.811168 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1325/2618] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:39:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:39:27.821418 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d298688-0c14-4f5c-9601-8e5876f3e302 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:39:27.822942 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-5d298688-0c14-4f5c-9601-8e5876f3e302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:39:27.886230 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d298688-0c14-4f5c-9601-8e5876f3e302 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:39:27.892157 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7582b34f-f705-49a8-a140-102a8012ff92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:39:27.893018 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582b34f-f705-49a8-a140-102a8012ff92 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:27.893400 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582b34f-f705-49a8-a140-102a8012ff92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:27.893847 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582b34f-f705-49a8-a140-102a8012ff92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:27.904771 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7582b34f-f705-49a8-a140-102a8012ff92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:39:27.906205 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7582b34f-f705-49a8-a140-102a8012ff92 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:39:27.911288 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:39:27.917190 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1294/2619] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:39:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:39:28.101639 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567a785-c8cc-4589-9a6b-17db43172f64 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:39:28.103071 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-d567a785-c8cc-4589-9a6b-17db43172f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:39:28.114741 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567a785-c8cc-4589-9a6b-17db43172f64 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:39:28.120454 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b937c38-586e-4f8e-9904-211309ed3a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:39:28.121104 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b937c38-586e-4f8e-9904-211309ed3a14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:28.121378 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b937c38-586e-4f8e-9904-211309ed3a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:28.121629 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b937c38-586e-4f8e-9904-211309ed3a14 admin admin] PATH_INFO: `/v3/projects/19366a0a96d64154abfecd2b62e0950a` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:28.122810 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b937c38-586e-4f8e-9904-211309ed3a14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19366a0a96d64154abfecd2b62e0950a)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:39:28.125328 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b937c38-586e-4f8e-9904-211309ed3a14 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:39:28.172906 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-5b937c38-586e-4f8e-9904-211309ed3a14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19366a0a96d64154abfecd2b62e0950a', 'request_id': 'req-5b937c38-586e-4f8e-9904-211309ed3a14'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:39:28.178192 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-5b937c38-586e-4f8e-9904-211309ed3a14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19366a0a96d64154abfecd2b62e0950a', 'request_id': 'req-5b937c38-586e-4f8e-9904-211309ed3a14'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:39:28.184348 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-5b937c38-586e-4f8e-9904-211309ed3a14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19366a0a96d64154abfecd2b62e0950a', 'request_id': 'req-5b937c38-586e-4f8e-9904-211309ed3a14'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:39:28.198286 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-5b937c38-586e-4f8e-9904-211309ed3a14 admin admin] The token cache is being invalidate because project 19366a0a96d64154abfecd2b62e0950a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:39:28.198568 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-5b937c38-586e-4f8e-9904-211309ed3a14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:39:28.199254 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-5b937c38-586e-4f8e-9904-211309ed3a14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:39:28.200927 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1326/2620] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:39:28 2022] DELETE /identity/v3/projects/19366a0a96d64154abfecd2b62e0950a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:39:28.205513 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7582b34f-f705-49a8-a140-102a8012ff92 service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:39:28.215727 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7582b34f-f705-49a8-a140-102a8012ff92 service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:39:28.275066 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c8e2e-ab22-41d8-8392-30ddf127f25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:39:28.275739 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c8e2e-ab22-41d8-8392-30ddf127f25c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:28.276041 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c8e2e-ab22-41d8-8392-30ddf127f25c admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:28.276311 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c8e2e-ab22-41d8-8392-30ddf127f25c admin admin] PATH_INFO: `/v3/users/5595b4cd927c46a4bf025a107939f298` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:28.277491 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698c8e2e-ab22-41d8-8392-30ddf127f25c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5595b4cd927c46a4bf025a107939f298)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:39:28.279411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698c8e2e-ab22-41d8-8392-30ddf127f25c admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:39:28.329424 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-698c8e2e-ab22-41d8-8392-30ddf127f25c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5595b4cd927c46a4bf025a107939f298'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:39:28.332214 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-698c8e2e-ab22-41d8-8392-30ddf127f25c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5595b4cd927c46a4bf025a107939f298'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:39:28.345820 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-698c8e2e-ab22-41d8-8392-30ddf127f25c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5595b4cd927c46a4bf025a107939f298'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:39:28.354978 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-698c8e2e-ab22-41d8-8392-30ddf127f25c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5595b4cd927c46a4bf025a107939f298'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:39:28.355913 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-698c8e2e-ab22-41d8-8392-30ddf127f25c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5595b4cd927c46a4bf025a107939f298'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:39:28.370123 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1295/2621] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:39:28 2022] DELETE /identity/v3/users/5595b4cd927c46a4bf025a107939f298 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:39:28.645661 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b937c38-586e-4f8e-9904-211309ed3a14 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:39:28.647697 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-5b937c38-586e-4f8e-9904-211309ed3a14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:39:28.660686 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b937c38-586e-4f8e-9904-211309ed3a14 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:39:28.673943 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:39:28.729358 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13534b6f-c4a5-4dd7-bf4a-97567a7684e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:39:28.730019 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13534b6f-c4a5-4dd7-bf4a-97567a7684e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:28.730271 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13534b6f-c4a5-4dd7-bf4a-97567a7684e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:28.730542 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13534b6f-c4a5-4dd7-bf4a-97567a7684e7 admin admin] PATH_INFO: `/v3/projects/7fdeb663c7d04a98b95f273d5317f3c4` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:28.731773 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13534b6f-c4a5-4dd7-bf4a-97567a7684e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fdeb663c7d04a98b95f273d5317f3c4)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:39:28.733683 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13534b6f-c4a5-4dd7-bf4a-97567a7684e7 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:39:28.781155 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-13534b6f-c4a5-4dd7-bf4a-97567a7684e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fdeb663c7d04a98b95f273d5317f3c4', 'request_id': 'req-13534b6f-c4a5-4dd7-bf4a-97567a7684e7'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:39:28.787000 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-13534b6f-c4a5-4dd7-bf4a-97567a7684e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fdeb663c7d04a98b95f273d5317f3c4', 'request_id': 'req-13534b6f-c4a5-4dd7-bf4a-97567a7684e7'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:39:28.793730 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-13534b6f-c4a5-4dd7-bf4a-97567a7684e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fdeb663c7d04a98b95f273d5317f3c4', 'request_id': 'req-13534b6f-c4a5-4dd7-bf4a-97567a7684e7'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:39:28.808555 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-13534b6f-c4a5-4dd7-bf4a-97567a7684e7 admin admin] The token cache is being invalidate because project 7fdeb663c7d04a98b95f273d5317f3c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:39:28.808829 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-13534b6f-c4a5-4dd7-bf4a-97567a7684e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:39:28.809506 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-13534b6f-c4a5-4dd7-bf4a-97567a7684e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:39:28.811272 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1327/2622] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:39:28 2022] DELETE /identity/v3/projects/7fdeb663c7d04a98b95f273d5317f3c4 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:39:28.817119 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c6934-761c-4dc8-8aee-7656230190ee None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:28.817575 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c6934-761c-4dc8-8aee-7656230190ee None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:28.817675 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c6934-761c-4dc8-8aee-7656230190ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:28.837082 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-695c6934-761c-4dc8-8aee-7656230190ee None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:39:28.838329 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-695c6934-761c-4dc8-8aee-7656230190ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:39:28.901226 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1296/2623] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:39:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:39:28.910036 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9267fe7-5119-482d-827b-27fed1856a1f None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:28.910316 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9267fe7-5119-482d-827b-27fed1856a1f None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:28.910579 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9267fe7-5119-482d-827b-27fed1856a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:28.930718 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-f9267fe7-5119-482d-827b-27fed1856a1f None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:39:28.931948 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-f9267fe7-5119-482d-827b-27fed1856a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:39:28.940686 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1328/2624] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:39:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:39:28.945111 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c6934-761c-4dc8-8aee-7656230190ee None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:39:28.955734 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c6934-761c-4dc8-8aee-7656230190ee None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:39:28.961623 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b086e9-3a99-4f6f-a110-ab4b44bb083c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:39:28.962231 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b086e9-3a99-4f6f-a110-ab4b44bb083c admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:28.962512 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b086e9-3a99-4f6f-a110-ab4b44bb083c admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:28.962772 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b086e9-3a99-4f6f-a110-ab4b44bb083c admin admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:28.963479 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b086e9-3a99-4f6f-a110-ab4b44bb083c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:39:28.963808 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b086e9-3a99-4f6f-a110-ab4b44bb083c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:39:28.965584 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b086e9-3a99-4f6f-a110-ab4b44bb083c admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:39:28.977329 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1297/2625] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:39:28.981864 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9267fe7-5119-482d-827b-27fed1856a1f None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:39:28.991342 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9267fe7-5119-482d-827b-27fed1856a1f None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:39:28.996993 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3416f4-3d42-4a16-a7e1-be332cf873a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:39:28.997676 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3416f4-3d42-4a16-a7e1-be332cf873a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:28.997974 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3416f4-3d42-4a16-a7e1-be332cf873a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:28.998263 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3416f4-3d42-4a16-a7e1-be332cf873a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:28.998908 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3416f4-3d42-4a16-a7e1-be332cf873a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:39:29.000832 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3416f4-3d42-4a16-a7e1-be332cf873a6 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:39:29.031547 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1329/2626] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:39:28 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:39:29.035943 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b086e9-3a99-4f6f-a110-ab4b44bb083c admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:39:29.046527 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b086e9-3a99-4f6f-a110-ab4b44bb083c admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:39:29.050331 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:39:29.107740 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0144f9c-2dfa-4a88-b349-27fb26d6868e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:39:29.108367 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0144f9c-2dfa-4a88-b349-27fb26d6868e admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:29.108637 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0144f9c-2dfa-4a88-b349-27fb26d6868e admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:29.108910 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0144f9c-2dfa-4a88-b349-27fb26d6868e admin admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:29.109598 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0144f9c-2dfa-4a88-b349-27fb26d6868e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:39:29.111650 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0144f9c-2dfa-4a88-b349-27fb26d6868e admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:39:29.138830 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1298/2627] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:39:29 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:39:29.143236 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3416f4-3d42-4a16-a7e1-be332cf873a6 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:39:29.154214 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3416f4-3d42-4a16-a7e1-be332cf873a6 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:39:29.159755 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c2dbd6-52d4-46a3-9a69-62e0b955c6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:39:29.160361 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2dbd6-52d4-46a3-9a69-62e0b955c6ba admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:29.160615 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2dbd6-52d4-46a3-9a69-62e0b955c6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:29.160903 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2dbd6-52d4-46a3-9a69-62e0b955c6ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:29.161590 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c2dbd6-52d4-46a3-9a69-62e0b955c6ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:39:29.163158 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c2dbd6-52d4-46a3-9a69-62e0b955c6ba admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:39:29.173285 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1330/2628] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:39:29.177719 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0144f9c-2dfa-4a88-b349-27fb26d6868e admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:39:29.187936 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0144f9c-2dfa-4a88-b349-27fb26d6868e admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:39:29.192950 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0d0ed-0b0d-44f6-bcd9-84e1bf975faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:39:29.193562 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0d0ed-0b0d-44f6-bcd9-84e1bf975faa admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:29.193847 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0d0ed-0b0d-44f6-bcd9-84e1bf975faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:29.194098 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0d0ed-0b0d-44f6-bcd9-84e1bf975faa admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:29.194794 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f0d0ed-0b0d-44f6-bcd9-84e1bf975faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:39:29.196410 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f0d0ed-0b0d-44f6-bcd9-84e1bf975faa admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:39:29.207402 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1299/2629] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:39:29.211633 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c2dbd6-52d4-46a3-9a69-62e0b955c6ba admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:39:29.221835 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c2dbd6-52d4-46a3-9a69-62e0b955c6ba admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:39:29.227148 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638d386-d6eb-48c0-8b55-ef510bf0f43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:39:29.227894 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638d386-d6eb-48c0-8b55-ef510bf0f43f admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:29.228164 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638d386-d6eb-48c0-8b55-ef510bf0f43f admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:29.228427 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638d386-d6eb-48c0-8b55-ef510bf0f43f admin admin] PATH_INFO: `/v3/projects/b9eb752b40524c42bb26ae2b21b8f0e2/users/e6e2c4f863ca42459a67ac96efb30a33/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:29.244035 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1638d386-d6eb-48c0-8b55-ef510bf0f43f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9eb752b40524c42bb26ae2b21b8f0e2, user_id=e6e2c4f863ca42459a67ac96efb30a33, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:39:29.247012 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1638d386-d6eb-48c0-8b55-ef510bf0f43f admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:39:29.262182 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1331/2630] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:39:29 2022] PUT /identity/v3/projects/b9eb752b40524c42bb26ae2b21b8f0e2/users/e6e2c4f863ca42459a67ac96efb30a33/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:39:29.267227 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927ba30-e288-44d9-b081-0310c0125fc5 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:29.267515 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927ba30-e288-44d9-b081-0310c0125fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:29.267813 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927ba30-e288-44d9-b081-0310c0125fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:29.287429 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-3927ba30-e288-44d9-b081-0310c0125fc5 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:39:29.288735 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-3927ba30-e288-44d9-b081-0310c0125fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:39:29.356413 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1300/2631] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:39:29.366485 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638d386-d6eb-48c0-8b55-ef510bf0f43f admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:39:29.368424 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-1638d386-d6eb-48c0-8b55-ef510bf0f43f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:39:29.417745 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:39:29.431390 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638d386-d6eb-48c0-8b55-ef510bf0f43f admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:39:29.435163 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec55894-526f-4391-a271-91caeb8760e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:39:29.435818 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec55894-526f-4391-a271-91caeb8760e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:29.436094 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec55894-526f-4391-a271-91caeb8760e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:29.436358 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec55894-526f-4391-a271-91caeb8760e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:29.445551 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec55894-526f-4391-a271-91caeb8760e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:39:29.446988 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec55894-526f-4391-a271-91caeb8760e8 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:39:29.456558 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1332/2632] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:39:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:39:33.244974 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89f359-94b5-479e-a733-dea245aebd94 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:33.245504 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89f359-94b5-479e-a733-dea245aebd94 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:33.245504 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89f359-94b5-479e-a733-dea245aebd94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:33.273465 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-9f89f359-94b5-479e-a733-dea245aebd94 None None] MFA Rules not processed for user `e6e2c4f863ca42459a67ac96efb30a33`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:39:33.274668 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-9f89f359-94b5-479e-a733-dea245aebd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:39:33.340615 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1301/2633] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:39:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:39:33.351956 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbc07c-4331-46a1-a3a5-5121bcbc000d None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:33.352479 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbc07c-4331-46a1-a3a5-5121bcbc000d None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:33.352479 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbc07c-4331-46a1-a3a5-5121bcbc000d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:33.373112 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-0ebbc07c-4331-46a1-a3a5-5121bcbc000d None None] MFA Rules not processed for user `e6e2c4f863ca42459a67ac96efb30a33`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:39:33.374513 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-0ebbc07c-4331-46a1-a3a5-5121bcbc000d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:39:33.382126 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1333/2634] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:39:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:39:33.396461 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89f359-94b5-479e-a733-dea245aebd94 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:39:33.398530 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-9f89f359-94b5-479e-a733-dea245aebd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:39:33.419845 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:39:33.478416 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89f359-94b5-479e-a733-dea245aebd94 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:39:33.484020 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d8a92-84fd-404f-a468-307cce06d2d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:39:33.484646 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d8a92-84fd-404f-a468-307cce06d2d4 service nova] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:33.484922 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d8a92-84fd-404f-a468-307cce06d2d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:33.485192 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d8a92-84fd-404f-a468-307cce06d2d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:33.493390 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d8a92-84fd-404f-a468-307cce06d2d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:39:33.495279 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d8a92-84fd-404f-a468-307cce06d2d4 service nova] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:39:33.504869 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1302/2635] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:39:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:39:43.368937 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=9 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:39:43.500270 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=27 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:39:45.283007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebbc07c-4331-46a1-a3a5-5121bcbc000d None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:39:45.284704 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-0ebbc07c-4331-46a1-a3a5-5121bcbc000d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:39:45.361907 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebbc07c-4331-46a1-a3a5-5121bcbc000d None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:39:45.368712 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808697b-596f-4ac7-bb78-10a1b5c688af service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:39:45.369704 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808697b-596f-4ac7-bb78-10a1b5c688af service placement] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:45.369976 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808697b-596f-4ac7-bb78-10a1b5c688af service placement] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:45.370237 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808697b-596f-4ac7-bb78-10a1b5c688af service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:45.372093 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-1808697b-596f-4ac7-bb78-10a1b5c688af service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:39:45.384331 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1808697b-596f-4ac7-bb78-10a1b5c688af service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:39:45.386024 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1808697b-596f-4ac7-bb78-10a1b5c688af service placement] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:39:45.396977 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1334/2636] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:39:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:39:45.471395 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598d63e-67aa-4dd4-aa5b-283203613aae None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:45.472067 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598d63e-67aa-4dd4-aa5b-283203613aae None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:45.472067 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598d63e-67aa-4dd4-aa5b-283203613aae None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:45.473378 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1303/2637] 10.222.0.60 () {54 vars in 921 bytes} [Sun Jul 31 01:39:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:39:45.481752 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2666371-519c-4f40-bcfe-9e90a35600be None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:45.482035 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2666371-519c-4f40-bcfe-9e90a35600be None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:45.482305 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2666371-519c-4f40-bcfe-9e90a35600be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:45.539406 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-a2666371-519c-4f40-bcfe-9e90a35600be None None] MFA Rules not processed for user `81117154f6d1474c805a69c5617c307d`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:39:45.540819 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-a2666371-519c-4f40-bcfe-9e90a35600be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:39:45.547527 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1335/2638] 10.222.0.60 () {58 vars in 1018 bytes} [Sun Jul 31 01:39:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:39:45.559986 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598d63e-67aa-4dd4-aa5b-283203613aae None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:39:45.571149 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598d63e-67aa-4dd4-aa5b-283203613aae None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:39:45.574977 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188d133-d9da-4b30-9eca-6a8f0eb86ff8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:39:45.575716 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188d133-d9da-4b30-9eca-6a8f0eb86ff8 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:45.576087 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188d133-d9da-4b30-9eca-6a8f0eb86ff8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:45.576451 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188d133-d9da-4b30-9eca-6a8f0eb86ff8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:45.584219 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e188d133-d9da-4b30-9eca-6a8f0eb86ff8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:39:45.585837 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e188d133-d9da-4b30-9eca-6a8f0eb86ff8 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:39:45.594680 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1304/2639] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:39:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:39:45.706974 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5fd22-a3aa-47be-ac77-9854935bc38d None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:45.707252 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5fd22-a3aa-47be-ac77-9854935bc38d None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:45.707611 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5fd22-a3aa-47be-ac77-9854935bc38d None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:45.708989 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1336/2640] 10.222.0.60 () {54 vars in 921 bytes} [Sun Jul 31 01:39:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:39:45.714354 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a422dc-7459-48ab-b72c-5837b1185a50 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:45.714670 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a422dc-7459-48ab-b72c-5837b1185a50 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:45.714947 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a422dc-7459-48ab-b72c-5837b1185a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:45.756117 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-e4a422dc-7459-48ab-b72c-5837b1185a50 None None] MFA Rules not processed for user `657a3f73879e4b31b70a1c4f73e80f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:39:45.757340 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-e4a422dc-7459-48ab-b72c-5837b1185a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:39:45.766907 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1305/2641] 10.222.0.60 () {58 vars in 1018 bytes} [Sun Jul 31 01:39:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:39:45.794279 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5fd22-a3aa-47be-ac77-9854935bc38d None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:39:45.816583 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5fd22-a3aa-47be-ac77-9854935bc38d None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:39:45.825198 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9769061e-4029-44a1-838a-f62ade6f8b57 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:39:45.825798 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769061e-4029-44a1-838a-f62ade6f8b57 service placement] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:45.826069 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769061e-4029-44a1-838a-f62ade6f8b57 service placement] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:45.826331 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769061e-4029-44a1-838a-f62ade6f8b57 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:45.839361 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9769061e-4029-44a1-838a-f62ade6f8b57 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:39:45.842465 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9769061e-4029-44a1-838a-f62ade6f8b57 service placement] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:39:45.856582 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1337/2642] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:39:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:39:46.046871 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a422dc-7459-48ab-b72c-5837b1185a50 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:39:46.048489 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-e4a422dc-7459-48ab-b72c-5837b1185a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:39:46.060985 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a422dc-7459-48ab-b72c-5837b1185a50 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:39:46.067094 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53431c-54de-480a-bd41-98dd43465686 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:39:46.068038 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53431c-54de-480a-bd41-98dd43465686 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:39:46.068380 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53431c-54de-480a-bd41-98dd43465686 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:39:46.068710 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53431c-54de-480a-bd41-98dd43465686 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:39:46.071912 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-cc53431c-54de-480a-bd41-98dd43465686 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:39:46.090007 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc53431c-54de-480a-bd41-98dd43465686 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:39:46.091464 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc53431c-54de-480a-bd41-98dd43465686 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:39:46.103260 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1306/2643] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:39:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:39:55.851012 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=51 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:39:56.098206 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=21 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:40:19.418397 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9769061e-4029-44a1-838a-f62ade6f8b57 service placement] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:40:19.420256 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-9769061e-4029-44a1-838a-f62ade6f8b57 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:40:19.439635 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9769061e-4029-44a1-838a-f62ade6f8b57 service placement] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:40:19.446455 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85cc69b-bfaa-4fd7-a488-c113ed30dc0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:40:19.447096 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85cc69b-bfaa-4fd7-a488-c113ed30dc0b service nova] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:40:19.447376 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85cc69b-bfaa-4fd7-a488-c113ed30dc0b service nova] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:40:19.447723 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85cc69b-bfaa-4fd7-a488-c113ed30dc0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:40:19.449869 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-c85cc69b-bfaa-4fd7-a488-c113ed30dc0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:40:19.466023 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85cc69b-bfaa-4fd7-a488-c113ed30dc0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:40:19.467665 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85cc69b-bfaa-4fd7-a488-c113ed30dc0b service nova] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:40:19.480833 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1338/2644] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:40:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:40:26.185902 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53431c-54de-480a-bd41-98dd43465686 service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:40:26.203354 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53431c-54de-480a-bd41-98dd43465686 service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:40:26.210313 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a6831-69cf-4575-905b-e33adba00c1d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:40:26.211300 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a6831-69cf-4575-905b-e33adba00c1d service placement] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:40:26.211680 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a6831-69cf-4575-905b-e33adba00c1d service placement] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:40:26.211971 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a6831-69cf-4575-905b-e33adba00c1d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:40:26.213823 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-3a2a6831-69cf-4575-905b-e33adba00c1d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:40:26.226283 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a6831-69cf-4575-905b-e33adba00c1d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:40:26.227957 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a6831-69cf-4575-905b-e33adba00c1d service placement] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:40:26.241698 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1307/2645] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:40:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:40:26.257418 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85cc69b-bfaa-4fd7-a488-c113ed30dc0b service nova] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:40:26.272592 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85cc69b-bfaa-4fd7-a488-c113ed30dc0b service nova] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:40:26.279874 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a12639-d362-49fa-a602-3c0fbba525e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:40:26.280752 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a12639-d362-49fa-a602-3c0fbba525e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:40:26.281697 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a12639-d362-49fa-a602-3c0fbba525e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:40:26.281697 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a12639-d362-49fa-a602-3c0fbba525e2 admin admin] PATH_INFO: `/v3/users/e6e2c4f863ca42459a67ac96efb30a33` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:40:26.282962 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a12639-d362-49fa-a602-3c0fbba525e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6e2c4f863ca42459a67ac96efb30a33)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:40:26.284997 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a12639-d362-49fa-a602-3c0fbba525e2 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:40:26.338213 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-87a12639-d362-49fa-a602-3c0fbba525e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6e2c4f863ca42459a67ac96efb30a33'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:40:26.344967 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-87a12639-d362-49fa-a602-3c0fbba525e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6e2c4f863ca42459a67ac96efb30a33'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:40:26.345615 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-87a12639-d362-49fa-a602-3c0fbba525e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6e2c4f863ca42459a67ac96efb30a33'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:40:26.358020 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-87a12639-d362-49fa-a602-3c0fbba525e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6e2c4f863ca42459a67ac96efb30a33'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:40:26.358699 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-87a12639-d362-49fa-a602-3c0fbba525e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6e2c4f863ca42459a67ac96efb30a33'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:40:26.373125 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1339/2646] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:40:26 2022] DELETE /identity/v3/users/e6e2c4f863ca42459a67ac96efb30a33 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:40:26.557554 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a6831-69cf-4575-905b-e33adba00c1d service placement] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:40:26.572577 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a6831-69cf-4575-905b-e33adba00c1d service placement] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:40:26.630573 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91c079-b81c-43b3-affc-0825272aebc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:40:26.631211 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91c079-b81c-43b3-affc-0825272aebc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:40:26.631545 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91c079-b81c-43b3-affc-0825272aebc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:40:26.631787 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91c079-b81c-43b3-affc-0825272aebc5 admin admin] PATH_INFO: `/v3/projects/b9eb752b40524c42bb26ae2b21b8f0e2` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:40:26.633038 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a91c079-b81c-43b3-affc-0825272aebc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9eb752b40524c42bb26ae2b21b8f0e2)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:40:26.634941 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a91c079-b81c-43b3-affc-0825272aebc5 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:40:26.684232 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-1a91c079-b81c-43b3-affc-0825272aebc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9eb752b40524c42bb26ae2b21b8f0e2', 'request_id': 'req-1a91c079-b81c-43b3-affc-0825272aebc5'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:40:26.689942 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-1a91c079-b81c-43b3-affc-0825272aebc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9eb752b40524c42bb26ae2b21b8f0e2', 'request_id': 'req-1a91c079-b81c-43b3-affc-0825272aebc5'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:40:26.696412 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-1a91c079-b81c-43b3-affc-0825272aebc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9eb752b40524c42bb26ae2b21b8f0e2', 'request_id': 'req-1a91c079-b81c-43b3-affc-0825272aebc5'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:40:26.711234 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-1a91c079-b81c-43b3-affc-0825272aebc5 admin admin] The token cache is being invalidate because project b9eb752b40524c42bb26ae2b21b8f0e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:40:26.711544 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-1a91c079-b81c-43b3-affc-0825272aebc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:40:26.712209 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-1a91c079-b81c-43b3-affc-0825272aebc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:40:26.713786 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1308/2647] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:40:26 2022] DELETE /identity/v3/projects/b9eb752b40524c42bb26ae2b21b8f0e2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:40:26.719007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd3a87-66e8-482e-8613-cc1a52f612ae None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:40:26.719298 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd3a87-66e8-482e-8613-cc1a52f612ae None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:40:26.719606 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd3a87-66e8-482e-8613-cc1a52f612ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:40:26.739635 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-d5bd3a87-66e8-482e-8613-cc1a52f612ae None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:40:26.740941 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-d5bd3a87-66e8-482e-8613-cc1a52f612ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:40:26.809396 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1340/2648] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:40:26.817402 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e27218-fd1a-41b1-a58b-9523ebf3feee None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:40:26.817667 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e27218-fd1a-41b1-a58b-9523ebf3feee None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:40:26.817971 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e27218-fd1a-41b1-a58b-9523ebf3feee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:40:26.837774 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-40e27218-fd1a-41b1-a58b-9523ebf3feee None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:40:26.838972 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-40e27218-fd1a-41b1-a58b-9523ebf3feee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:40:26.847585 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1309/2649] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:40:26.852074 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd3a87-66e8-482e-8613-cc1a52f612ae None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:40:26.861961 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd3a87-66e8-482e-8613-cc1a52f612ae None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:40:26.866978 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccae591-9985-4afc-a145-a25385a057da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:40:26.867604 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccae591-9985-4afc-a145-a25385a057da admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:40:26.867879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccae591-9985-4afc-a145-a25385a057da admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:40:26.868127 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccae591-9985-4afc-a145-a25385a057da admin admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:40:26.868813 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccae591-9985-4afc-a145-a25385a057da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:40:26.869478 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccae591-9985-4afc-a145-a25385a057da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:40:26.871081 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccae591-9985-4afc-a145-a25385a057da admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:40:26.882818 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1341/2650] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:40:26.888719 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e27218-fd1a-41b1-a58b-9523ebf3feee None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:40:26.898584 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e27218-fd1a-41b1-a58b-9523ebf3feee None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:40:26.904711 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a91aa4-cc6c-429c-8eb1-b8c7371b365c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:40:26.905268 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a91aa4-cc6c-429c-8eb1-b8c7371b365c admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:40:26.905545 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a91aa4-cc6c-429c-8eb1-b8c7371b365c admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:40:26.905814 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a91aa4-cc6c-429c-8eb1-b8c7371b365c admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:40:26.907031 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a91aa4-cc6c-429c-8eb1-b8c7371b365c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:40:26.908495 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a91aa4-cc6c-429c-8eb1-b8c7371b365c admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:40:26.938994 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1310/2651] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:40:26 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:40:26.943375 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccae591-9985-4afc-a145-a25385a057da admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:40:26.953934 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccae591-9985-4afc-a145-a25385a057da admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:40:26.997669 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:40:27.012958 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f5a8a-87a6-436a-b58f-da1dd82400b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:40:27.013576 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f5a8a-87a6-436a-b58f-da1dd82400b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:40:27.013847 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f5a8a-87a6-436a-b58f-da1dd82400b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:40:27.014136 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f5a8a-87a6-436a-b58f-da1dd82400b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:40:27.014822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f5a8a-87a6-436a-b58f-da1dd82400b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:40:27.016739 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f5a8a-87a6-436a-b58f-da1dd82400b6 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:40:27.039054 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1342/2652] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:40:26 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:40:27.043299 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a91aa4-cc6c-429c-8eb1-b8c7371b365c admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:40:27.054238 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a91aa4-cc6c-429c-8eb1-b8c7371b365c admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:40:27.059445 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9764f-6c4b-4eff-8037-08a863d074d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:40:27.060094 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9764f-6c4b-4eff-8037-08a863d074d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:40:27.060369 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9764f-6c4b-4eff-8037-08a863d074d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:40:27.060643 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9764f-6c4b-4eff-8037-08a863d074d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:40:27.061338 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf9764f-6c4b-4eff-8037-08a863d074d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:40:27.062921 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf9764f-6c4b-4eff-8037-08a863d074d2 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:40:27.073393 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1311/2653] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:40:27.077477 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f5a8a-87a6-436a-b58f-da1dd82400b6 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:40:27.087868 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f5a8a-87a6-436a-b58f-da1dd82400b6 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:40:27.093408 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f6850-be58-4db1-b836-831e624a9dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:40:27.094027 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f6850-be58-4db1-b836-831e624a9dbd admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:40:27.094306 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f6850-be58-4db1-b836-831e624a9dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:40:27.094579 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f6850-be58-4db1-b836-831e624a9dbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:40:27.095275 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f6850-be58-4db1-b836-831e624a9dbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:40:27.096913 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f6850-be58-4db1-b836-831e624a9dbd admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:40:27.107505 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1343/2654] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:40:27.111755 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9764f-6c4b-4eff-8037-08a863d074d2 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:40:27.122809 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9764f-6c4b-4eff-8037-08a863d074d2 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:40:27.128049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07676ede-0197-49b0-a69b-52405d5fed8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:40:27.128713 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07676ede-0197-49b0-a69b-52405d5fed8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:40:27.128993 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07676ede-0197-49b0-a69b-52405d5fed8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:40:27.129276 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07676ede-0197-49b0-a69b-52405d5fed8e admin admin] PATH_INFO: `/v3/projects/e25ed81b5c764d12bd8b454b5d1215ac/users/8cae9594d2d64114b5b68b5149954992/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:40:27.146389 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07676ede-0197-49b0-a69b-52405d5fed8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e25ed81b5c764d12bd8b454b5d1215ac, user_id=8cae9594d2d64114b5b68b5149954992, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:40:27.150434 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07676ede-0197-49b0-a69b-52405d5fed8e admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:40:27.165273 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1312/2655] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:40:27 2022] PUT /identity/v3/projects/e25ed81b5c764d12bd8b454b5d1215ac/users/8cae9594d2d64114b5b68b5149954992/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:40:27.170384 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a2428-29a9-4fef-b6e2-29a75ae68e18 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:40:27.170663 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a2428-29a9-4fef-b6e2-29a75ae68e18 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:40:27.170926 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a2428-29a9-4fef-b6e2-29a75ae68e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:40:27.189592 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-305a2428-29a9-4fef-b6e2-29a75ae68e18 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:40:27.190777 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-305a2428-29a9-4fef-b6e2-29a75ae68e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:40:27.255899 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1344/2656] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:40:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:40:27.268017 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07676ede-0197-49b0-a69b-52405d5fed8e admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:40:27.269888 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-07676ede-0197-49b0-a69b-52405d5fed8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:40:27.286552 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:40:27.338858 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07676ede-0197-49b0-a69b-52405d5fed8e admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:40:27.343202 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fed87b-b584-4417-b0f5-96370d746b21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:40:27.343928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fed87b-b584-4417-b0f5-96370d746b21 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:40:27.344416 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fed87b-b584-4417-b0f5-96370d746b21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:40:27.344905 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fed87b-b584-4417-b0f5-96370d746b21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:40:27.357522 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fed87b-b584-4417-b0f5-96370d746b21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:40:27.358960 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fed87b-b584-4417-b0f5-96370d746b21 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:40:27.370629 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1313/2657] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:40:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:40:31.326640 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0de88a-1ae7-4afd-97a2-171b685eeadb None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:40:31.327166 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0de88a-1ae7-4afd-97a2-171b685eeadb None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:40:31.327166 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0de88a-1ae7-4afd-97a2-171b685eeadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:40:31.365566 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-db0de88a-1ae7-4afd-97a2-171b685eeadb None None] MFA Rules not processed for user `8cae9594d2d64114b5b68b5149954992`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:40:31.367017 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-db0de88a-1ae7-4afd-97a2-171b685eeadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:40:31.437144 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1345/2658] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:40:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:40:31.448101 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73666545-ee00-4493-bf98-5408e56591dc None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:40:31.448628 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73666545-ee00-4493-bf98-5408e56591dc None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:40:31.448628 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73666545-ee00-4493-bf98-5408e56591dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:40:31.468546 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-73666545-ee00-4493-bf98-5408e56591dc None None] MFA Rules not processed for user `8cae9594d2d64114b5b68b5149954992`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:40:31.469773 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-73666545-ee00-4493-bf98-5408e56591dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:40:31.477117 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1314/2659] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:40:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:40:31.488846 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0de88a-1ae7-4afd-97a2-171b685eeadb None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:40:31.490287 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-db0de88a-1ae7-4afd-97a2-171b685eeadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:40:31.546116 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:40:31.568941 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0de88a-1ae7-4afd-97a2-171b685eeadb None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:40:31.574892 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b47d7-d26d-4e11-b7d2-1f7d1bf02bb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:40:31.575537 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b47d7-d26d-4e11-b7d2-1f7d1bf02bb8 service nova] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:40:31.575838 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b47d7-d26d-4e11-b7d2-1f7d1bf02bb8 service nova] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:40:31.576112 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b47d7-d26d-4e11-b7d2-1f7d1bf02bb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:40:31.586930 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b47d7-d26d-4e11-b7d2-1f7d1bf02bb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:40:31.588548 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b47d7-d26d-4e11-b7d2-1f7d1bf02bb8 service nova] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:40:31.598236 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1346/2660] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:40:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:40:41.463270 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=23 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:40:41.593646 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=9 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:40:42.766254 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f244514-ea19-4279-8fb4-5e0da835b537 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:40:42.766815 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f244514-ea19-4279-8fb4-5e0da835b537 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:40:42.766815 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f244514-ea19-4279-8fb4-5e0da835b537 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:40:42.768278 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1315/2661] 10.222.0.60 () {54 vars in 921 bytes} [Sun Jul 31 01:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:40:42.773519 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c5fa5-bcf9-4a20-9abb-3bb451534435 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:40:42.774520 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c5fa5-bcf9-4a20-9abb-3bb451534435 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:40:42.774921 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c5fa5-bcf9-4a20-9abb-3bb451534435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:40:42.794882 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-c30c5fa5-bcf9-4a20-9abb-3bb451534435 None None] MFA Rules not processed for user `657a3f73879e4b31b70a1c4f73e80f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:40:42.796122 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-c30c5fa5-bcf9-4a20-9abb-3bb451534435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:40:42.858627 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1347/2662] 10.222.0.60 () {58 vars in 1018 bytes} [Sun Jul 31 01:40:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:40:42.882076 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f244514-ea19-4279-8fb4-5e0da835b537 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:40:42.884058 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-6f244514-ea19-4279-8fb4-5e0da835b537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:40:42.902126 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f244514-ea19-4279-8fb4-5e0da835b537 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:40:42.907682 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6990dd-4abe-4c66-bcd9-e9e4d11fc1a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:40:42.908300 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6990dd-4abe-4c66-bcd9-e9e4d11fc1a6 service placement] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:40:42.908577 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6990dd-4abe-4c66-bcd9-e9e4d11fc1a6 service placement] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:40:42.908847 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6990dd-4abe-4c66-bcd9-e9e4d11fc1a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:40:42.917869 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6990dd-4abe-4c66-bcd9-e9e4d11fc1a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:40:42.919440 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6990dd-4abe-4c66-bcd9-e9e4d11fc1a6 service placement] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:40:42.928901 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1316/2663] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:40:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:40:52.849615 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=29 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:40:52.925196 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=6 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:41:23.102982 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a10ed-decd-4d44-a522-1323808c77f9 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:41:23.103610 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a10ed-decd-4d44-a522-1323808c77f9 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:41:23.103610 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a10ed-decd-4d44-a522-1323808c77f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:41:23.126595 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-e15a10ed-decd-4d44-a522-1323808c77f9 None None] MFA Rules not processed for user `8cae9594d2d64114b5b68b5149954992`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:41:23.128125 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-e15a10ed-decd-4d44-a522-1323808c77f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:41:23.135310 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1348/2664] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:41:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:41:23.390296 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6990dd-4abe-4c66-bcd9-e9e4d11fc1a6 service placement] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:41:23.392000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-5b6990dd-4abe-4c66-bcd9-e9e4d11fc1a6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:41:23.404740 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6990dd-4abe-4c66-bcd9-e9e4d11fc1a6 service placement] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:41:23.408818 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc500c03-13c0-4fdc-be17-a398249f91ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:41:23.409422 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc500c03-13c0-4fdc-be17-a398249f91ed service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:41:23.409690 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc500c03-13c0-4fdc-be17-a398249f91ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:41:23.410032 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc500c03-13c0-4fdc-be17-a398249f91ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:41:23.412051 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-cc500c03-13c0-4fdc-be17-a398249f91ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:41:23.421706 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc500c03-13c0-4fdc-be17-a398249f91ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:41:23.423216 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc500c03-13c0-4fdc-be17-a398249f91ed service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:41:23.431398 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1317/2665] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:41:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:41:33.120856 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:41:33.428116 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=6 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:41:34.951685 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30bb227-2f6f-4d43-91f7-cd48c7e8e4e3 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:41:34.952247 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30bb227-2f6f-4d43-91f7-cd48c7e8e4e3 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:41:34.952247 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30bb227-2f6f-4d43-91f7-cd48c7e8e4e3 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:41:34.953654 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1349/2666] 10.222.0.60 () {54 vars in 921 bytes} [Sun Jul 31 01:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:41:34.959199 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13234bb0-88d8-4ed1-8f52-412454649ee5 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:41:34.959715 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13234bb0-88d8-4ed1-8f52-412454649ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:41:34.959812 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13234bb0-88d8-4ed1-8f52-412454649ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:41:34.979192 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-13234bb0-88d8-4ed1-8f52-412454649ee5 None None] MFA Rules not processed for user `657a3f73879e4b31b70a1c4f73e80f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:41:34.980457 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-13234bb0-88d8-4ed1-8f52-412454649ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:41:34.991968 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1318/2667] 10.222.0.60 () {58 vars in 1018 bytes} [Sun Jul 31 01:41:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:41:35.013100 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30bb227-2f6f-4d43-91f7-cd48c7e8e4e3 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:41:35.027545 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30bb227-2f6f-4d43-91f7-cd48c7e8e4e3 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:41:35.033018 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e8e89-d857-4022-b8b3-e17a69081fc1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:41:35.033623 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e8e89-d857-4022-b8b3-e17a69081fc1 service placement] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:41:35.033886 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e8e89-d857-4022-b8b3-e17a69081fc1 service placement] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:41:35.034170 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e8e89-d857-4022-b8b3-e17a69081fc1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:41:35.043285 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412e8e89-d857-4022-b8b3-e17a69081fc1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:41:35.044910 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412e8e89-d857-4022-b8b3-e17a69081fc1 service placement] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:41:35.054671 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1350/2668] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:41:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:41:40.900914 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13234bb0-88d8-4ed1-8f52-412454649ee5 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:41:40.910513 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13234bb0-88d8-4ed1-8f52-412454649ee5 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:41:40.914346 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24331d-92e4-4178-b351-9259363f0f26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:41:40.914958 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24331d-92e4-4178-b351-9259363f0f26 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:41:40.915242 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24331d-92e4-4178-b351-9259363f0f26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:41:40.915511 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24331d-92e4-4178-b351-9259363f0f26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:41:40.917361 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-0e24331d-92e4-4178-b351-9259363f0f26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:41:40.930646 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e24331d-92e4-4178-b351-9259363f0f26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:41:40.932653 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e24331d-92e4-4178-b351-9259363f0f26 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:41:40.943059 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1319/2669] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:41:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:41:42.071662 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e8e89-d857-4022-b8b3-e17a69081fc1 service placement] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:41:42.081840 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e8e89-d857-4022-b8b3-e17a69081fc1 service placement] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:41:42.087809 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8c2d1-7bfc-4363-bb1a-2ed6a734e30e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:41:42.089726 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8c2d1-7bfc-4363-bb1a-2ed6a734e30e service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:41:42.089726 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8c2d1-7bfc-4363-bb1a-2ed6a734e30e service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:41:42.089726 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8c2d1-7bfc-4363-bb1a-2ed6a734e30e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:41:42.091669 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-2de8c2d1-7bfc-4363-bb1a-2ed6a734e30e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:41:42.112813 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de8c2d1-7bfc-4363-bb1a-2ed6a734e30e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:41:42.114444 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de8c2d1-7bfc-4363-bb1a-2ed6a734e30e service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:41:42.127772 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1351/2670] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:41:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:41:48.044824 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24331d-92e4-4178-b351-9259363f0f26 service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:41:48.053933 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24331d-92e4-4178-b351-9259363f0f26 service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:41:48.057886 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e76f5-a483-4be6-bcff-bda51e2f42ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:41:48.058528 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e76f5-a483-4be6-bcff-bda51e2f42ef service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:41:48.058783 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e76f5-a483-4be6-bcff-bda51e2f42ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:41:48.059065 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e76f5-a483-4be6-bcff-bda51e2f42ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:41:48.060985 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-4c3e76f5-a483-4be6-bcff-bda51e2f42ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:41:48.070910 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e76f5-a483-4be6-bcff-bda51e2f42ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:41:48.072459 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e76f5-a483-4be6-bcff-bda51e2f42ef service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:41:48.080568 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1320/2671] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:41:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:41:52.122602 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=12 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:41:58.077203 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=15 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:42:16.482498 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8c2d1-7bfc-4363-bb1a-2ed6a734e30e service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:42:16.494975 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8c2d1-7bfc-4363-bb1a-2ed6a734e30e service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:42:16.501439 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cde57e-1228-4f59-9ff8-897abb32b8f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:42:16.502235 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cde57e-1228-4f59-9ff8-897abb32b8f3 service nova] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:42:16.502659 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cde57e-1228-4f59-9ff8-897abb32b8f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:42:16.503031 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cde57e-1228-4f59-9ff8-897abb32b8f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:42:16.504995 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-e8cde57e-1228-4f59-9ff8-897abb32b8f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:42:16.519120 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cde57e-1228-4f59-9ff8-897abb32b8f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:42:16.520761 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cde57e-1228-4f59-9ff8-897abb32b8f3 service nova] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:42:16.532872 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1352/2672] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:42:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:42:21.922362 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e76f5-a483-4be6-bcff-bda51e2f42ef service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:42:21.937996 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e76f5-a483-4be6-bcff-bda51e2f42ef service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:42:21.944270 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20392dd9-5b49-4a38-812f-431cabe6a025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:42:21.944950 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20392dd9-5b49-4a38-812f-431cabe6a025 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:42:21.945280 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20392dd9-5b49-4a38-812f-431cabe6a025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:42:21.945617 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20392dd9-5b49-4a38-812f-431cabe6a025 admin admin] PATH_INFO: `/v3/users/8cae9594d2d64114b5b68b5149954992` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:42:21.947694 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20392dd9-5b49-4a38-812f-431cabe6a025 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cae9594d2d64114b5b68b5149954992)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:42:21.950311 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20392dd9-5b49-4a38-812f-431cabe6a025 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:42:22.003647 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-20392dd9-5b49-4a38-812f-431cabe6a025 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cae9594d2d64114b5b68b5149954992'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:42:22.004348 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-20392dd9-5b49-4a38-812f-431cabe6a025 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cae9594d2d64114b5b68b5149954992'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:42:22.016813 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-20392dd9-5b49-4a38-812f-431cabe6a025 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cae9594d2d64114b5b68b5149954992'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:42:22.024136 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-20392dd9-5b49-4a38-812f-431cabe6a025 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cae9594d2d64114b5b68b5149954992'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:42:22.024764 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-20392dd9-5b49-4a38-812f-431cabe6a025 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cae9594d2d64114b5b68b5149954992'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:42:22.037897 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1321/2673] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:42:21 2022] DELETE /identity/v3/users/8cae9594d2d64114b5b68b5149954992 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:42:22.229370 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cde57e-1228-4f59-9ff8-897abb32b8f3 service nova] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:42:22.240890 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cde57e-1228-4f59-9ff8-897abb32b8f3 service nova] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:42:22.300819 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f000bd-0496-4b43-8b5c-0a98c6fd72a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:42:22.301473 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f000bd-0496-4b43-8b5c-0a98c6fd72a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:42:22.301750 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f000bd-0496-4b43-8b5c-0a98c6fd72a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:42:22.302019 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f000bd-0496-4b43-8b5c-0a98c6fd72a9 admin admin] PATH_INFO: `/v3/projects/e25ed81b5c764d12bd8b454b5d1215ac` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:42:22.303187 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f000bd-0496-4b43-8b5c-0a98c6fd72a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e25ed81b5c764d12bd8b454b5d1215ac)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:42:22.305192 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f000bd-0496-4b43-8b5c-0a98c6fd72a9 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:42:22.351623 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-d7f000bd-0496-4b43-8b5c-0a98c6fd72a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e25ed81b5c764d12bd8b454b5d1215ac', 'request_id': 'req-d7f000bd-0496-4b43-8b5c-0a98c6fd72a9'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:42:22.358919 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-d7f000bd-0496-4b43-8b5c-0a98c6fd72a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e25ed81b5c764d12bd8b454b5d1215ac', 'request_id': 'req-d7f000bd-0496-4b43-8b5c-0a98c6fd72a9'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:42:22.369928 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-d7f000bd-0496-4b43-8b5c-0a98c6fd72a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e25ed81b5c764d12bd8b454b5d1215ac', 'request_id': 'req-d7f000bd-0496-4b43-8b5c-0a98c6fd72a9'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:42:22.383447 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-d7f000bd-0496-4b43-8b5c-0a98c6fd72a9 admin admin] The token cache is being invalidate because project e25ed81b5c764d12bd8b454b5d1215ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:42:22.383764 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-d7f000bd-0496-4b43-8b5c-0a98c6fd72a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:42:22.384494 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-d7f000bd-0496-4b43-8b5c-0a98c6fd72a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:42:22.386073 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1353/2674] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:42:22 2022] DELETE /identity/v3/projects/e25ed81b5c764d12bd8b454b5d1215ac => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:42:22.391395 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ac202-e0ee-4750-ac28-b87729c65198 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:42:22.391670 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ac202-e0ee-4750-ac28-b87729c65198 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:42:22.391951 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ac202-e0ee-4750-ac28-b87729c65198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:42:22.412967 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-301ac202-e0ee-4750-ac28-b87729c65198 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:42:22.414194 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-301ac202-e0ee-4750-ac28-b87729c65198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:42:22.475672 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1322/2675] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:42:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:42:22.484724 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424372b-d0d5-4b3f-91a3-73b8e4b36204 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:42:22.485015 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424372b-d0d5-4b3f-91a3-73b8e4b36204 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:42:22.485289 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424372b-d0d5-4b3f-91a3-73b8e4b36204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:42:22.505794 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-c424372b-d0d5-4b3f-91a3-73b8e4b36204 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:42:22.506974 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-c424372b-d0d5-4b3f-91a3-73b8e4b36204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:42:22.515512 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1354/2676] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:42:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:42:22.519901 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ac202-e0ee-4750-ac28-b87729c65198 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:42:22.529625 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ac202-e0ee-4750-ac28-b87729c65198 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:42:22.534837 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577050d-02d5-4d7c-a816-68f3f18799f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:42:22.535442 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577050d-02d5-4d7c-a816-68f3f18799f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:42:22.535752 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577050d-02d5-4d7c-a816-68f3f18799f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:42:22.536022 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577050d-02d5-4d7c-a816-68f3f18799f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:42:22.536715 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9577050d-02d5-4d7c-a816-68f3f18799f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:42:22.537002 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9577050d-02d5-4d7c-a816-68f3f18799f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:42:22.538591 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9577050d-02d5-4d7c-a816-68f3f18799f7 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:42:22.550354 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1323/2677] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:42:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:42:22.555347 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424372b-d0d5-4b3f-91a3-73b8e4b36204 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:42:22.569772 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424372b-d0d5-4b3f-91a3-73b8e4b36204 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:42:22.576418 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e26fa9-fcba-42cc-a28e-ffa89a761282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:42:22.577020 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e26fa9-fcba-42cc-a28e-ffa89a761282 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:42:22.577327 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e26fa9-fcba-42cc-a28e-ffa89a761282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:42:22.577593 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e26fa9-fcba-42cc-a28e-ffa89a761282 admin admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:42:22.578267 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e26fa9-fcba-42cc-a28e-ffa89a761282 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:42:22.580178 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e26fa9-fcba-42cc-a28e-ffa89a761282 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:42:22.620531 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1355/2678] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:42:22 2022] POST /identity/v3/projects => generated 379 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:42:22.624771 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577050d-02d5-4d7c-a816-68f3f18799f7 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:42:22.634654 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577050d-02d5-4d7c-a816-68f3f18799f7 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:42:22.691295 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8bb9a-8c83-4206-a6f5-88059889f435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:42:22.691860 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8bb9a-8c83-4206-a6f5-88059889f435 admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:42:22.692135 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8bb9a-8c83-4206-a6f5-88059889f435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:42:22.692405 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8bb9a-8c83-4206-a6f5-88059889f435 admin admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:42:22.693076 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba8bb9a-8c83-4206-a6f5-88059889f435 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:42:22.694988 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba8bb9a-8c83-4206-a6f5-88059889f435 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:42:22.703034 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:42:22.718864 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1324/2679] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:42:22 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:42:22.723181 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e26fa9-fcba-42cc-a28e-ffa89a761282 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:42:22.733445 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e26fa9-fcba-42cc-a28e-ffa89a761282 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:42:22.738619 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34feca-13e8-440e-a983-fd05ca135314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:42:22.739223 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34feca-13e8-440e-a983-fd05ca135314 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:42:22.739516 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34feca-13e8-440e-a983-fd05ca135314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:42:22.739786 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34feca-13e8-440e-a983-fd05ca135314 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:42:22.740480 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c34feca-13e8-440e-a983-fd05ca135314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:42:22.742078 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c34feca-13e8-440e-a983-fd05ca135314 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:42:22.753150 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1356/2680] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:42:22.757455 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8bb9a-8c83-4206-a6f5-88059889f435 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:42:22.768225 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8bb9a-8c83-4206-a6f5-88059889f435 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:42:22.774017 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5a627-55bd-4ea9-a190-68ec67727c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:42:22.774668 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5a627-55bd-4ea9-a190-68ec67727c32 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:42:22.775047 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5a627-55bd-4ea9-a190-68ec67727c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:42:22.775321 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5a627-55bd-4ea9-a190-68ec67727c32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:42:22.776082 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5a627-55bd-4ea9-a190-68ec67727c32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:42:22.777672 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5a627-55bd-4ea9-a190-68ec67727c32 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:42:22.788870 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1325/2681] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:42:22.793069 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34feca-13e8-440e-a983-fd05ca135314 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:42:22.803095 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34feca-13e8-440e-a983-fd05ca135314 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:42:22.808639 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6748a65-53c7-4ed0-8d97-83c2b8366f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:42:22.809302 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6748a65-53c7-4ed0-8d97-83c2b8366f2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:42:22.809560 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6748a65-53c7-4ed0-8d97-83c2b8366f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:42:22.809855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6748a65-53c7-4ed0-8d97-83c2b8366f2f admin admin] PATH_INFO: `/v3/projects/0b06992da1e6409990af5f339a480865/users/8cb7a9b9caaf495793cbdf1ddccd4787/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:42:22.825043 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6748a65-53c7-4ed0-8d97-83c2b8366f2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b06992da1e6409990af5f339a480865, user_id=8cb7a9b9caaf495793cbdf1ddccd4787, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:42:22.827852 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6748a65-53c7-4ed0-8d97-83c2b8366f2f admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:42:22.846308 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1357/2682] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:42:22 2022] PUT /identity/v3/projects/0b06992da1e6409990af5f339a480865/users/8cb7a9b9caaf495793cbdf1ddccd4787/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:42:22.851599 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83be8a-db13-4bdb-8dce-770dacd4ae75 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:42:22.851874 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83be8a-db13-4bdb-8dce-770dacd4ae75 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:42:22.852174 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83be8a-db13-4bdb-8dce-770dacd4ae75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:42:22.875259 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-3e83be8a-db13-4bdb-8dce-770dacd4ae75 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:42:22.876485 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-3e83be8a-db13-4bdb-8dce-770dacd4ae75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:42:22.938869 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1326/2683] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:42:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:42:22.949227 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6748a65-53c7-4ed0-8d97-83c2b8366f2f admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:42:22.951903 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-a6748a65-53c7-4ed0-8d97-83c2b8366f2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:42:22.961825 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:42:23.016906 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6748a65-53c7-4ed0-8d97-83c2b8366f2f admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:42:23.021173 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7feee6a-e8c2-49e1-ac3f-6da5a971cc34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:42:23.021795 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7feee6a-e8c2-49e1-ac3f-6da5a971cc34 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:42:23.022073 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7feee6a-e8c2-49e1-ac3f-6da5a971cc34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:42:23.022341 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7feee6a-e8c2-49e1-ac3f-6da5a971cc34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:42:23.032346 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7feee6a-e8c2-49e1-ac3f-6da5a971cc34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:42:23.033776 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7feee6a-e8c2-49e1-ac3f-6da5a971cc34 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:42:23.043505 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1358/2684] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:42:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:42:27.066411 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9c0a8-a156-4171-ae08-2ebb4cc7a86d None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:42:27.066919 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9c0a8-a156-4171-ae08-2ebb4cc7a86d None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:42:27.067031 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9c0a8-a156-4171-ae08-2ebb4cc7a86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:42:27.100435 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-49c9c0a8-a156-4171-ae08-2ebb4cc7a86d None None] MFA Rules not processed for user `8cb7a9b9caaf495793cbdf1ddccd4787`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:42:27.101199 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-49c9c0a8-a156-4171-ae08-2ebb4cc7a86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:42:27.177871 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1327/2685] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:42:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:42:27.192245 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7feee6a-e8c2-49e1-ac3f-6da5a971cc34 service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:42:27.193754 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-c7feee6a-e8c2-49e1-ac3f-6da5a971cc34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:42:27.272409 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7feee6a-e8c2-49e1-ac3f-6da5a971cc34 service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:42:27.278571 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35116e5a-1319-496e-a9e9-a9b567fe8b38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:42:27.278766 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35116e5a-1319-496e-a9e9-a9b567fe8b38 service nova] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:42:27.278982 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35116e5a-1319-496e-a9e9-a9b567fe8b38 service nova] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:42:27.279248 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35116e5a-1319-496e-a9e9-a9b567fe8b38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:42:27.287855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35116e5a-1319-496e-a9e9-a9b567fe8b38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:42:27.289456 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35116e5a-1319-496e-a9e9-a9b567fe8b38 service nova] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:42:27.303852 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1359/2686] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:42:27 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:42:28.626971 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54936eee-3c50-452a-a4c7-df082e80a67a None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:42:28.627514 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54936eee-3c50-452a-a4c7-df082e80a67a None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:42:28.627514 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54936eee-3c50-452a-a4c7-df082e80a67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:42:28.647668 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-54936eee-3c50-452a-a4c7-df082e80a67a None None] MFA Rules not processed for user `8cb7a9b9caaf495793cbdf1ddccd4787`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:42:28.648780 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-54936eee-3c50-452a-a4c7-df082e80a67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:42:28.656247 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1328/2687] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:42:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:42:37.295812 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=58 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:42:38.642034 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:43:16.274550 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950d321-571c-433c-a6a1-f7f2432e1204 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:43:16.275148 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950d321-571c-433c-a6a1-f7f2432e1204 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:43:16.275259 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950d321-571c-433c-a6a1-f7f2432e1204 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:43:16.276775 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1360/2688] 10.222.0.60 () {54 vars in 921 bytes} [Sun Jul 31 01:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:43:16.283329 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640771a-7314-4db1-93af-1b6366ce8e60 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:43:16.283867 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640771a-7314-4db1-93af-1b6366ce8e60 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:43:16.283975 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640771a-7314-4db1-93af-1b6366ce8e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:43:16.303437 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-0640771a-7314-4db1-93af-1b6366ce8e60 None None] MFA Rules not processed for user `657a3f73879e4b31b70a1c4f73e80f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:43:16.304683 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-0640771a-7314-4db1-93af-1b6366ce8e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:43:16.372586 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1329/2689] 10.222.0.60 () {58 vars in 1018 bytes} [Sun Jul 31 01:43:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:43:16.393882 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950d321-571c-433c-a6a1-f7f2432e1204 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:43:16.395657 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-d950d321-571c-433c-a6a1-f7f2432e1204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:43:16.412324 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950d321-571c-433c-a6a1-f7f2432e1204 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:43:16.417515 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1355e6-7d55-4bdb-b326-f3d7d2db7f78 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:43:16.418119 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1355e6-7d55-4bdb-b326-f3d7d2db7f78 service placement] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:43:16.418390 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1355e6-7d55-4bdb-b326-f3d7d2db7f78 service placement] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:43:16.418660 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1355e6-7d55-4bdb-b326-f3d7d2db7f78 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:43:16.427002 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1355e6-7d55-4bdb-b326-f3d7d2db7f78 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:43:16.428588 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1355e6-7d55-4bdb-b326-f3d7d2db7f78 service placement] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:43:16.438058 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1361/2690] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:43:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:43:26.359849 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=29 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:43:26.434325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=6 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:43:39.996343 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879f9b2-b926-4794-a256-e2f16549f3ea None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:43:39.996870 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879f9b2-b926-4794-a256-e2f16549f3ea None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:43:39.996870 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879f9b2-b926-4794-a256-e2f16549f3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:43:40.016122 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-3879f9b2-b926-4794-a256-e2f16549f3ea None None] MFA Rules not processed for user `8cb7a9b9caaf495793cbdf1ddccd4787`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:43:40.017349 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-3879f9b2-b926-4794-a256-e2f16549f3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:43:40.026976 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1330/2691] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:43:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:43:50.010641 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=3 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:44:39.628599 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c189e-78bd-4b42-91c2-13d9d66963d9 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:44:39.629171 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c189e-78bd-4b42-91c2-13d9d66963d9 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:44:39.629171 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c189e-78bd-4b42-91c2-13d9d66963d9 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:44:39.630488 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1362/2692] 10.222.0.60 () {54 vars in 921 bytes} [Sun Jul 31 01:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:44:39.635958 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404e7c3-4cb9-40a1-9e4c-10031b6bd7d5 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:44:39.636424 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404e7c3-4cb9-40a1-9e4c-10031b6bd7d5 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:44:39.636526 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404e7c3-4cb9-40a1-9e4c-10031b6bd7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:44:39.679363 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-a404e7c3-4cb9-40a1-9e4c-10031b6bd7d5 None None] MFA Rules not processed for user `657a3f73879e4b31b70a1c4f73e80f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:44:39.680596 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-a404e7c3-4cb9-40a1-9e4c-10031b6bd7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:44:39.740679 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1331/2693] 10.222.0.60 () {58 vars in 1018 bytes} [Sun Jul 31 01:44:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:44:39.763192 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c189e-78bd-4b42-91c2-13d9d66963d9 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:44:39.777197 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c189e-78bd-4b42-91c2-13d9d66963d9 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:44:39.782555 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba58a8-6f17-4c9e-bc45-d1bb7ce072a0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:44:39.783147 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba58a8-6f17-4c9e-bc45-d1bb7ce072a0 service placement] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:44:39.783416 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba58a8-6f17-4c9e-bc45-d1bb7ce072a0 service placement] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:44:39.783721 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba58a8-6f17-4c9e-bc45-d1bb7ce072a0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:44:39.791819 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ba58a8-6f17-4c9e-bc45-d1bb7ce072a0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:44:39.793405 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ba58a8-6f17-4c9e-bc45-d1bb7ce072a0 service placement] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:44:39.802787 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1363/2694] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:44:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:44:40.049426 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404e7c3-4cb9-40a1-9e4c-10031b6bd7d5 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:44:40.061196 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404e7c3-4cb9-40a1-9e4c-10031b6bd7d5 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:44:40.067383 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82479fb-7826-4947-b43a-3ee87f60304d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:44:40.068029 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82479fb-7826-4947-b43a-3ee87f60304d service placement] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:44:40.068304 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82479fb-7826-4947-b43a-3ee87f60304d service placement] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:44:40.068571 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82479fb-7826-4947-b43a-3ee87f60304d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:44:40.070783 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-b82479fb-7826-4947-b43a-3ee87f60304d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:44:40.083216 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82479fb-7826-4947-b43a-3ee87f60304d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:44:40.084843 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82479fb-7826-4947-b43a-3ee87f60304d service placement] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:44:40.094698 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1332/2695] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:44:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:44:46.594546 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba58a8-6f17-4c9e-bc45-d1bb7ce072a0 service placement] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:44:46.596331 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-b4ba58a8-6f17-4c9e-bc45-d1bb7ce072a0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:44:46.611711 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba58a8-6f17-4c9e-bc45-d1bb7ce072a0 service placement] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:44:46.617156 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef945bb2-4271-4b79-be80-cb8ffc6bbe03 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:44:46.618177 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef945bb2-4271-4b79-be80-cb8ffc6bbe03 service placement] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:44:46.618430 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef945bb2-4271-4b79-be80-cb8ffc6bbe03 service placement] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:44:46.618690 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef945bb2-4271-4b79-be80-cb8ffc6bbe03 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:44:46.620521 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-ef945bb2-4271-4b79-be80-cb8ffc6bbe03 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:44:46.632239 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef945bb2-4271-4b79-be80-cb8ffc6bbe03 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:44:46.633803 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef945bb2-4271-4b79-be80-cb8ffc6bbe03 service placement] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:44:46.644138 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1364/2696] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:44:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:44:50.090483 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=40 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:44:53.983789 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a3455-91be-4a6d-8a5e-816d922ade25 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:44:53.984395 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a3455-91be-4a6d-8a5e-816d922ade25 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:44:53.984395 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a3455-91be-4a6d-8a5e-816d922ade25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:44:54.004634 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-e57a3455-91be-4a6d-8a5e-816d922ade25 None None] MFA Rules not processed for user `8cb7a9b9caaf495793cbdf1ddccd4787`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:44:54.005703 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-e57a3455-91be-4a6d-8a5e-816d922ade25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:44:54.016763 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1333/2697] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:44:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:44:54.326535 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef945bb2-4271-4b79-be80-cb8ffc6bbe03 service placement] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:44:54.328425 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-ef945bb2-4271-4b79-be80-cb8ffc6bbe03 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:44:54.370523 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef945bb2-4271-4b79-be80-cb8ffc6bbe03 service placement] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:44:54.376329 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429caa7-dee8-44ed-a6ac-b260b04bb14f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:44:54.377102 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429caa7-dee8-44ed-a6ac-b260b04bb14f service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:44:54.377375 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429caa7-dee8-44ed-a6ac-b260b04bb14f service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:44:54.377640 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429caa7-dee8-44ed-a6ac-b260b04bb14f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:44:54.380111 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-f429caa7-dee8-44ed-a6ac-b260b04bb14f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:44:54.390804 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429caa7-dee8-44ed-a6ac-b260b04bb14f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:44:54.392271 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429caa7-dee8-44ed-a6ac-b260b04bb14f service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:44:54.401646 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1365/2698] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:44:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:45:03.999286 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=3 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:45:04.397182 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=27 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:45:39.848553 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a3455-91be-4a6d-8a5e-816d922ade25 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:45:39.859154 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a3455-91be-4a6d-8a5e-816d922ade25 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:45:39.863455 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540aae0-b0fd-49b4-b77a-448cbc9b3120 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:45:39.864112 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540aae0-b0fd-49b4-b77a-448cbc9b3120 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:45:39.864388 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540aae0-b0fd-49b4-b77a-448cbc9b3120 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:45:39.864652 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540aae0-b0fd-49b4-b77a-448cbc9b3120 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:45:39.866575 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-0540aae0-b0fd-49b4-b77a-448cbc9b3120 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:45:39.877663 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0540aae0-b0fd-49b4-b77a-448cbc9b3120 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:45:39.879381 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0540aae0-b0fd-49b4-b77a-448cbc9b3120 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:45:39.887975 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1334/2699] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:45:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:45:39.986344 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996151a1-194a-457e-b0ef-b303da2910bc None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:45:39.986831 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996151a1-194a-457e-b0ef-b303da2910bc None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:45:39.986932 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996151a1-194a-457e-b0ef-b303da2910bc None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:45:39.988266 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1366/2700] 10.222.0.60 () {54 vars in 921 bytes} [Sun Jul 31 01:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:45:39.993574 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712f5f6-b737-4ee4-9a29-1ae3b1b04149 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:45:39.993977 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712f5f6-b737-4ee4-9a29-1ae3b1b04149 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:45:39.994334 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712f5f6-b737-4ee4-9a29-1ae3b1b04149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:45:40.015673 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-2712f5f6-b737-4ee4-9a29-1ae3b1b04149 None None] MFA Rules not processed for user `657a3f73879e4b31b70a1c4f73e80f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:45:40.016867 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-2712f5f6-b737-4ee4-9a29-1ae3b1b04149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:45:40.025307 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1335/2701] 10.222.0.60 () {58 vars in 1018 bytes} [Sun Jul 31 01:45:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:45:40.045845 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996151a1-194a-457e-b0ef-b303da2910bc None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:45:40.060255 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996151a1-194a-457e-b0ef-b303da2910bc None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:45:40.065993 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92f206-b5c7-4e5d-acf2-7ff0cb297d8c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:45:40.066592 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92f206-b5c7-4e5d-acf2-7ff0cb297d8c service placement] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:45:40.066864 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92f206-b5c7-4e5d-acf2-7ff0cb297d8c service placement] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:45:40.067129 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92f206-b5c7-4e5d-acf2-7ff0cb297d8c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:45:40.075687 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92f206-b5c7-4e5d-acf2-7ff0cb297d8c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:45:40.077250 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92f206-b5c7-4e5d-acf2-7ff0cb297d8c service placement] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:45:40.086911 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1367/2702] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:45:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:45:40.273181 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2712f5f6-b737-4ee4-9a29-1ae3b1b04149 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:45:40.284126 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2712f5f6-b737-4ee4-9a29-1ae3b1b04149 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:45:40.288595 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1956a2-914a-448b-9b92-0b8b5c018029 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:45:40.289210 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1956a2-914a-448b-9b92-0b8b5c018029 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:45:40.289485 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1956a2-914a-448b-9b92-0b8b5c018029 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:45:40.289749 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1956a2-914a-448b-9b92-0b8b5c018029 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:45:40.291746 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-0e1956a2-914a-448b-9b92-0b8b5c018029 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:45:40.328797 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1956a2-914a-448b-9b92-0b8b5c018029 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:45:40.330241 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1956a2-914a-448b-9b92-0b8b5c018029 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:45:40.350747 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1336/2703] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:45:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:45:50.085073 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=6 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:45:50.348156 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=27 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:46:03.026271 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92f206-b5c7-4e5d-acf2-7ff0cb297d8c service placement] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:46:03.029265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-cb92f206-b5c7-4e5d-acf2-7ff0cb297d8c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:46:03.047249 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92f206-b5c7-4e5d-acf2-7ff0cb297d8c service placement] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:46:03.052981 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c89e4d-8617-420d-8582-46b7a32c3b79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:46:03.053618 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c89e4d-8617-420d-8582-46b7a32c3b79 service nova] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:46:03.053916 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c89e4d-8617-420d-8582-46b7a32c3b79 service nova] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:46:03.054181 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c89e4d-8617-420d-8582-46b7a32c3b79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:46:03.056118 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-e4c89e4d-8617-420d-8582-46b7a32c3b79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:46:03.072133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c89e4d-8617-420d-8582-46b7a32c3b79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:46:03.072133 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c89e4d-8617-420d-8582-46b7a32c3b79 service nova] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:46:03.081701 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1368/2704] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:46:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:46:13.081800 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=6 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:46:14.364282 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de7bfd-e665-4333-b0e6-3d3edff64299 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:46:14.364901 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de7bfd-e665-4333-b0e6-3d3edff64299 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:46:14.364901 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de7bfd-e665-4333-b0e6-3d3edff64299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:46:14.384528 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-f7de7bfd-e665-4333-b0e6-3d3edff64299 None None] MFA Rules not processed for user `8cb7a9b9caaf495793cbdf1ddccd4787`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:46:14.385784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-f7de7bfd-e665-4333-b0e6-3d3edff64299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:46:14.393934 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1337/2705] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:46:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:46:24.379041 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=3 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:46:53.975838 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c89e4d-8617-420d-8582-46b7a32c3b79 service nova] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:46:53.986310 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c89e4d-8617-420d-8582-46b7a32c3b79 service nova] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:46:53.990744 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1fb1e6-3b5f-4d0b-b99a-4084ea3ba2ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:46:53.991351 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fb1e6-3b5f-4d0b-b99a-4084ea3ba2ab service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:46:53.992033 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fb1e6-3b5f-4d0b-b99a-4084ea3ba2ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:46:53.992298 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fb1e6-3b5f-4d0b-b99a-4084ea3ba2ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:46:53.994471 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-ee1fb1e6-3b5f-4d0b-b99a-4084ea3ba2ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:46:54.004730 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1fb1e6-3b5f-4d0b-b99a-4084ea3ba2ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:46:54.006187 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1fb1e6-3b5f-4d0b-b99a-4084ea3ba2ab service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:46:54.014076 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1369/2706] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:46:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:47:01.139740 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de7bfd-e665-4333-b0e6-3d3edff64299 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:47:01.149868 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de7bfd-e665-4333-b0e6-3d3edff64299 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:47:01.154102 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb199a0-e859-4747-b3ac-10e3b954fdf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:47:01.154718 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb199a0-e859-4747-b3ac-10e3b954fdf1 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:47:01.155002 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb199a0-e859-4747-b3ac-10e3b954fdf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:47:01.155275 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb199a0-e859-4747-b3ac-10e3b954fdf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:47:01.157232 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-edb199a0-e859-4747-b3ac-10e3b954fdf1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:47:01.172101 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb199a0-e859-4747-b3ac-10e3b954fdf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:47:01.173528 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb199a0-e859-4747-b3ac-10e3b954fdf1 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:47:01.185004 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1338/2707] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:47:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:47:01.378721 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1fb1e6-3b5f-4d0b-b99a-4084ea3ba2ab service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:47:01.380203 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-ee1fb1e6-3b5f-4d0b-b99a-4084ea3ba2ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:47:01.458955 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1fb1e6-3b5f-4d0b-b99a-4084ea3ba2ab service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:47:01.463096 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f703b2c-f5d3-4cf0-ae55-f54fe5590c71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1943ab629b6411d81327a845b77c8c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:47:01.463771 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f703b2c-f5d3-4cf0-ae55-f54fe5590c71 service cinder] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:47:01.464047 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f703b2c-f5d3-4cf0-ae55-f54fe5590c71 service cinder] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:47:01.464312 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f703b2c-f5d3-4cf0-ae55-f54fe5590c71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:47:01.466151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-0f703b2c-f5d3-4cf0-ae55-f54fe5590c71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:47:01.479981 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f703b2c-f5d3-4cf0-ae55-f54fe5590c71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:47:01.481430 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f703b2c-f5d3-4cf0-ae55-f54fe5590c71 service cinder] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:47:01.493059 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1370/2708] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:47:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:47:11.180021 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=6 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:47:11.487674 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=41 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:47:13.879906 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa83ae-ad69-4a8b-82d8-2d841b4c2066 None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:47:13.880487 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa83ae-ad69-4a8b-82d8-2d841b4c2066 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:47:13.880487 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa83ae-ad69-4a8b-82d8-2d841b4c2066 None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:47:13.881985 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1339/2709] 10.222.0.60 () {54 vars in 921 bytes} [Sun Jul 31 01:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:47:13.887013 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e86e4f-2f33-4aef-9dc8-9e16a364598c None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:47:13.887458 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e86e4f-2f33-4aef-9dc8-9e16a364598c None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:47:13.887586 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e86e4f-2f33-4aef-9dc8-9e16a364598c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:47:13.908489 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-b9e86e4f-2f33-4aef-9dc8-9e16a364598c None None] MFA Rules not processed for user `657a3f73879e4b31b70a1c4f73e80f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:47:13.909688 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-b9e86e4f-2f33-4aef-9dc8-9e16a364598c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:47:13.919584 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1371/2710] 10.222.0.60 () {58 vars in 1018 bytes} [Sun Jul 31 01:47:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:47:13.940270 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa83ae-ad69-4a8b-82d8-2d841b4c2066 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:47:13.954231 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa83ae-ad69-4a8b-82d8-2d841b4c2066 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:47:13.959566 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400f2af-d28c-452e-9341-9ef3a39e5ac9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:47:13.960171 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400f2af-d28c-452e-9341-9ef3a39e5ac9 service placement] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:47:13.960444 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400f2af-d28c-452e-9341-9ef3a39e5ac9 service placement] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:47:13.960712 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400f2af-d28c-452e-9341-9ef3a39e5ac9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:47:13.969164 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5400f2af-d28c-452e-9341-9ef3a39e5ac9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:47:13.970720 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5400f2af-d28c-452e-9341-9ef3a39e5ac9 service placement] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:47:13.980273 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1340/2711] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:47:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:47:23.903005 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:47:23.976335 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=6 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:47:27.642586 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e86e4f-2f33-4aef-9dc8-9e16a364598c None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:47:27.660224 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e86e4f-2f33-4aef-9dc8-9e16a364598c None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:47:27.667096 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8643b465-b6d7-44c5-a67b-45c79dd62555 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1943ab629b6411d81327a845b77c8c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:47:27.667741 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643b465-b6d7-44c5-a67b-45c79dd62555 service cinder] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:47:27.668016 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643b465-b6d7-44c5-a67b-45c79dd62555 service cinder] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:47:27.668284 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643b465-b6d7-44c5-a67b-45c79dd62555 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:47:27.678287 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8643b465-b6d7-44c5-a67b-45c79dd62555 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:47:27.679906 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8643b465-b6d7-44c5-a67b-45c79dd62555 service cinder] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:47:27.689863 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1372/2712] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:47:27 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:47:37.685077 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=6 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:48:06.028287 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400f2af-d28c-452e-9341-9ef3a39e5ac9 service placement] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:48:06.043015 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400f2af-d28c-452e-9341-9ef3a39e5ac9 service placement] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:48:06.049845 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5d388-0b44-4bb4-bfb3-b5bb2784ed92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:48:06.055788 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5d388-0b44-4bb4-bfb3-b5bb2784ed92 service nova] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:48:06.056112 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5d388-0b44-4bb4-bfb3-b5bb2784ed92 service nova] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:48:06.056393 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5d388-0b44-4bb4-bfb3-b5bb2784ed92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:48:06.058448 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-18e5d388-0b44-4bb4-bfb3-b5bb2784ed92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:48:06.074243 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e5d388-0b44-4bb4-bfb3-b5bb2784ed92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:48:06.075888 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e5d388-0b44-4bb4-bfb3-b5bb2784ed92 service nova] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:48:06.092355 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1341/2713] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:48:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:48:16.087672 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=6 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:48:16.935252 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8643b465-b6d7-44c5-a67b-45c79dd62555 service cinder] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:48:16.949109 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8643b465-b6d7-44c5-a67b-45c79dd62555 service cinder] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:48:16.954795 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23464c-3798-448d-9ed3-714f734e993d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:48:16.955397 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23464c-3798-448d-9ed3-714f734e993d service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:48:16.955709 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23464c-3798-448d-9ed3-714f734e993d service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:48:16.955970 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23464c-3798-448d-9ed3-714f734e993d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:48:16.970152 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23464c-3798-448d-9ed3-714f734e993d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:48:16.971663 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23464c-3798-448d-9ed3-714f734e993d service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:48:16.982992 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1373/2714] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:48:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:48:20.147020 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5d388-0b44-4bb4-bfb3-b5bb2784ed92 service nova] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:48:20.159851 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5d388-0b44-4bb4-bfb3-b5bb2784ed92 service nova] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:48:20.165455 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92467017-b003-4b6e-b4aa-2bbe514d3cb0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:48:20.166188 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92467017-b003-4b6e-b4aa-2bbe514d3cb0 service placement] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:48:20.166536 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92467017-b003-4b6e-b4aa-2bbe514d3cb0 service placement] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:48:20.167115 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92467017-b003-4b6e-b4aa-2bbe514d3cb0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:48:20.169203 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-92467017-b003-4b6e-b4aa-2bbe514d3cb0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:48:20.185793 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92467017-b003-4b6e-b4aa-2bbe514d3cb0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:48:20.187916 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92467017-b003-4b6e-b4aa-2bbe514d3cb0 service placement] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:48:20.201247 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1342/2715] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:48:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:48:20.224633 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23464c-3798-448d-9ed3-714f734e993d service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:48:20.235666 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23464c-3798-448d-9ed3-714f734e993d service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:48:20.240688 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3700294-9b48-4a39-a779-53fb767755df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:48:20.241810 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3700294-9b48-4a39-a779-53fb767755df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:48:20.241963 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3700294-9b48-4a39-a779-53fb767755df admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:48:20.242412 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3700294-9b48-4a39-a779-53fb767755df admin admin] PATH_INFO: `/v3/users/8cb7a9b9caaf495793cbdf1ddccd4787` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:48:20.243647 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3700294-9b48-4a39-a779-53fb767755df admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cb7a9b9caaf495793cbdf1ddccd4787)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:48:20.245553 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3700294-9b48-4a39-a779-53fb767755df admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:48:20.294503 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-e3700294-9b48-4a39-a779-53fb767755df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cb7a9b9caaf495793cbdf1ddccd4787'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:48:20.301108 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-e3700294-9b48-4a39-a779-53fb767755df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cb7a9b9caaf495793cbdf1ddccd4787'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:48:20.301750 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-e3700294-9b48-4a39-a779-53fb767755df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cb7a9b9caaf495793cbdf1ddccd4787'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:48:20.314139 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-e3700294-9b48-4a39-a779-53fb767755df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cb7a9b9caaf495793cbdf1ddccd4787'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:48:20.314799 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-e3700294-9b48-4a39-a779-53fb767755df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cb7a9b9caaf495793cbdf1ddccd4787'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:48:20.328428 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1374/2716] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:48:20 2022] DELETE /identity/v3/users/8cb7a9b9caaf495793cbdf1ddccd4787 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:48:20.512155 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92467017-b003-4b6e-b4aa-2bbe514d3cb0 service placement] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:48:20.525978 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92467017-b003-4b6e-b4aa-2bbe514d3cb0 service placement] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:48:20.582685 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce568e-b97c-4ee2-ba65-966066ae1697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:48:20.583249 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce568e-b97c-4ee2-ba65-966066ae1697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:48:20.583561 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce568e-b97c-4ee2-ba65-966066ae1697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:48:20.583838 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce568e-b97c-4ee2-ba65-966066ae1697 admin admin] PATH_INFO: `/v3/projects/0b06992da1e6409990af5f339a480865` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:48:20.585445 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce568e-b97c-4ee2-ba65-966066ae1697 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b06992da1e6409990af5f339a480865)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:48:20.587701 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce568e-b97c-4ee2-ba65-966066ae1697 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:48:20.638149 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-25ce568e-b97c-4ee2-ba65-966066ae1697 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b06992da1e6409990af5f339a480865', 'request_id': 'req-25ce568e-b97c-4ee2-ba65-966066ae1697'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:48:20.643553 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-25ce568e-b97c-4ee2-ba65-966066ae1697 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b06992da1e6409990af5f339a480865', 'request_id': 'req-25ce568e-b97c-4ee2-ba65-966066ae1697'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:48:20.650000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-25ce568e-b97c-4ee2-ba65-966066ae1697 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b06992da1e6409990af5f339a480865', 'request_id': 'req-25ce568e-b97c-4ee2-ba65-966066ae1697'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:48:20.663006 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-25ce568e-b97c-4ee2-ba65-966066ae1697 admin admin] The token cache is being invalidate because project 0b06992da1e6409990af5f339a480865 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:48:20.663293 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-25ce568e-b97c-4ee2-ba65-966066ae1697 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:48:20.663935 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-25ce568e-b97c-4ee2-ba65-966066ae1697 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:48:20.665445 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1343/2717] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:48:20 2022] DELETE /identity/v3/projects/0b06992da1e6409990af5f339a480865 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:48:20.670935 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d35ef-4b4b-4ac6-9245-19bc44f7659a None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:48:20.671216 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d35ef-4b4b-4ac6-9245-19bc44f7659a None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:48:20.671498 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d35ef-4b4b-4ac6-9245-19bc44f7659a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:48:20.691445 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-c76d35ef-4b4b-4ac6-9245-19bc44f7659a None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:48:20.692672 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-c76d35ef-4b4b-4ac6-9245-19bc44f7659a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:48:20.763285 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1375/2718] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:48:20.772606 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5354e-7656-4919-aeb3-ad24282a0bb6 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:48:20.772889 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5354e-7656-4919-aeb3-ad24282a0bb6 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:48:20.773155 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5354e-7656-4919-aeb3-ad24282a0bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:48:20.793906 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-fca5354e-7656-4919-aeb3-ad24282a0bb6 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:48:20.795233 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-fca5354e-7656-4919-aeb3-ad24282a0bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:48:20.804122 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1344/2719] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:48:20.808598 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d35ef-4b4b-4ac6-9245-19bc44f7659a None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:48:20.819201 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d35ef-4b4b-4ac6-9245-19bc44f7659a None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:48:20.824764 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf20cae-b5cc-4c2c-a4c1-025bc5f1f0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:48:20.825407 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf20cae-b5cc-4c2c-a4c1-025bc5f1f0ed admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:48:20.825686 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf20cae-b5cc-4c2c-a4c1-025bc5f1f0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:48:20.825953 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf20cae-b5cc-4c2c-a4c1-025bc5f1f0ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:48:20.826769 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf20cae-b5cc-4c2c-a4c1-025bc5f1f0ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:48:20.827070 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf20cae-b5cc-4c2c-a4c1-025bc5f1f0ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:48:20.828715 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf20cae-b5cc-4c2c-a4c1-025bc5f1f0ed admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:48:20.840833 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1376/2720] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:48:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:48:20.845277 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca5354e-7656-4919-aeb3-ad24282a0bb6 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:48:20.855010 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca5354e-7656-4919-aeb3-ad24282a0bb6 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:48:20.860574 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b1bb1-4145-4215-be71-7d513521cd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:48:20.861191 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b1bb1-4145-4215-be71-7d513521cd4b admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:48:20.861469 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b1bb1-4145-4215-be71-7d513521cd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:48:20.861742 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b1bb1-4145-4215-be71-7d513521cd4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:48:20.862437 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b1bb1-4145-4215-be71-7d513521cd4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:48:20.864408 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b1bb1-4145-4215-be71-7d513521cd4b admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:48:20.893832 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1345/2721] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:48:20 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:48:20.898154 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf20cae-b5cc-4c2c-a4c1-025bc5f1f0ed admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:48:20.908563 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf20cae-b5cc-4c2c-a4c1-025bc5f1f0ed admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:48:20.952882 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:48:20.967828 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e52f2-1984-4909-94e2-56be4eda6b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:48:20.968440 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e52f2-1984-4909-94e2-56be4eda6b90 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:48:20.968717 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e52f2-1984-4909-94e2-56be4eda6b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:48:20.968992 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e52f2-1984-4909-94e2-56be4eda6b90 admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:48:20.969654 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e52f2-1984-4909-94e2-56be4eda6b90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:48:20.971592 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e52f2-1984-4909-94e2-56be4eda6b90 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:48:20.994101 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1377/2722] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:48:20 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:48:20.998346 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b1bb1-4145-4215-be71-7d513521cd4b admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:48:21.008646 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b1bb1-4145-4215-be71-7d513521cd4b admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:48:21.013589 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a13ac03-c194-408a-b0c8-47a07d3400d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:48:21.014199 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13ac03-c194-408a-b0c8-47a07d3400d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:48:21.014469 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13ac03-c194-408a-b0c8-47a07d3400d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:48:21.014726 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13ac03-c194-408a-b0c8-47a07d3400d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:48:21.015424 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a13ac03-c194-408a-b0c8-47a07d3400d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:48:21.017038 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a13ac03-c194-408a-b0c8-47a07d3400d7 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:48:21.026743 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1346/2723] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:48:21.030964 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e52f2-1984-4909-94e2-56be4eda6b90 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:48:21.041300 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e52f2-1984-4909-94e2-56be4eda6b90 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:48:21.047638 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c6dc7b-e7a2-447b-803a-4f6ac9e08da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:48:21.048252 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6dc7b-e7a2-447b-803a-4f6ac9e08da0 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:48:21.048532 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6dc7b-e7a2-447b-803a-4f6ac9e08da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:48:21.048801 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6dc7b-e7a2-447b-803a-4f6ac9e08da0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:48:21.049492 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c6dc7b-e7a2-447b-803a-4f6ac9e08da0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:48:21.051088 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c6dc7b-e7a2-447b-803a-4f6ac9e08da0 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:48:21.062026 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1378/2724] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:48:21.066242 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a13ac03-c194-408a-b0c8-47a07d3400d7 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:48:21.076687 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a13ac03-c194-408a-b0c8-47a07d3400d7 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:48:21.082178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250df520-32be-4fba-bf3f-d512e965c8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:48:21.082838 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250df520-32be-4fba-bf3f-d512e965c8bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:48:21.083109 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250df520-32be-4fba-bf3f-d512e965c8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:48:21.083374 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250df520-32be-4fba-bf3f-d512e965c8bc admin admin] PATH_INFO: `/v3/projects/36303f82985a40e3a408199f8af10cc5/users/eaf6c4dba95944d99def77c319c82cc8/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:48:21.102700 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250df520-32be-4fba-bf3f-d512e965c8bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=36303f82985a40e3a408199f8af10cc5, user_id=eaf6c4dba95944d99def77c319c82cc8, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:48:21.105573 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250df520-32be-4fba-bf3f-d512e965c8bc admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:48:21.125260 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1347/2725] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:48:21 2022] PUT /identity/v3/projects/36303f82985a40e3a408199f8af10cc5/users/eaf6c4dba95944d99def77c319c82cc8/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:48:21.131443 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9c335-2136-4785-bed7-8b016e6644a6 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:48:21.131775 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9c335-2136-4785-bed7-8b016e6644a6 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:48:21.132151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9c335-2136-4785-bed7-8b016e6644a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:48:21.154631 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-e0b9c335-2136-4785-bed7-8b016e6644a6 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:48:21.155841 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-e0b9c335-2136-4785-bed7-8b016e6644a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:48:21.217985 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1379/2726] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:48:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:48:21.231433 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250df520-32be-4fba-bf3f-d512e965c8bc admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:48:21.233930 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-250df520-32be-4fba-bf3f-d512e965c8bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:48:21.251076 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:48:21.298013 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250df520-32be-4fba-bf3f-d512e965c8bc admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:48:21.302160 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d40d7f-3b44-444c-83bf-770e0a64a4ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:48:21.302779 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d40d7f-3b44-444c-83bf-770e0a64a4ad service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:48:21.303052 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d40d7f-3b44-444c-83bf-770e0a64a4ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:48:21.303317 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d40d7f-3b44-444c-83bf-770e0a64a4ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:48:21.318308 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d40d7f-3b44-444c-83bf-770e0a64a4ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:48:21.320484 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d40d7f-3b44-444c-83bf-770e0a64a4ad service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:48:21.332579 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1348/2727] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:48:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:48:25.387851 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e0a10-1eb5-4602-8039-aa66c12a5c8b None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:48:25.388389 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e0a10-1eb5-4602-8039-aa66c12a5c8b None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:48:25.388389 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e0a10-1eb5-4602-8039-aa66c12a5c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:48:25.416908 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-306e0a10-1eb5-4602-8039-aa66c12a5c8b None None] MFA Rules not processed for user `eaf6c4dba95944d99def77c319c82cc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:48:25.418128 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-306e0a10-1eb5-4602-8039-aa66c12a5c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:48:25.485861 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1380/2728] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:48:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:48:25.497292 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d683ef-d88c-4bff-91aa-28c8e3252b7d None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:48:25.497862 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d683ef-d88c-4bff-91aa-28c8e3252b7d None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:48:25.497965 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d683ef-d88c-4bff-91aa-28c8e3252b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:48:25.517651 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-60d683ef-d88c-4bff-91aa-28c8e3252b7d None None] MFA Rules not processed for user `eaf6c4dba95944d99def77c319c82cc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:48:25.518877 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-60d683ef-d88c-4bff-91aa-28c8e3252b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:48:25.525800 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1349/2729] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:48:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:48:25.539137 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e0a10-1eb5-4602-8039-aa66c12a5c8b None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:48:25.540988 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-306e0a10-1eb5-4602-8039-aa66c12a5c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:48:25.605229 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:48:25.627979 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e0a10-1eb5-4602-8039-aa66c12a5c8b None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:48:25.634119 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b16e36-ba98-4c62-b09a-cb6b3c9c5631 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:48:25.634765 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b16e36-ba98-4c62-b09a-cb6b3c9c5631 service nova] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:48:25.635045 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b16e36-ba98-4c62-b09a-cb6b3c9c5631 service nova] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:48:25.635317 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b16e36-ba98-4c62-b09a-cb6b3c9c5631 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:48:25.644100 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b16e36-ba98-4c62-b09a-cb6b3c9c5631 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:48:25.645716 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b16e36-ba98-4c62-b09a-cb6b3c9c5631 service nova] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:48:25.655328 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1381/2730] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:48:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:48:25.928961 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d683ef-d88c-4bff-91aa-28c8e3252b7d None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:48:25.931924 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-60d683ef-d88c-4bff-91aa-28c8e3252b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:48:25.948291 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d683ef-d88c-4bff-91aa-28c8e3252b7d None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:48:25.954354 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c649d-360e-4e7e-90df-e6407c0284eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:48:25.955039 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c649d-360e-4e7e-90df-e6407c0284eb service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:48:25.955253 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c649d-360e-4e7e-90df-e6407c0284eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:48:25.955517 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c649d-360e-4e7e-90df-e6407c0284eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:48:25.957635 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-390c649d-360e-4e7e-90df-e6407c0284eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:48:25.968519 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c649d-360e-4e7e-90df-e6407c0284eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:48:25.969956 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c649d-360e-4e7e-90df-e6407c0284eb service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:48:25.978242 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1350/2731] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:48:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:48:35.650992 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=9 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:48:35.974573 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=29 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:48:40.105237 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1992ff5-fd90-4ae3-9d91-dadf425645f0 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:48:40.105757 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1992ff5-fd90-4ae3-9d91-dadf425645f0 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:48:40.105757 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1992ff5-fd90-4ae3-9d91-dadf425645f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:48:40.125541 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-b1992ff5-fd90-4ae3-9d91-dadf425645f0 None None] MFA Rules not processed for user `eaf6c4dba95944d99def77c319c82cc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:48:40.126728 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-b1992ff5-fd90-4ae3-9d91-dadf425645f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:48:40.134497 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1382/2732] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:48:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:48:50.120221 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:49:02.420138 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c649d-360e-4e7e-90df-e6407c0284eb service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:49:02.421374 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-390c649d-360e-4e7e-90df-e6407c0284eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:49:02.488536 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1992ff5-fd90-4ae3-9d91-dadf425645f0 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:49:02.505099 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c649d-360e-4e7e-90df-e6407c0284eb service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:49:02.510428 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65daff9f-87b2-4956-ade0-144272668f6a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:49:02.511055 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65daff9f-87b2-4956-ade0-144272668f6a service placement] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:02.511448 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65daff9f-87b2-4956-ade0-144272668f6a service placement] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:02.511754 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65daff9f-87b2-4956-ade0-144272668f6a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:02.513529 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-65daff9f-87b2-4956-ade0-144272668f6a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:49:02.526049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65daff9f-87b2-4956-ade0-144272668f6a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:49:02.526281 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1992ff5-fd90-4ae3-9d91-dadf425645f0 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:49:02.527738 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65daff9f-87b2-4956-ade0-144272668f6a service placement] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:49:02.531663 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f33f1e-cd6e-4ef0-b716-f1120b928c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:49:02.532437 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f33f1e-cd6e-4ef0-b716-f1120b928c3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:02.532719 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f33f1e-cd6e-4ef0-b716-f1120b928c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:02.533109 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f33f1e-cd6e-4ef0-b716-f1120b928c3b admin admin] PATH_INFO: `/v3/users/eaf6c4dba95944d99def77c319c82cc8` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:02.534346 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f33f1e-cd6e-4ef0-b716-f1120b928c3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaf6c4dba95944d99def77c319c82cc8)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:49:02.536284 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f33f1e-cd6e-4ef0-b716-f1120b928c3b admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:49:02.538708 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1351/2733] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:49:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:49:02.593777 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-a6f33f1e-cd6e-4ef0-b716-f1120b928c3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaf6c4dba95944d99def77c319c82cc8'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:49:02.600580 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-a6f33f1e-cd6e-4ef0-b716-f1120b928c3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaf6c4dba95944d99def77c319c82cc8'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:49:02.601174 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-a6f33f1e-cd6e-4ef0-b716-f1120b928c3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaf6c4dba95944d99def77c319c82cc8'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:49:02.613184 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-a6f33f1e-cd6e-4ef0-b716-f1120b928c3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaf6c4dba95944d99def77c319c82cc8'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:49:02.613860 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-a6f33f1e-cd6e-4ef0-b716-f1120b928c3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaf6c4dba95944d99def77c319c82cc8'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:49:02.628440 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1383/2734] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:49:02 2022] DELETE /identity/v3/users/eaf6c4dba95944d99def77c319c82cc8 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:49:02.808379 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65daff9f-87b2-4956-ade0-144272668f6a service placement] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:49:02.819832 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65daff9f-87b2-4956-ade0-144272668f6a service placement] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:49:02.879200 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e849fab-33f6-4c93-a35f-ba3a7785d3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:49:02.879945 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e849fab-33f6-4c93-a35f-ba3a7785d3c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:02.880224 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e849fab-33f6-4c93-a35f-ba3a7785d3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:02.880498 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e849fab-33f6-4c93-a35f-ba3a7785d3c7 admin admin] PATH_INFO: `/v3/projects/36303f82985a40e3a408199f8af10cc5` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:02.881653 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e849fab-33f6-4c93-a35f-ba3a7785d3c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36303f82985a40e3a408199f8af10cc5)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:49:02.883599 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e849fab-33f6-4c93-a35f-ba3a7785d3c7 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:49:02.930609 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-6e849fab-33f6-4c93-a35f-ba3a7785d3c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36303f82985a40e3a408199f8af10cc5', 'request_id': 'req-6e849fab-33f6-4c93-a35f-ba3a7785d3c7'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:49:02.935933 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-6e849fab-33f6-4c93-a35f-ba3a7785d3c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36303f82985a40e3a408199f8af10cc5', 'request_id': 'req-6e849fab-33f6-4c93-a35f-ba3a7785d3c7'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:49:02.941989 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-6e849fab-33f6-4c93-a35f-ba3a7785d3c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36303f82985a40e3a408199f8af10cc5', 'request_id': 'req-6e849fab-33f6-4c93-a35f-ba3a7785d3c7'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:49:02.954000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-6e849fab-33f6-4c93-a35f-ba3a7785d3c7 admin admin] The token cache is being invalidate because project 36303f82985a40e3a408199f8af10cc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:49:02.954290 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-6e849fab-33f6-4c93-a35f-ba3a7785d3c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:49:02.954901 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-6e849fab-33f6-4c93-a35f-ba3a7785d3c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:49:02.956525 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1352/2735] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:49:02 2022] DELETE /identity/v3/projects/36303f82985a40e3a408199f8af10cc5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:49:02.961565 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc230a6-bdda-4209-87a3-7d15905f25dc None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:02.961852 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc230a6-bdda-4209-87a3-7d15905f25dc None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:02.962124 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc230a6-bdda-4209-87a3-7d15905f25dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:02.981349 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-1cc230a6-bdda-4209-87a3-7d15905f25dc None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:49:02.982504 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-1cc230a6-bdda-4209-87a3-7d15905f25dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:49:03.045909 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1384/2736] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:49:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:49:03.054396 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14325a37-f80c-4fb8-88d3-b7563054602a None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:03.054707 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14325a37-f80c-4fb8-88d3-b7563054602a None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:03.054979 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14325a37-f80c-4fb8-88d3-b7563054602a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:03.075900 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-14325a37-f80c-4fb8-88d3-b7563054602a None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:49:03.077099 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-14325a37-f80c-4fb8-88d3-b7563054602a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:49:03.085732 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1353/2737] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:49:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:49:03.091956 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc230a6-bdda-4209-87a3-7d15905f25dc None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:49:03.104344 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc230a6-bdda-4209-87a3-7d15905f25dc None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:49:03.109719 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f5a81-7bf6-4d0b-9dd5-35808fc7076f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:49:03.110309 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f5a81-7bf6-4d0b-9dd5-35808fc7076f admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:03.110581 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f5a81-7bf6-4d0b-9dd5-35808fc7076f admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:03.110846 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f5a81-7bf6-4d0b-9dd5-35808fc7076f admin admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:03.111579 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439f5a81-7bf6-4d0b-9dd5-35808fc7076f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:49:03.111883 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439f5a81-7bf6-4d0b-9dd5-35808fc7076f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:49:03.113617 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439f5a81-7bf6-4d0b-9dd5-35808fc7076f admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:49:03.125314 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1385/2738] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:49:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:49:03.129815 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14325a37-f80c-4fb8-88d3-b7563054602a None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:49:03.139282 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14325a37-f80c-4fb8-88d3-b7563054602a None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:49:03.145230 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f7017-35de-4d28-973c-aab54c7722e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:49:03.145841 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f7017-35de-4d28-973c-aab54c7722e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:03.146108 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f7017-35de-4d28-973c-aab54c7722e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:03.146371 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f7017-35de-4d28-973c-aab54c7722e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:03.147034 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7f7017-35de-4d28-973c-aab54c7722e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:49:03.148948 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7f7017-35de-4d28-973c-aab54c7722e0 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:49:03.160737 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:49:03.183320 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1354/2739] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:49:03 2022] POST /identity/v3/projects => generated 367 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:49:03.187726 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f5a81-7bf6-4d0b-9dd5-35808fc7076f admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:49:03.198678 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f5a81-7bf6-4d0b-9dd5-35808fc7076f admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:49:03.244536 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:49:03.260996 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d9530-ca60-4401-84d2-871a384d2e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:49:03.261637 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d9530-ca60-4401-84d2-871a384d2e36 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:03.261914 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d9530-ca60-4401-84d2-871a384d2e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:03.262180 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d9530-ca60-4401-84d2-871a384d2e36 admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:03.262828 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788d9530-ca60-4401-84d2-871a384d2e36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:49:03.264907 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788d9530-ca60-4401-84d2-871a384d2e36 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:49:03.287839 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1386/2740] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:49:03 2022] POST /identity/v3/users => generated 284 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:49:03.292232 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f7017-35de-4d28-973c-aab54c7722e0 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:49:03.302990 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f7017-35de-4d28-973c-aab54c7722e0 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:49:03.308240 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2901e-5e53-489a-af4f-e4235605c4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:49:03.308851 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2901e-5e53-489a-af4f-e4235605c4b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:03.309121 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2901e-5e53-489a-af4f-e4235605c4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:03.309388 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2901e-5e53-489a-af4f-e4235605c4b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:03.310079 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a2901e-5e53-489a-af4f-e4235605c4b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:49:03.311686 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a2901e-5e53-489a-af4f-e4235605c4b8 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:49:03.324485 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1355/2741] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:49:03.328712 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d9530-ca60-4401-84d2-871a384d2e36 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:49:03.339345 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d9530-ca60-4401-84d2-871a384d2e36 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:49:03.346233 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1633190-359e-454e-afac-2449adaf2781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:49:03.347020 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1633190-359e-454e-afac-2449adaf2781 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:03.347294 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1633190-359e-454e-afac-2449adaf2781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:03.347587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1633190-359e-454e-afac-2449adaf2781 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:03.348284 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1633190-359e-454e-afac-2449adaf2781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:49:03.349911 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1633190-359e-454e-afac-2449adaf2781 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:49:03.361613 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1387/2742] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:49:03.366513 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2901e-5e53-489a-af4f-e4235605c4b8 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:49:03.377271 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2901e-5e53-489a-af4f-e4235605c4b8 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:49:03.382339 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7d5b7-b98c-44e7-8b8a-6b3773ac6e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:49:03.383008 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7d5b7-b98c-44e7-8b8a-6b3773ac6e6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:03.383286 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7d5b7-b98c-44e7-8b8a-6b3773ac6e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:03.383590 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7d5b7-b98c-44e7-8b8a-6b3773ac6e6d admin admin] PATH_INFO: `/v3/projects/fba24bc37df44631b71363f7acb04ee5/users/d8a6f098f95644219074c66fe6c6a01f/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:03.399250 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e7d5b7-b98c-44e7-8b8a-6b3773ac6e6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fba24bc37df44631b71363f7acb04ee5, user_id=d8a6f098f95644219074c66fe6c6a01f, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:49:03.401956 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e7d5b7-b98c-44e7-8b8a-6b3773ac6e6d admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:49:03.429328 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1356/2743] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:49:03 2022] PUT /identity/v3/projects/fba24bc37df44631b71363f7acb04ee5/users/d8a6f098f95644219074c66fe6c6a01f/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:49:03.441121 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae9f4c-d88b-48a5-b909-edb8c2184fb9 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:03.441367 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae9f4c-d88b-48a5-b909-edb8c2184fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:03.441634 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae9f4c-d88b-48a5-b909-edb8c2184fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:03.471052 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-88ae9f4c-d88b-48a5-b909-edb8c2184fb9 None None] MFA Rules not processed for user `d8a6f098f95644219074c66fe6c6a01f`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:49:03.472367 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-88ae9f4c-d88b-48a5-b909-edb8c2184fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:49:03.538068 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1388/2744] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:49:03 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:49:03.550626 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7d5b7-b98c-44e7-8b8a-6b3773ac6e6d admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:49:03.552693 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-20e7d5b7-b98c-44e7-8b8a-6b3773ac6e6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:49:03.613515 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7d5b7-b98c-44e7-8b8a-6b3773ac6e6d admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:49:03.620956 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bb54c-db19-405f-b92b-74f94c1b0581 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:49:03.621576 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bb54c-db19-405f-b92b-74f94c1b0581 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:03.621871 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bb54c-db19-405f-b92b-74f94c1b0581 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:03.622128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bb54c-db19-405f-b92b-74f94c1b0581 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:03.630944 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378bb54c-db19-405f-b92b-74f94c1b0581 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:49:03.632431 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378bb54c-db19-405f-b92b-74f94c1b0581 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:49:03.641498 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1357/2745] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:49:03 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:49:13.534742 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=46,keystone:INSERT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:49:13.637328 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=49,keystone:INSERT=2 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:49:17.806172 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae9f4c-d88b-48a5-b909-edb8c2184fb9 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:49:17.871184 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae9f4c-d88b-48a5-b909-edb8c2184fb9 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:49:17.876011 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290e6ed-6d61-40b9-9715-f88d8579cf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:49:17.876656 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290e6ed-6d61-40b9-9715-f88d8579cf71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:17.876965 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290e6ed-6d61-40b9-9715-f88d8579cf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:17.877205 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290e6ed-6d61-40b9-9715-f88d8579cf71 admin admin] PATH_INFO: `/v3/users/d8a6f098f95644219074c66fe6c6a01f` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:17.878412 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1290e6ed-6d61-40b9-9715-f88d8579cf71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8a6f098f95644219074c66fe6c6a01f)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:49:17.880350 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1290e6ed-6d61-40b9-9715-f88d8579cf71 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:49:17.926632 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-1290e6ed-6d61-40b9-9715-f88d8579cf71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8a6f098f95644219074c66fe6c6a01f'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:49:17.933431 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-1290e6ed-6d61-40b9-9715-f88d8579cf71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8a6f098f95644219074c66fe6c6a01f'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:49:17.934245 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-1290e6ed-6d61-40b9-9715-f88d8579cf71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8a6f098f95644219074c66fe6c6a01f'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:49:17.946378 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-1290e6ed-6d61-40b9-9715-f88d8579cf71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8a6f098f95644219074c66fe6c6a01f'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:49:17.947129 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-1290e6ed-6d61-40b9-9715-f88d8579cf71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8a6f098f95644219074c66fe6c6a01f'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:49:17.962559 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1389/2746] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:49:17 2022] DELETE /identity/v3/users/d8a6f098f95644219074c66fe6c6a01f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:49:17.967100 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f324030-fa13-4f93-a622-9a1a1ce23dea None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:17.967668 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f324030-fa13-4f93-a622-9a1a1ce23dea None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:17.967668 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f324030-fa13-4f93-a622-9a1a1ce23dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:17.996609 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-2f324030-fa13-4f93-a622-9a1a1ce23dea None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:49:17.998472 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-2f324030-fa13-4f93-a622-9a1a1ce23dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:49:18.060685 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1358/2747] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:49:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:49:18.071175 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290e6ed-6d61-40b9-9715-f88d8579cf71 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:49:18.072859 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-1290e6ed-6d61-40b9-9715-f88d8579cf71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:49:18.131327 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290e6ed-6d61-40b9-9715-f88d8579cf71 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:49:18.135092 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2501adf-2f74-4270-a0ff-666c5037ab75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:49:18.135744 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2501adf-2f74-4270-a0ff-666c5037ab75 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:18.136021 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2501adf-2f74-4270-a0ff-666c5037ab75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:18.136291 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2501adf-2f74-4270-a0ff-666c5037ab75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:18.145566 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2501adf-2f74-4270-a0ff-666c5037ab75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:49:18.147131 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2501adf-2f74-4270-a0ff-666c5037ab75 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:49:18.156806 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1390/2748] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:49:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:49:18.673574 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f324030-fa13-4f93-a622-9a1a1ce23dea None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:49:18.675466 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-2f324030-fa13-4f93-a622-9a1a1ce23dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:49:18.689032 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f324030-fa13-4f93-a622-9a1a1ce23dea None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:49:18.694222 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb199c1-703e-4cda-b6be-a0847e60b4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:49:18.695094 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb199c1-703e-4cda-b6be-a0847e60b4ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:18.695321 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb199c1-703e-4cda-b6be-a0847e60b4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:18.695645 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb199c1-703e-4cda-b6be-a0847e60b4ec admin admin] PATH_INFO: `/v3/projects/fba24bc37df44631b71363f7acb04ee5` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:18.696975 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb199c1-703e-4cda-b6be-a0847e60b4ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=fba24bc37df44631b71363f7acb04ee5)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:49:18.699049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb199c1-703e-4cda-b6be-a0847e60b4ec admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:49:18.748577 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-abb199c1-703e-4cda-b6be-a0847e60b4ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fba24bc37df44631b71363f7acb04ee5', 'request_id': 'req-abb199c1-703e-4cda-b6be-a0847e60b4ec'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:49:18.754117 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-abb199c1-703e-4cda-b6be-a0847e60b4ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fba24bc37df44631b71363f7acb04ee5', 'request_id': 'req-abb199c1-703e-4cda-b6be-a0847e60b4ec'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:49:18.760527 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-abb199c1-703e-4cda-b6be-a0847e60b4ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fba24bc37df44631b71363f7acb04ee5', 'request_id': 'req-abb199c1-703e-4cda-b6be-a0847e60b4ec'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:49:18.774272 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-abb199c1-703e-4cda-b6be-a0847e60b4ec admin admin] The token cache is being invalidate because project fba24bc37df44631b71363f7acb04ee5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:49:18.774569 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-abb199c1-703e-4cda-b6be-a0847e60b4ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:49:18.775179 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-abb199c1-703e-4cda-b6be-a0847e60b4ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:49:18.777433 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1359/2749] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:49:18 2022] DELETE /identity/v3/projects/fba24bc37df44631b71363f7acb04ee5 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:49:18.782649 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c051cc-704e-4416-ab95-60c47c7a1ad5 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:18.783176 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c051cc-704e-4416-ab95-60c47c7a1ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:18.784716 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c051cc-704e-4416-ab95-60c47c7a1ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:18.817522 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:49:18.840110 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-95c051cc-704e-4416-ab95-60c47c7a1ad5 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:49:18.841294 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-95c051cc-704e-4416-ab95-60c47c7a1ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:49:18.902767 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1391/2750] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:49:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:49:18.910577 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da2002-0919-41c8-be0a-1e27d71b516b None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:18.910858 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da2002-0919-41c8-be0a-1e27d71b516b None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:18.911129 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da2002-0919-41c8-be0a-1e27d71b516b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:18.931925 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-f9da2002-0919-41c8-be0a-1e27d71b516b None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:49:18.933428 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-f9da2002-0919-41c8-be0a-1e27d71b516b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:49:18.942342 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1360/2751] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:49:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:49:18.946878 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c051cc-704e-4416-ab95-60c47c7a1ad5 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:49:18.957763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c051cc-704e-4416-ab95-60c47c7a1ad5 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:49:18.963557 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8842ab-927c-41b7-986e-71aa810a0119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:49:18.964164 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8842ab-927c-41b7-986e-71aa810a0119 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:18.964435 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8842ab-927c-41b7-986e-71aa810a0119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:18.964702 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8842ab-927c-41b7-986e-71aa810a0119 admin admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:18.965413 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8842ab-927c-41b7-986e-71aa810a0119 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:49:18.965724 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8842ab-927c-41b7-986e-71aa810a0119 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:49:18.967313 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8842ab-927c-41b7-986e-71aa810a0119 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:49:18.979097 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1392/2752] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:49:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:49:18.983612 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da2002-0919-41c8-be0a-1e27d71b516b None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:49:18.993523 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da2002-0919-41c8-be0a-1e27d71b516b None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:49:18.998507 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20111768-3f54-404d-a832-31c17ffefbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:49:18.999215 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20111768-3f54-404d-a832-31c17ffefbdd admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:18.999593 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20111768-3f54-404d-a832-31c17ffefbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:18.999930 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20111768-3f54-404d-a832-31c17ffefbdd admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:19.000681 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20111768-3f54-404d-a832-31c17ffefbdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:49:19.002747 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20111768-3f54-404d-a832-31c17ffefbdd admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:49:19.034658 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1361/2753] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:49:18 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:49:19.039219 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8842ab-927c-41b7-986e-71aa810a0119 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:49:19.050221 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8842ab-927c-41b7-986e-71aa810a0119 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:49:19.108348 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978eaf5-b57d-4416-81d3-84d32bfd77bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:49:19.108958 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978eaf5-b57d-4416-81d3-84d32bfd77bb admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:19.109234 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978eaf5-b57d-4416-81d3-84d32bfd77bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:19.109504 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978eaf5-b57d-4416-81d3-84d32bfd77bb admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:19.110148 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7978eaf5-b57d-4416-81d3-84d32bfd77bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:49:19.112074 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7978eaf5-b57d-4416-81d3-84d32bfd77bb admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:49:19.135646 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1393/2754] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:49:19 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:49:19.140072 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20111768-3f54-404d-a832-31c17ffefbdd admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:49:19.150563 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20111768-3f54-404d-a832-31c17ffefbdd admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:49:19.156218 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9e061-98c9-4d2f-af98-73d63c2848dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:49:19.156835 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9e061-98c9-4d2f-af98-73d63c2848dd admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:19.157113 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9e061-98c9-4d2f-af98-73d63c2848dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:19.157388 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9e061-98c9-4d2f-af98-73d63c2848dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:19.158091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c9e061-98c9-4d2f-af98-73d63c2848dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:49:19.159821 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c9e061-98c9-4d2f-af98-73d63c2848dd admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:49:19.170644 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1362/2755] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:49:19.175019 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978eaf5-b57d-4416-81d3-84d32bfd77bb admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:49:19.185483 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978eaf5-b57d-4416-81d3-84d32bfd77bb admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:49:19.190230 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc736af-d438-45a3-9b20-0cea2d7b4ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:49:19.190822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc736af-d438-45a3-9b20-0cea2d7b4ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:19.191103 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc736af-d438-45a3-9b20-0cea2d7b4ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:19.191365 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc736af-d438-45a3-9b20-0cea2d7b4ec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:19.192125 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc736af-d438-45a3-9b20-0cea2d7b4ec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:49:19.193714 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc736af-d438-45a3-9b20-0cea2d7b4ec1 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:49:19.204028 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1394/2756] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:49:19.208228 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9e061-98c9-4d2f-af98-73d63c2848dd admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:49:19.218516 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9e061-98c9-4d2f-af98-73d63c2848dd admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:49:19.223323 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16593d31-673e-4f80-bd77-b625c523708f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:49:19.224006 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16593d31-673e-4f80-bd77-b625c523708f admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:19.224259 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16593d31-673e-4f80-bd77-b625c523708f admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:19.224534 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16593d31-673e-4f80-bd77-b625c523708f admin admin] PATH_INFO: `/v3/projects/3fcb613ce08f453096e1a20118df7b77/users/9346497fdd47402fa1d71ca0f734a0f9/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:19.239822 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16593d31-673e-4f80-bd77-b625c523708f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fcb613ce08f453096e1a20118df7b77, user_id=9346497fdd47402fa1d71ca0f734a0f9, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:49:19.242845 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16593d31-673e-4f80-bd77-b625c523708f admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:49:19.259789 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1363/2757] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:49:19 2022] PUT /identity/v3/projects/3fcb613ce08f453096e1a20118df7b77/users/9346497fdd47402fa1d71ca0f734a0f9/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:49:19.270123 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cce811-3b1e-479c-bd25-688ab252e0ca None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:19.270409 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cce811-3b1e-479c-bd25-688ab252e0ca None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:19.270684 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cce811-3b1e-479c-bd25-688ab252e0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:19.298095 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-b2cce811-3b1e-479c-bd25-688ab252e0ca None None] MFA Rules not processed for user `9346497fdd47402fa1d71ca0f734a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:49:19.299296 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-b2cce811-3b1e-479c-bd25-688ab252e0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:49:19.356440 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:49:19.369004 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1395/2758] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:49:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:49:19.379102 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16593d31-673e-4f80-bd77-b625c523708f admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:49:19.381047 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-16593d31-673e-4f80-bd77-b625c523708f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:49:19.396799 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:49:19.449391 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16593d31-673e-4f80-bd77-b625c523708f admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:49:19.456239 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e6204-286c-4870-909d-31ac3688aec3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:49:19.456870 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e6204-286c-4870-909d-31ac3688aec3 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:19.457151 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e6204-286c-4870-909d-31ac3688aec3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:19.457418 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e6204-286c-4870-909d-31ac3688aec3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:19.467167 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e6204-286c-4870-909d-31ac3688aec3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:49:19.468652 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e6204-286c-4870-909d-31ac3688aec3 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:49:19.482536 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1364/2759] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:49:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:49:23.643855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cce811-3b1e-479c-bd25-688ab252e0ca None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:49:23.710355 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cce811-3b1e-479c-bd25-688ab252e0ca None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:49:23.715055 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e0185-5202-4a6f-9087-e757ba239600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:49:23.715731 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e0185-5202-4a6f-9087-e757ba239600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:23.716004 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e0185-5202-4a6f-9087-e757ba239600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:23.716270 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e0185-5202-4a6f-9087-e757ba239600 admin admin] PATH_INFO: `/v3/users/9346497fdd47402fa1d71ca0f734a0f9` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:23.717430 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423e0185-5202-4a6f-9087-e757ba239600 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9346497fdd47402fa1d71ca0f734a0f9)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:49:23.719342 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423e0185-5202-4a6f-9087-e757ba239600 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:49:23.769810 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-423e0185-5202-4a6f-9087-e757ba239600 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9346497fdd47402fa1d71ca0f734a0f9'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:49:23.776581 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-423e0185-5202-4a6f-9087-e757ba239600 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9346497fdd47402fa1d71ca0f734a0f9'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:49:23.777246 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-423e0185-5202-4a6f-9087-e757ba239600 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9346497fdd47402fa1d71ca0f734a0f9'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:49:23.790510 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-423e0185-5202-4a6f-9087-e757ba239600 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9346497fdd47402fa1d71ca0f734a0f9'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:49:23.791214 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-423e0185-5202-4a6f-9087-e757ba239600 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9346497fdd47402fa1d71ca0f734a0f9'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:49:23.805038 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1396/2760] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:49:23 2022] DELETE /identity/v3/users/9346497fdd47402fa1d71ca0f734a0f9 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:49:23.809841 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b3fc2-9f6c-46a9-8427-0e97bb01f8d7 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:23.810399 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b3fc2-9f6c-46a9-8427-0e97bb01f8d7 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:23.810399 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b3fc2-9f6c-46a9-8427-0e97bb01f8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:23.830089 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-5e7b3fc2-9f6c-46a9-8427-0e97bb01f8d7 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:49:23.831375 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-5e7b3fc2-9f6c-46a9-8427-0e97bb01f8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:49:23.895942 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1365/2761] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:49:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:49:23.906392 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e0185-5202-4a6f-9087-e757ba239600 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:49:23.907902 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-423e0185-5202-4a6f-9087-e757ba239600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:49:23.969667 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e0185-5202-4a6f-9087-e757ba239600 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:49:23.973624 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad903097-c376-43ba-a135-713e5f374c17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:49:23.974253 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad903097-c376-43ba-a135-713e5f374c17 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:23.974520 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad903097-c376-43ba-a135-713e5f374c17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:23.974815 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad903097-c376-43ba-a135-713e5f374c17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:23.985065 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad903097-c376-43ba-a135-713e5f374c17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:49:23.986554 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad903097-c376-43ba-a135-713e5f374c17 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:49:23.996815 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1397/2762] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:49:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:49:24.178569 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b3fc2-9f6c-46a9-8427-0e97bb01f8d7 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:49:24.180000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-5e7b3fc2-9f6c-46a9-8427-0e97bb01f8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:49:24.192226 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b3fc2-9f6c-46a9-8427-0e97bb01f8d7 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:49:24.197164 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2835089-d0bb-431f-8d4f-6f1ee2509b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:49:24.197821 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2835089-d0bb-431f-8d4f-6f1ee2509b8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:24.198081 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2835089-d0bb-431f-8d4f-6f1ee2509b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:24.198354 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2835089-d0bb-431f-8d4f-6f1ee2509b8c admin admin] PATH_INFO: `/v3/projects/3fcb613ce08f453096e1a20118df7b77` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:24.199553 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2835089-d0bb-431f-8d4f-6f1ee2509b8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fcb613ce08f453096e1a20118df7b77)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:49:24.201542 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2835089-d0bb-431f-8d4f-6f1ee2509b8c admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:49:24.249868 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-d2835089-d0bb-431f-8d4f-6f1ee2509b8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fcb613ce08f453096e1a20118df7b77', 'request_id': 'req-d2835089-d0bb-431f-8d4f-6f1ee2509b8c'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:49:24.256128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-d2835089-d0bb-431f-8d4f-6f1ee2509b8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fcb613ce08f453096e1a20118df7b77', 'request_id': 'req-d2835089-d0bb-431f-8d4f-6f1ee2509b8c'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:49:24.263064 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-d2835089-d0bb-431f-8d4f-6f1ee2509b8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fcb613ce08f453096e1a20118df7b77', 'request_id': 'req-d2835089-d0bb-431f-8d4f-6f1ee2509b8c'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:49:24.277647 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-d2835089-d0bb-431f-8d4f-6f1ee2509b8c admin admin] The token cache is being invalidate because project 3fcb613ce08f453096e1a20118df7b77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:49:24.277933 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-d2835089-d0bb-431f-8d4f-6f1ee2509b8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:49:24.278581 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-d2835089-d0bb-431f-8d4f-6f1ee2509b8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:49:24.280161 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1366/2763] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:49:24 2022] DELETE /identity/v3/projects/3fcb613ce08f453096e1a20118df7b77 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:49:24.285408 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe188d7-96f3-44db-afa5-2ee2c603468e None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:24.285687 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe188d7-96f3-44db-afa5-2ee2c603468e None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:24.285983 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe188d7-96f3-44db-afa5-2ee2c603468e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:24.306278 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-abe188d7-96f3-44db-afa5-2ee2c603468e None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:49:24.307507 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-abe188d7-96f3-44db-afa5-2ee2c603468e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:49:24.318250 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:49:24.375999 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1398/2764] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:49:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:49:24.385133 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2f67f-bb11-4399-a53f-2457fbc46f36 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:24.385427 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2f67f-bb11-4399-a53f-2457fbc46f36 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:24.385706 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2f67f-bb11-4399-a53f-2457fbc46f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:24.407613 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-5ef2f67f-bb11-4399-a53f-2457fbc46f36 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:49:24.408950 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-5ef2f67f-bb11-4399-a53f-2457fbc46f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:49:24.417729 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1367/2765] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:49:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:49:24.422035 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe188d7-96f3-44db-afa5-2ee2c603468e None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:49:24.432492 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe188d7-96f3-44db-afa5-2ee2c603468e None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:49:24.438366 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e4d35d-9ba0-4a11-a767-6f5cf932d97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:49:24.439027 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e4d35d-9ba0-4a11-a767-6f5cf932d97f admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:24.439298 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e4d35d-9ba0-4a11-a767-6f5cf932d97f admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:24.439583 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e4d35d-9ba0-4a11-a767-6f5cf932d97f admin admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:24.440387 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e4d35d-9ba0-4a11-a767-6f5cf932d97f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:49:24.440614 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e4d35d-9ba0-4a11-a767-6f5cf932d97f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:49:24.442219 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e4d35d-9ba0-4a11-a767-6f5cf932d97f admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:49:24.454964 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1399/2766] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:49:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:49:24.459437 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef2f67f-bb11-4399-a53f-2457fbc46f36 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:49:24.469084 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef2f67f-bb11-4399-a53f-2457fbc46f36 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:49:24.474736 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bec36f-20ce-45e2-98a1-7adf09069ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:49:24.475359 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bec36f-20ce-45e2-98a1-7adf09069ecd admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:24.475850 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bec36f-20ce-45e2-98a1-7adf09069ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:24.475969 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bec36f-20ce-45e2-98a1-7adf09069ecd admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:24.476589 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bec36f-20ce-45e2-98a1-7adf09069ecd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:49:24.478652 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bec36f-20ce-45e2-98a1-7adf09069ecd admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:49:24.511602 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1368/2767] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:49:24 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:49:24.515054 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e4d35d-9ba0-4a11-a767-6f5cf932d97f admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:49:24.525488 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e4d35d-9ba0-4a11-a767-6f5cf932d97f admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:49:24.585229 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f25c09-36d7-48c8-8a5e-87ff1f998362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:49:24.585853 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f25c09-36d7-48c8-8a5e-87ff1f998362 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:24.586124 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f25c09-36d7-48c8-8a5e-87ff1f998362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:24.586394 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f25c09-36d7-48c8-8a5e-87ff1f998362 admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:24.587042 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f25c09-36d7-48c8-8a5e-87ff1f998362 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:49:24.588976 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f25c09-36d7-48c8-8a5e-87ff1f998362 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:49:24.610942 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1400/2768] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:49:24 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:49:24.615747 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bec36f-20ce-45e2-98a1-7adf09069ecd admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:49:24.627629 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bec36f-20ce-45e2-98a1-7adf09069ecd admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:49:24.633534 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0828644-7e80-4360-b58b-df30ee90fca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:49:24.634155 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0828644-7e80-4360-b58b-df30ee90fca5 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:24.634426 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0828644-7e80-4360-b58b-df30ee90fca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:24.634694 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0828644-7e80-4360-b58b-df30ee90fca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:24.635393 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0828644-7e80-4360-b58b-df30ee90fca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:49:24.637034 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0828644-7e80-4360-b58b-df30ee90fca5 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:49:24.643130 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:49:24.648698 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1369/2769] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:49:24.653148 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f25c09-36d7-48c8-8a5e-87ff1f998362 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:49:24.663656 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f25c09-36d7-48c8-8a5e-87ff1f998362 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:49:24.668558 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71474cbf-7b38-4ba1-9941-9dfd055cfa70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:49:24.669165 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71474cbf-7b38-4ba1-9941-9dfd055cfa70 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:24.669443 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71474cbf-7b38-4ba1-9941-9dfd055cfa70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:24.669713 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71474cbf-7b38-4ba1-9941-9dfd055cfa70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:24.670410 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71474cbf-7b38-4ba1-9941-9dfd055cfa70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:49:24.672054 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71474cbf-7b38-4ba1-9941-9dfd055cfa70 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:49:24.682889 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1401/2770] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:49:24.687111 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0828644-7e80-4360-b58b-df30ee90fca5 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:49:24.697132 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0828644-7e80-4360-b58b-df30ee90fca5 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:49:24.701867 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278bc1c-99e6-4ccb-ae63-1470129f8bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:49:24.702528 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278bc1c-99e6-4ccb-ae63-1470129f8bf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:24.702805 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278bc1c-99e6-4ccb-ae63-1470129f8bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:24.703077 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278bc1c-99e6-4ccb-ae63-1470129f8bf0 admin admin] PATH_INFO: `/v3/projects/a7c5c49d9fda4bcdb5707d6416cf2a4d/users/47d73419a8f24716b7d0909a37ff8011/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:24.717499 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278bc1c-99e6-4ccb-ae63-1470129f8bf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7c5c49d9fda4bcdb5707d6416cf2a4d, user_id=47d73419a8f24716b7d0909a37ff8011, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:49:24.720276 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278bc1c-99e6-4ccb-ae63-1470129f8bf0 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:49:24.735258 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1370/2771] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:49:24 2022] PUT /identity/v3/projects/a7c5c49d9fda4bcdb5707d6416cf2a4d/users/47d73419a8f24716b7d0909a37ff8011/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:49:24.741097 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b242dd6-ae02-4149-bd52-7612b656ecb3 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:24.741458 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b242dd6-ae02-4149-bd52-7612b656ecb3 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:24.741821 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b242dd6-ae02-4149-bd52-7612b656ecb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:24.762144 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-1b242dd6-ae02-4149-bd52-7612b656ecb3 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:49:24.763280 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-1b242dd6-ae02-4149-bd52-7612b656ecb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:49:24.824763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1402/2772] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:49:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:49:24.834950 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278bc1c-99e6-4ccb-ae63-1470129f8bf0 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:49:24.837146 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-4278bc1c-99e6-4ccb-ae63-1470129f8bf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:49:24.896066 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278bc1c-99e6-4ccb-ae63-1470129f8bf0 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:49:24.900261 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bea47c-50da-4810-a022-63f8b380050c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:49:24.900875 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bea47c-50da-4810-a022-63f8b380050c service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:24.901146 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bea47c-50da-4810-a022-63f8b380050c service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:24.901414 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bea47c-50da-4810-a022-63f8b380050c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:24.910594 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bea47c-50da-4810-a022-63f8b380050c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:49:24.912054 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bea47c-50da-4810-a022-63f8b380050c service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:49:24.921296 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1371/2773] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:49:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:49:28.942633 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08172b6c-d9a7-4b05-8173-41115112b2e5 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:28.943148 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08172b6c-d9a7-4b05-8173-41115112b2e5 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:28.943148 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08172b6c-d9a7-4b05-8173-41115112b2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:28.975548 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-08172b6c-d9a7-4b05-8173-41115112b2e5 None None] MFA Rules not processed for user `47d73419a8f24716b7d0909a37ff8011`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:49:28.976945 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-08172b6c-d9a7-4b05-8173-41115112b2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:49:28.986465 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:49:29.056454 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1403/2774] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:49:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:49:29.061143 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bea47c-50da-4810-a022-63f8b380050c service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:49:29.071458 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bea47c-50da-4810-a022-63f8b380050c service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:49:29.076137 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab426d1-f9bd-4e4d-afda-9c3b216eea9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:49:29.076757 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab426d1-f9bd-4e4d-afda-9c3b216eea9b admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:29.077030 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab426d1-f9bd-4e4d-afda-9c3b216eea9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:29.077312 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab426d1-f9bd-4e4d-afda-9c3b216eea9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:29.077984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab426d1-f9bd-4e4d-afda-9c3b216eea9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:49:29.079897 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab426d1-f9bd-4e4d-afda-9c3b216eea9b admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:49:29.109552 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1372/2775] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:49:29 2022] POST /identity/v3/projects => generated 389 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:49:29.113898 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08172b6c-d9a7-4b05-8173-41115112b2e5 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:49:29.125413 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08172b6c-d9a7-4b05-8173-41115112b2e5 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:49:29.201274 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd43c85-98dd-4c14-9939-60d44691700f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:49:29.201903 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd43c85-98dd-4c14-9939-60d44691700f admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:29.202179 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd43c85-98dd-4c14-9939-60d44691700f admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:29.202441 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd43c85-98dd-4c14-9939-60d44691700f admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:29.203098 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd43c85-98dd-4c14-9939-60d44691700f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:49:29.205041 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd43c85-98dd-4c14-9939-60d44691700f admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:49:29.228541 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1404/2776] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:49:29 2022] POST /identity/v3/users => generated 301 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:49:29.233398 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab426d1-f9bd-4e4d-afda-9c3b216eea9b admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:49:29.244875 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab426d1-f9bd-4e4d-afda-9c3b216eea9b admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:49:29.249548 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956037e3-1ba1-4e71-9cc4-9ee8fcec79f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:49:29.250174 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956037e3-1ba1-4e71-9cc4-9ee8fcec79f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:29.250449 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956037e3-1ba1-4e71-9cc4-9ee8fcec79f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:29.250718 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956037e3-1ba1-4e71-9cc4-9ee8fcec79f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:29.251439 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956037e3-1ba1-4e71-9cc4-9ee8fcec79f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:49:29.253138 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956037e3-1ba1-4e71-9cc4-9ee8fcec79f0 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:49:29.265047 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1373/2777] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:49:29.269573 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd43c85-98dd-4c14-9939-60d44691700f admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:49:29.280787 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd43c85-98dd-4c14-9939-60d44691700f admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:49:29.285516 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdc196-08e1-4621-b6ac-01bd6ded8d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:49:29.286195 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdc196-08e1-4621-b6ac-01bd6ded8d68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:29.286474 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdc196-08e1-4621-b6ac-01bd6ded8d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:29.286897 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdc196-08e1-4621-b6ac-01bd6ded8d68 admin admin] PATH_INFO: `/v3/projects/72993772511e4d61ab948bfcb633fd3d/users/b7ad1677b4dd4423a98d216256137662/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:29.304245 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bdc196-08e1-4621-b6ac-01bd6ded8d68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72993772511e4d61ab948bfcb633fd3d, user_id=b7ad1677b4dd4423a98d216256137662, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:49:29.307069 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bdc196-08e1-4621-b6ac-01bd6ded8d68 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:49:29.322923 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1405/2778] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:49:29 2022] PUT /identity/v3/projects/72993772511e4d61ab948bfcb633fd3d/users/b7ad1677b4dd4423a98d216256137662/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:49:29.327014 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956037e3-1ba1-4e71-9cc4-9ee8fcec79f0 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:49:29.337423 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956037e3-1ba1-4e71-9cc4-9ee8fcec79f0 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:49:29.398955 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75842d36-7db8-4356-b2e1-dd2e07238872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:49:29.399631 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75842d36-7db8-4356-b2e1-dd2e07238872 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:29.399907 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75842d36-7db8-4356-b2e1-dd2e07238872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:29.400176 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75842d36-7db8-4356-b2e1-dd2e07238872 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:29.400873 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75842d36-7db8-4356-b2e1-dd2e07238872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:49:29.402494 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75842d36-7db8-4356-b2e1-dd2e07238872 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:49:29.413314 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1374/2779] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:49:29.417646 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdc196-08e1-4621-b6ac-01bd6ded8d68 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:49:29.428539 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdc196-08e1-4621-b6ac-01bd6ded8d68 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:49:29.433394 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6740f8b4-d195-4a48-9f5f-00dbca6f5147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:49:29.434184 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740f8b4-d195-4a48-9f5f-00dbca6f5147 admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:29.434530 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740f8b4-d195-4a48-9f5f-00dbca6f5147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:29.434869 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740f8b4-d195-4a48-9f5f-00dbca6f5147 admin admin] PATH_INFO: `/v3/projects/72993772511e4d61ab948bfcb633fd3d/users/b7ad1677b4dd4423a98d216256137662/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:29.436955 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6740f8b4-d195-4a48-9f5f-00dbca6f5147 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72993772511e4d61ab948bfcb633fd3d, user_id=b7ad1677b4dd4423a98d216256137662, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:49:29.439713 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6740f8b4-d195-4a48-9f5f-00dbca6f5147 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:49:29.451126 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1406/2780] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:49:29 2022] PUT /identity/v3/projects/72993772511e4d61ab948bfcb633fd3d/users/b7ad1677b4dd4423a98d216256137662/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:49:33.829219 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5c7d8-e7c6-4745-87e2-f23bcfc8876f None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:33.829753 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5c7d8-e7c6-4745-87e2-f23bcfc8876f None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:33.829753 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5c7d8-e7c6-4745-87e2-f23bcfc8876f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:33.859805 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-c6a5c7d8-e7c6-4745-87e2-f23bcfc8876f None None] MFA Rules not processed for user `b7ad1677b4dd4423a98d216256137662`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:49:33.861297 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-c6a5c7d8-e7c6-4745-87e2-f23bcfc8876f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:49:33.893550 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:49:33.936262 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1375/2781] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:49:33 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:49:33.952887 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6740f8b4-d195-4a48-9f5f-00dbca6f5147 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:49:33.954986 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-6740f8b4-d195-4a48-9f5f-00dbca6f5147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:49:34.028252 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:49:34.035602 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6740f8b4-d195-4a48-9f5f-00dbca6f5147 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:49:34.041794 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8ac0e-294e-4df8-a1d3-4521f7dee166 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:49:34.042793 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8ac0e-294e-4df8-a1d3-4521f7dee166 service nova] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:34.042793 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8ac0e-294e-4df8-a1d3-4521f7dee166 service nova] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:34.043004 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8ac0e-294e-4df8-a1d3-4521f7dee166 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:34.098984 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf8ac0e-294e-4df8-a1d3-4521f7dee166 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:49:34.100675 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf8ac0e-294e-4df8-a1d3-4521f7dee166 service nova] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:49:34.110122 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1407/2782] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:49:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:49:34.186436 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007a94c-a9a1-478f-872d-41743ecb1a62 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:34.187052 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007a94c-a9a1-478f-872d-41743ecb1a62 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:34.187393 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007a94c-a9a1-478f-872d-41743ecb1a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:34.207688 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-d007a94c-a9a1-478f-872d-41743ecb1a62 None None] MFA Rules not processed for user `47d73419a8f24716b7d0909a37ff8011`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:49:34.208920 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-d007a94c-a9a1-478f-872d-41743ecb1a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:49:34.216822 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1376/2783] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:49:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:49:44.106466 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=27 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:49:44.202424 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=18 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:49:44.583278 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8ac0e-294e-4df8-a1d3-4521f7dee166 service nova] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:49:44.585851 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-eaf8ac0e-294e-4df8-a1d3-4521f7dee166 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:49:44.649963 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8ac0e-294e-4df8-a1d3-4521f7dee166 service nova] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:49:44.654125 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa08125-b756-4e93-881b-08897e722c33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1943ab629b6411d81327a845b77c8c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:49:44.654738 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa08125-b756-4e93-881b-08897e722c33 service cinder] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:44.655010 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa08125-b756-4e93-881b-08897e722c33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:44.655280 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa08125-b756-4e93-881b-08897e722c33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:44.664687 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa08125-b756-4e93-881b-08897e722c33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:49:44.666118 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa08125-b756-4e93-881b-08897e722c33 service cinder] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:49:44.675652 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1408/2784] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:49:44 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:49:54.671605 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=26 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:49:56.280625 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007a94c-a9a1-478f-872d-41743ecb1a62 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:49:56.282294 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-d007a94c-a9a1-478f-872d-41743ecb1a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:49:56.377866 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007a94c-a9a1-478f-872d-41743ecb1a62 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:49:56.386243 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62facc0-201c-4bd7-b8b2-20af06ff16d8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:49:56.386881 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62facc0-201c-4bd7-b8b2-20af06ff16d8 service placement] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:49:56.387157 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62facc0-201c-4bd7-b8b2-20af06ff16d8 service placement] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:49:56.387429 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62facc0-201c-4bd7-b8b2-20af06ff16d8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:49:56.389483 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-d62facc0-201c-4bd7-b8b2-20af06ff16d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:49:56.401502 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62facc0-201c-4bd7-b8b2-20af06ff16d8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:49:56.403079 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62facc0-201c-4bd7-b8b2-20af06ff16d8 service placement] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:49:56.412933 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1377/2785] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:49:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:50:06.408811 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=32 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:50:11.322181 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd14419-e36b-477e-b134-7c86c51748c4 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:50:11.322703 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd14419-e36b-477e-b134-7c86c51748c4 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:50:11.322703 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd14419-e36b-477e-b134-7c86c51748c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:50:11.342125 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-4bd14419-e36b-477e-b134-7c86c51748c4 None None] MFA Rules not processed for user `47d73419a8f24716b7d0909a37ff8011`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:50:11.343332 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-4bd14419-e36b-477e-b134-7c86c51748c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:50:11.351105 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1409/2786] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:50:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:50:11.919999 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62facc0-201c-4bd7-b8b2-20af06ff16d8 service placement] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:50:11.930824 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62facc0-201c-4bd7-b8b2-20af06ff16d8 service placement] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:50:11.936723 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a3425-ba5c-467a-84c1-f1192feeb246 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:50:11.937646 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a3425-ba5c-467a-84c1-f1192feeb246 service placement] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:50:11.937934 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a3425-ba5c-467a-84c1-f1192feeb246 service placement] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:50:11.938178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a3425-ba5c-467a-84c1-f1192feeb246 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:50:11.940134 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-974a3425-ba5c-467a-84c1-f1192feeb246 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:50:11.952647 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974a3425-ba5c-467a-84c1-f1192feeb246 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:50:11.954219 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974a3425-ba5c-467a-84c1-f1192feeb246 service placement] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:50:11.964759 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1378/2787] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:50:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:50:21.336738 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:50:21.960201 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=6 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:50:46.958881 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a05663-b569-4446-9771-3e0a029e59a6 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:50:46.959410 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a05663-b569-4446-9771-3e0a029e59a6 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:50:46.959410 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a05663-b569-4446-9771-3e0a029e59a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:50:46.979899 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-54a05663-b569-4446-9771-3e0a029e59a6 None None] MFA Rules not processed for user `47d73419a8f24716b7d0909a37ff8011`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:50:46.981151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-54a05663-b569-4446-9771-3e0a029e59a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:50:46.991103 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1410/2788] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:50:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:50:47.250676 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a3425-ba5c-467a-84c1-f1192feeb246 service placement] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:50:47.253236 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-974a3425-ba5c-467a-84c1-f1192feeb246 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:50:47.323527 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a3425-ba5c-467a-84c1-f1192feeb246 service placement] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:50:47.329070 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae7bea-34a2-45f5-9936-04aabf5f1a99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:50:47.329695 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae7bea-34a2-45f5-9936-04aabf5f1a99 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:50:47.329972 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae7bea-34a2-45f5-9936-04aabf5f1a99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:50:47.330245 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae7bea-34a2-45f5-9936-04aabf5f1a99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:50:47.332650 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-4eae7bea-34a2-45f5-9936-04aabf5f1a99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:50:47.343189 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae7bea-34a2-45f5-9936-04aabf5f1a99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:50:47.344674 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae7bea-34a2-45f5-9936-04aabf5f1a99 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:50:47.353685 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1379/2789] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:50:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:50:56.974459 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:50:57.349891 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=26 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:51:29.180919 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a05663-b569-4446-9771-3e0a029e59a6 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:51:29.258497 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a05663-b569-4446-9771-3e0a029e59a6 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:51:29.263232 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410925ba-970c-4cb0-8fda-31402df3cd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:51:29.264006 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410925ba-970c-4cb0-8fda-31402df3cd77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:51:29.264277 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410925ba-970c-4cb0-8fda-31402df3cd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:51:29.264544 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410925ba-970c-4cb0-8fda-31402df3cd77 admin admin] PATH_INFO: `/v3/users/47d73419a8f24716b7d0909a37ff8011` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:51:29.265879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410925ba-970c-4cb0-8fda-31402df3cd77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47d73419a8f24716b7d0909a37ff8011)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:51:29.267824 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410925ba-970c-4cb0-8fda-31402df3cd77 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:51:29.319252 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-410925ba-970c-4cb0-8fda-31402df3cd77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47d73419a8f24716b7d0909a37ff8011'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:51:29.330641 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-410925ba-970c-4cb0-8fda-31402df3cd77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47d73419a8f24716b7d0909a37ff8011'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:51:29.331425 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-410925ba-970c-4cb0-8fda-31402df3cd77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47d73419a8f24716b7d0909a37ff8011'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:51:29.343687 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-410925ba-970c-4cb0-8fda-31402df3cd77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47d73419a8f24716b7d0909a37ff8011'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:51:29.344332 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-410925ba-970c-4cb0-8fda-31402df3cd77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47d73419a8f24716b7d0909a37ff8011'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:51:29.357883 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1411/2790] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:51:29 2022] DELETE /identity/v3/users/47d73419a8f24716b7d0909a37ff8011 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:51:29.537978 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae7bea-34a2-45f5-9936-04aabf5f1a99 service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:51:29.552745 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae7bea-34a2-45f5-9936-04aabf5f1a99 service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:51:29.616691 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613daf1d-1367-46df-89c6-4ec4fb63a9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:51:29.617357 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613daf1d-1367-46df-89c6-4ec4fb63a9f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:51:29.617638 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613daf1d-1367-46df-89c6-4ec4fb63a9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:51:29.617906 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613daf1d-1367-46df-89c6-4ec4fb63a9f9 admin admin] PATH_INFO: `/v3/projects/a7c5c49d9fda4bcdb5707d6416cf2a4d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:51:29.619156 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613daf1d-1367-46df-89c6-4ec4fb63a9f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7c5c49d9fda4bcdb5707d6416cf2a4d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:51:29.621182 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613daf1d-1367-46df-89c6-4ec4fb63a9f9 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:51:29.674084 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-613daf1d-1367-46df-89c6-4ec4fb63a9f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7c5c49d9fda4bcdb5707d6416cf2a4d', 'request_id': 'req-613daf1d-1367-46df-89c6-4ec4fb63a9f9'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:51:29.680162 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-613daf1d-1367-46df-89c6-4ec4fb63a9f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7c5c49d9fda4bcdb5707d6416cf2a4d', 'request_id': 'req-613daf1d-1367-46df-89c6-4ec4fb63a9f9'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:51:29.686405 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-613daf1d-1367-46df-89c6-4ec4fb63a9f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7c5c49d9fda4bcdb5707d6416cf2a4d', 'request_id': 'req-613daf1d-1367-46df-89c6-4ec4fb63a9f9'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:51:29.700128 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-613daf1d-1367-46df-89c6-4ec4fb63a9f9 admin admin] The token cache is being invalidate because project a7c5c49d9fda4bcdb5707d6416cf2a4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:51:29.700414 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-613daf1d-1367-46df-89c6-4ec4fb63a9f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:51:29.701015 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-613daf1d-1367-46df-89c6-4ec4fb63a9f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:51:29.702557 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1380/2791] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:51:29 2022] DELETE /identity/v3/projects/a7c5c49d9fda4bcdb5707d6416cf2a4d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:51:29.707289 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410925ba-970c-4cb0-8fda-31402df3cd77 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:51:29.709088 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-410925ba-970c-4cb0-8fda-31402df3cd77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:51:29.724272 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410925ba-970c-4cb0-8fda-31402df3cd77 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:51:29.784928 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020c3a5-2d15-4f2b-a27b-232b9e55da13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:51:29.785555 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020c3a5-2d15-4f2b-a27b-232b9e55da13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:51:29.785851 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020c3a5-2d15-4f2b-a27b-232b9e55da13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:51:29.786124 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020c3a5-2d15-4f2b-a27b-232b9e55da13 admin admin] PATH_INFO: `/v3/users/b7ad1677b4dd4423a98d216256137662` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:51:29.787327 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7020c3a5-2d15-4f2b-a27b-232b9e55da13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7ad1677b4dd4423a98d216256137662)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:51:29.789325 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7020c3a5-2d15-4f2b-a27b-232b9e55da13 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:51:29.813245 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:51:29.841256 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-7020c3a5-2d15-4f2b-a27b-232b9e55da13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7ad1677b4dd4423a98d216256137662'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:51:29.847968 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-7020c3a5-2d15-4f2b-a27b-232b9e55da13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7ad1677b4dd4423a98d216256137662'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:51:29.848616 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-7020c3a5-2d15-4f2b-a27b-232b9e55da13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7ad1677b4dd4423a98d216256137662'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:51:29.860822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-7020c3a5-2d15-4f2b-a27b-232b9e55da13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7ad1677b4dd4423a98d216256137662'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:51:29.861446 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-7020c3a5-2d15-4f2b-a27b-232b9e55da13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7ad1677b4dd4423a98d216256137662'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:51:29.877132 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1412/2792] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:51:29 2022] DELETE /identity/v3/users/b7ad1677b4dd4423a98d216256137662 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:51:30.060699 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613daf1d-1367-46df-89c6-4ec4fb63a9f9 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:51:30.062187 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-613daf1d-1367-46df-89c6-4ec4fb63a9f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:51:30.075385 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613daf1d-1367-46df-89c6-4ec4fb63a9f9 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:51:30.132689 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c6a648-9139-43d0-953f-847d27bd9752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:51:30.133337 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6a648-9139-43d0-953f-847d27bd9752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:51:30.133616 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6a648-9139-43d0-953f-847d27bd9752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:51:30.133891 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6a648-9139-43d0-953f-847d27bd9752 admin admin] PATH_INFO: `/v3/projects/72993772511e4d61ab948bfcb633fd3d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:51:30.135109 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c6a648-9139-43d0-953f-847d27bd9752 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72993772511e4d61ab948bfcb633fd3d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:51:30.137252 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c6a648-9139-43d0-953f-847d27bd9752 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:51:30.174457 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:51:30.187530 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-04c6a648-9139-43d0-953f-847d27bd9752 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72993772511e4d61ab948bfcb633fd3d', 'request_id': 'req-04c6a648-9139-43d0-953f-847d27bd9752'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:51:30.193364 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-04c6a648-9139-43d0-953f-847d27bd9752 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72993772511e4d61ab948bfcb633fd3d', 'request_id': 'req-04c6a648-9139-43d0-953f-847d27bd9752'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:51:30.199705 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-04c6a648-9139-43d0-953f-847d27bd9752 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72993772511e4d61ab948bfcb633fd3d', 'request_id': 'req-04c6a648-9139-43d0-953f-847d27bd9752'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:51:30.214068 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-04c6a648-9139-43d0-953f-847d27bd9752 admin admin] The token cache is being invalidate because project 72993772511e4d61ab948bfcb633fd3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:51:30.214353 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-04c6a648-9139-43d0-953f-847d27bd9752 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:51:30.215016 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-04c6a648-9139-43d0-953f-847d27bd9752 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:51:30.216573 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1381/2793] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:51:30 2022] DELETE /identity/v3/projects/72993772511e4d61ab948bfcb633fd3d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:51:30.221840 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa15c2-b10f-4a05-8d8d-768c35edf08b None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:51:30.222331 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa15c2-b10f-4a05-8d8d-768c35edf08b None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:51:30.222521 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa15c2-b10f-4a05-8d8d-768c35edf08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:51:30.243274 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-e4fa15c2-b10f-4a05-8d8d-768c35edf08b None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:51:30.244527 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-e4fa15c2-b10f-4a05-8d8d-768c35edf08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:51:30.304841 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1413/2794] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:51:30.312639 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f58971-9467-41eb-b122-26ce668c4e77 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:51:30.312919 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f58971-9467-41eb-b122-26ce668c4e77 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:51:30.313214 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f58971-9467-41eb-b122-26ce668c4e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:51:30.333057 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-78f58971-9467-41eb-b122-26ce668c4e77 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:51:30.334279 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-78f58971-9467-41eb-b122-26ce668c4e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:51:30.342423 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1382/2795] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:51:30.347513 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa15c2-b10f-4a05-8d8d-768c35edf08b None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:51:30.357938 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa15c2-b10f-4a05-8d8d-768c35edf08b None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:51:30.363526 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5e5b8-499d-468e-b05c-41eb5d67d14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:51:30.364157 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5e5b8-499d-468e-b05c-41eb5d67d14c admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:51:30.364792 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5e5b8-499d-468e-b05c-41eb5d67d14c admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:51:30.365068 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5e5b8-499d-468e-b05c-41eb5d67d14c admin admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:51:30.365765 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf5e5b8-499d-468e-b05c-41eb5d67d14c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:51:30.366066 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf5e5b8-499d-468e-b05c-41eb5d67d14c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:51:30.367702 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf5e5b8-499d-468e-b05c-41eb5d67d14c admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:51:30.380102 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1414/2796] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:51:30.384571 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f58971-9467-41eb-b122-26ce668c4e77 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:51:30.393668 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f58971-9467-41eb-b122-26ce668c4e77 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:51:30.398359 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356092e-db1d-41c3-bd50-0a08d77f262d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:51:30.398963 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356092e-db1d-41c3-bd50-0a08d77f262d admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:51:30.399232 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356092e-db1d-41c3-bd50-0a08d77f262d admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:51:30.399527 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356092e-db1d-41c3-bd50-0a08d77f262d admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:51:30.400189 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7356092e-db1d-41c3-bd50-0a08d77f262d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:51:30.402075 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7356092e-db1d-41c3-bd50-0a08d77f262d admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:51:30.432244 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1383/2797] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:51:30 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:51:30.436973 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5e5b8-499d-468e-b05c-41eb5d67d14c admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:51:30.448499 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5e5b8-499d-468e-b05c-41eb5d67d14c admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:51:30.508114 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2b0b4-8edc-4eb9-81e4-f6629e2fdae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:51:30.508741 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2b0b4-8edc-4eb9-81e4-f6629e2fdae0 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:51:30.509044 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2b0b4-8edc-4eb9-81e4-f6629e2fdae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:51:30.509285 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2b0b4-8edc-4eb9-81e4-f6629e2fdae0 admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:51:30.509937 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2b0b4-8edc-4eb9-81e4-f6629e2fdae0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:51:30.511879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2b0b4-8edc-4eb9-81e4-f6629e2fdae0 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:51:30.534627 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1415/2798] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:51:30 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:51:30.538842 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356092e-db1d-41c3-bd50-0a08d77f262d admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:51:30.549587 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356092e-db1d-41c3-bd50-0a08d77f262d admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:51:30.554793 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2591e1-3e5f-4e6b-8f46-e6a27fdd79c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:51:30.555404 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2591e1-3e5f-4e6b-8f46-e6a27fdd79c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:51:30.555685 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2591e1-3e5f-4e6b-8f46-e6a27fdd79c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:51:30.556030 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2591e1-3e5f-4e6b-8f46-e6a27fdd79c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:51:30.556727 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2591e1-3e5f-4e6b-8f46-e6a27fdd79c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:51:30.558359 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2591e1-3e5f-4e6b-8f46-e6a27fdd79c7 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:51:30.568879 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1384/2799] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:51:30.574388 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2b0b4-8edc-4eb9-81e4-f6629e2fdae0 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:51:30.585353 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2b0b4-8edc-4eb9-81e4-f6629e2fdae0 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:51:30.591159 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f6237-1a9b-4cc0-b43a-f4f5c80cb4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:51:30.591816 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f6237-1a9b-4cc0-b43a-f4f5c80cb4c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:51:30.592120 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f6237-1a9b-4cc0-b43a-f4f5c80cb4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:51:30.592389 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f6237-1a9b-4cc0-b43a-f4f5c80cb4c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:51:30.593084 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f6237-1a9b-4cc0-b43a-f4f5c80cb4c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:51:30.594738 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f6237-1a9b-4cc0-b43a-f4f5c80cb4c1 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:51:30.606994 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1416/2800] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:51:30.611294 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2591e1-3e5f-4e6b-8f46-e6a27fdd79c7 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:51:30.622848 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2591e1-3e5f-4e6b-8f46-e6a27fdd79c7 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:51:30.629547 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852d909-a9d4-41aa-8111-b2edc1e3051e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:51:30.630699 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852d909-a9d4-41aa-8111-b2edc1e3051e admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:51:30.631164 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852d909-a9d4-41aa-8111-b2edc1e3051e admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:51:30.631697 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852d909-a9d4-41aa-8111-b2edc1e3051e admin admin] PATH_INFO: `/v3/projects/80ae8986beb2493fa4ab1c916ca805fd/users/e3f7dfd1a9a843c8969cf620a191143e/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:51:30.652040 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2852d909-a9d4-41aa-8111-b2edc1e3051e admin admin] RBAC: Authorizing `identity:create_grant(project_id=80ae8986beb2493fa4ab1c916ca805fd, user_id=e3f7dfd1a9a843c8969cf620a191143e, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:51:30.654699 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2852d909-a9d4-41aa-8111-b2edc1e3051e admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:51:30.671067 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1385/2801] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:51:30 2022] PUT /identity/v3/projects/80ae8986beb2493fa4ab1c916ca805fd/users/e3f7dfd1a9a843c8969cf620a191143e/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:51:30.676461 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e49f0-b84e-45c3-80e5-f62e1b075960 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:51:30.676773 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e49f0-b84e-45c3-80e5-f62e1b075960 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:51:30.677051 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e49f0-b84e-45c3-80e5-f62e1b075960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:51:30.685299 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:51:30.697749 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-262e49f0-b84e-45c3-80e5-f62e1b075960 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:51:30.699083 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-262e49f0-b84e-45c3-80e5-f62e1b075960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:51:30.760741 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1417/2802] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:51:30.770839 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852d909-a9d4-41aa-8111-b2edc1e3051e admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:51:30.772867 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-2852d909-a9d4-41aa-8111-b2edc1e3051e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:51:30.831770 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852d909-a9d4-41aa-8111-b2edc1e3051e admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:51:30.835998 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95617c3-55af-46e0-b951-4f68fe6d4626 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:51:30.836630 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95617c3-55af-46e0-b951-4f68fe6d4626 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:51:30.836927 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95617c3-55af-46e0-b951-4f68fe6d4626 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:51:30.837194 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95617c3-55af-46e0-b951-4f68fe6d4626 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:51:30.846768 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95617c3-55af-46e0-b951-4f68fe6d4626 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:51:30.848226 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95617c3-55af-46e0-b951-4f68fe6d4626 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:51:30.858288 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1386/2803] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:51:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:51:34.921045 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a0d07-d8df-4c0d-afdc-23bb5b40442d None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:51:34.921534 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a0d07-d8df-4c0d-afdc-23bb5b40442d None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:51:34.921646 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a0d07-d8df-4c0d-afdc-23bb5b40442d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:51:34.957399 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-7d4a0d07-d8df-4c0d-afdc-23bb5b40442d None None] MFA Rules not processed for user `e3f7dfd1a9a843c8969cf620a191143e`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:51:34.958616 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-7d4a0d07-d8df-4c0d-afdc-23bb5b40442d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:51:35.029709 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1418/2804] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:51:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:51:35.034384 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95617c3-55af-46e0-b951-4f68fe6d4626 service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:51:35.044955 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95617c3-55af-46e0-b951-4f68fe6d4626 service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:51:35.049564 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e6dd4-9c0d-4bcf-8329-3acb9663cebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:51:35.050185 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e6dd4-9c0d-4bcf-8329-3acb9663cebb admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:51:35.050460 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e6dd4-9c0d-4bcf-8329-3acb9663cebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:51:35.050726 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e6dd4-9c0d-4bcf-8329-3acb9663cebb admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:51:35.051386 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273e6dd4-9c0d-4bcf-8329-3acb9663cebb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:51:35.053344 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273e6dd4-9c0d-4bcf-8329-3acb9663cebb admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:51:35.082029 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1387/2805] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:51:35 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:51:35.086190 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a0d07-d8df-4c0d-afdc-23bb5b40442d None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:51:35.097599 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a0d07-d8df-4c0d-afdc-23bb5b40442d None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:51:35.154855 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237e2a9-062f-43fc-89ee-eb038a30722a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:51:35.155508 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237e2a9-062f-43fc-89ee-eb038a30722a admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:51:35.155790 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237e2a9-062f-43fc-89ee-eb038a30722a admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:51:35.156068 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237e2a9-062f-43fc-89ee-eb038a30722a admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:51:35.156738 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237e2a9-062f-43fc-89ee-eb038a30722a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:51:35.158720 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237e2a9-062f-43fc-89ee-eb038a30722a admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:51:35.182099 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1419/2806] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:51:35 2022] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:51:35.185757 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e6dd4-9c0d-4bcf-8329-3acb9663cebb admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:51:35.199442 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e6dd4-9c0d-4bcf-8329-3acb9663cebb admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:51:35.204897 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f5b89b-c917-45cd-aa4b-ded0d5f1acb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:51:35.205593 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5b89b-c917-45cd-aa4b-ded0d5f1acb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:51:35.205903 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5b89b-c917-45cd-aa4b-ded0d5f1acb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:51:35.206172 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5b89b-c917-45cd-aa4b-ded0d5f1acb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:51:35.207049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f5b89b-c917-45cd-aa4b-ded0d5f1acb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:51:35.208675 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f5b89b-c917-45cd-aa4b-ded0d5f1acb1 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:51:35.220539 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1388/2807] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:51:35.224928 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237e2a9-062f-43fc-89ee-eb038a30722a admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:51:35.236149 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237e2a9-062f-43fc-89ee-eb038a30722a admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:51:35.242058 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02161315-6533-430e-a1ce-95ceed7f614d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:51:35.242756 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02161315-6533-430e-a1ce-95ceed7f614d admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:51:35.243035 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02161315-6533-430e-a1ce-95ceed7f614d admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:51:35.243305 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02161315-6533-430e-a1ce-95ceed7f614d admin admin] PATH_INFO: `/v3/projects/eb84a4c6eb344bd89b0d2effee36dc81/users/792626582cb64aa1aad3262b3f4f9990/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:51:35.261618 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02161315-6533-430e-a1ce-95ceed7f614d admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb84a4c6eb344bd89b0d2effee36dc81, user_id=792626582cb64aa1aad3262b3f4f9990, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:51:35.264536 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02161315-6533-430e-a1ce-95ceed7f614d admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:51:35.275140 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:51:35.280413 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1420/2808] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:51:35 2022] PUT /identity/v3/projects/eb84a4c6eb344bd89b0d2effee36dc81/users/792626582cb64aa1aad3262b3f4f9990/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:51:35.284530 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f5b89b-c917-45cd-aa4b-ded0d5f1acb1 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:51:35.294605 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f5b89b-c917-45cd-aa4b-ded0d5f1acb1 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:51:35.318954 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:51:35.354832 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e97c3f-3feb-49c2-aff8-8f8be78830ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:51:35.355479 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e97c3f-3feb-49c2-aff8-8f8be78830ad admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:51:35.355800 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e97c3f-3feb-49c2-aff8-8f8be78830ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:51:35.356061 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e97c3f-3feb-49c2-aff8-8f8be78830ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:51:35.356775 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e97c3f-3feb-49c2-aff8-8f8be78830ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:51:35.358394 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e97c3f-3feb-49c2-aff8-8f8be78830ad admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:51:35.370958 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1389/2809] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:51:35.376639 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02161315-6533-430e-a1ce-95ceed7f614d admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:51:35.387163 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02161315-6533-430e-a1ce-95ceed7f614d admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:51:35.393059 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0b28b-cf38-4dbb-a445-3fbe6b0fb1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:51:35.393743 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0b28b-cf38-4dbb-a445-3fbe6b0fb1b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:51:35.394014 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0b28b-cf38-4dbb-a445-3fbe6b0fb1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:51:35.394285 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0b28b-cf38-4dbb-a445-3fbe6b0fb1b4 admin admin] PATH_INFO: `/v3/projects/eb84a4c6eb344bd89b0d2effee36dc81/users/792626582cb64aa1aad3262b3f4f9990/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:51:35.396538 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf0b28b-cf38-4dbb-a445-3fbe6b0fb1b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb84a4c6eb344bd89b0d2effee36dc81, user_id=792626582cb64aa1aad3262b3f4f9990, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:51:35.399421 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf0b28b-cf38-4dbb-a445-3fbe6b0fb1b4 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:51:35.411454 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1421/2810] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:51:35 2022] PUT /identity/v3/projects/eb84a4c6eb344bd89b0d2effee36dc81/users/792626582cb64aa1aad3262b3f4f9990/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:51:39.434772 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337cb78-4bab-4a02-b245-de56a8b2af95 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:51:39.435381 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337cb78-4bab-4a02-b245-de56a8b2af95 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:51:39.435527 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337cb78-4bab-4a02-b245-de56a8b2af95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:51:39.468294 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-0337cb78-4bab-4a02-b245-de56a8b2af95 None None] MFA Rules not processed for user `792626582cb64aa1aad3262b3f4f9990`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:51:39.469533 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-0337cb78-4bab-4a02-b245-de56a8b2af95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:51:39.541756 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1390/2811] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:51:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:51:39.554257 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0b28b-cf38-4dbb-a445-3fbe6b0fb1b4 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:51:39.556079 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-bbf0b28b-cf38-4dbb-a445-3fbe6b0fb1b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:51:39.637884 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0b28b-cf38-4dbb-a445-3fbe6b0fb1b4 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:51:39.641757 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe40ba-9967-4d01-8596-d4b3aff4d890 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdebcb0a2a7548a09b3e9d3cf085e40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:51:39.642378 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe40ba-9967-4d01-8596-d4b3aff4d890 service glance] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:51:39.642651 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe40ba-9967-4d01-8596-d4b3aff4d890 service glance] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:51:39.643119 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe40ba-9967-4d01-8596-d4b3aff4d890 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:51:39.700187 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe40ba-9967-4d01-8596-d4b3aff4d890 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:51:39.701579 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe40ba-9967-4d01-8596-d4b3aff4d890 service glance] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:51:39.710975 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1422/2812] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:51:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:51:39.906540 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32894a-7074-46af-9b21-db3c9cb7134a None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:51:39.906828 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32894a-7074-46af-9b21-db3c9cb7134a None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:51:39.907106 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32894a-7074-46af-9b21-db3c9cb7134a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:51:39.971574 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-5e32894a-7074-46af-9b21-db3c9cb7134a None None] MFA Rules not processed for user `02ed9040d575462db4b270a5b57063f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:51:39.972805 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-5e32894a-7074-46af-9b21-db3c9cb7134a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:51:40.061335 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1391/2813] 10.222.0.60 () {58 vars in 1009 bytes} [Sun Jul 31 01:51:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:51:40.109641 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe40ba-9967-4d01-8596-d4b3aff4d890 service glance] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:51:40.111222 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-9abe40ba-9967-4d01-8596-d4b3aff4d890 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:51:40.209012 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:51:40.212086 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe40ba-9967-4d01-8596-d4b3aff4d890 service glance] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:51:40.218130 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409c248-aad9-4e3b-bb15-87dee633fb03 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c8c98c1e2d24de89c7d07753fae02e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:51:40.218784 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409c248-aad9-4e3b-bb15-87dee633fb03 service swift] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:51:40.219111 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409c248-aad9-4e3b-bb15-87dee633fb03 service swift] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:51:40.219386 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409c248-aad9-4e3b-bb15-87dee633fb03 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:51:40.228409 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d409c248-aad9-4e3b-bb15-87dee633fb03 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:51:40.230010 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d409c248-aad9-4e3b-bb15-87dee633fb03 service swift] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:51:40.238868 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1423/2814] 10.222.0.60 () {60 vars in 1384 bytes} [Sun Jul 31 01:51:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 01:51:48.973404 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c120a-ded6-4184-b53f-d2365927763d None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:51:48.973989 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c120a-ded6-4184-b53f-d2365927763d None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:51:48.973989 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c120a-ded6-4184-b53f-d2365927763d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:51:48.993944 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-0d1c120a-ded6-4184-b53f-d2365927763d None None] MFA Rules not processed for user `e3f7dfd1a9a843c8969cf620a191143e`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:51:48.995150 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-0d1c120a-ded6-4184-b53f-d2365927763d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:51:49.003212 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1392/2815] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:51:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:51:50.235332 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=4 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:51:50.909527 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf68d7-16b8-4503-969f-f803f0169950 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:51:50.909812 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf68d7-16b8-4503-969f-f803f0169950 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:51:50.910085 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf68d7-16b8-4503-969f-f803f0169950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:51:50.930208 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-58bf68d7-16b8-4503-969f-f803f0169950 None None] MFA Rules not processed for user `02ed9040d575462db4b270a5b57063f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:51:50.931429 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-58bf68d7-16b8-4503-969f-f803f0169950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:51:50.940030 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1424/2816] 10.222.0.60 () {58 vars in 1009 bytes} [Sun Jul 31 01:51:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:51:50.952173 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c120a-ded6-4184-b53f-d2365927763d None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:51:50.959908 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=100 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:51:50.965424 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c120a-ded6-4184-b53f-d2365927763d None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:51:50.970834 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6826e15-3d2e-42f9-86c6-c31f599c80ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c8c98c1e2d24de89c7d07753fae02e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:51:50.971457 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6826e15-3d2e-42f9-86c6-c31f599c80ef service swift] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:51:50.971812 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6826e15-3d2e-42f9-86c6-c31f599c80ef service swift] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:51:50.972061 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6826e15-3d2e-42f9-86c6-c31f599c80ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:51:50.980342 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6826e15-3d2e-42f9-86c6-c31f599c80ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:51:50.981928 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6826e15-3d2e-42f9-86c6-c31f599c80ef service swift] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:51:50.993045 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1393/2817] 10.222.0.60 () {60 vars in 1384 bytes} [Sun Jul 31 01:51:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 31 01:51:58.835392 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf68d7-16b8-4503-969f-f803f0169950 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:51:58.837076 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-58bf68d7-16b8-4503-969f-f803f0169950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:51:58.895704 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf68d7-16b8-4503-969f-f803f0169950 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:51:58.899785 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c1f19-faf3-400e-9bdb-3c7f215ad4f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:51:58.900370 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c1f19-faf3-400e-9bdb-3c7f215ad4f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:51:58.900677 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c1f19-faf3-400e-9bdb-3c7f215ad4f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:51:58.900923 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c1f19-faf3-400e-9bdb-3c7f215ad4f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:51:58.902915 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-890c1f19-faf3-400e-9bdb-3c7f215ad4f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:51:58.913373 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c1f19-faf3-400e-9bdb-3c7f215ad4f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:51:58.914788 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c1f19-faf3-400e-9bdb-3c7f215ad4f1 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:51:58.922986 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1425/2818] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:51:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:52:00.987426 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=4 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:52:01.482127 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6826e15-3d2e-42f9-86c6-c31f599c80ef service swift] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:52:01.492120 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6826e15-3d2e-42f9-86c6-c31f599c80ef service swift] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:52:01.496860 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc428a70-9f2d-4d32-b677-06c89cd8202d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:52:01.498026 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc428a70-9f2d-4d32-b677-06c89cd8202d service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:52:01.498309 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc428a70-9f2d-4d32-b677-06c89cd8202d service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:52:01.498604 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc428a70-9f2d-4d32-b677-06c89cd8202d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:52:01.500517 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-fc428a70-9f2d-4d32-b677-06c89cd8202d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:52:01.573359 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc428a70-9f2d-4d32-b677-06c89cd8202d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:52:01.574829 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc428a70-9f2d-4d32-b677-06c89cd8202d service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:52:01.585934 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1394/2819] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:52:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:52:02.773917 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c1f19-faf3-400e-9bdb-3c7f215ad4f1 service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:52:02.783037 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c1f19-faf3-400e-9bdb-3c7f215ad4f1 service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:52:02.787390 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded131cc-a407-4445-ae3c-bcb9ac39b392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:52:02.788038 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded131cc-a407-4445-ae3c-bcb9ac39b392 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:52:02.788309 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded131cc-a407-4445-ae3c-bcb9ac39b392 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:52:02.788570 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded131cc-a407-4445-ae3c-bcb9ac39b392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:52:02.790590 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-ded131cc-a407-4445-ae3c-bcb9ac39b392 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:52:02.804559 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded131cc-a407-4445-ae3c-bcb9ac39b392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:52:02.805982 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded131cc-a407-4445-ae3c-bcb9ac39b392 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:52:02.817176 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1426/2820] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:52:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:52:04.967686 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc428a70-9f2d-4d32-b677-06c89cd8202d service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:52:04.969270 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-fc428a70-9f2d-4d32-b677-06c89cd8202d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:52:04.983274 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc428a70-9f2d-4d32-b677-06c89cd8202d service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:52:04.988960 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f492d-54c5-46f9-91cc-b321b56c4cc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:52:04.990318 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f492d-54c5-46f9-91cc-b321b56c4cc1 service nova] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:52:04.990741 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f492d-54c5-46f9-91cc-b321b56c4cc1 service nova] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:52:04.991134 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f492d-54c5-46f9-91cc-b321b56c4cc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:52:04.993319 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-d72f492d-54c5-46f9-91cc-b321b56c4cc1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:52:05.006080 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f492d-54c5-46f9-91cc-b321b56c4cc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:52:05.007362 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f492d-54c5-46f9-91cc-b321b56c4cc1 service nova] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:52:05.022611 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1395/2821] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:52:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:52:12.812142 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=35 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:52:15.014547 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=40 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:52:22.176482 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded131cc-a407-4445-ae3c-bcb9ac39b392 service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:52:22.185895 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded131cc-a407-4445-ae3c-bcb9ac39b392 service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:52:22.190554 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be741a52-72e5-4f10-8938-0115e5e404eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:52:22.191269 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be741a52-72e5-4f10-8938-0115e5e404eb service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:52:22.191604 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be741a52-72e5-4f10-8938-0115e5e404eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:52:22.191906 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be741a52-72e5-4f10-8938-0115e5e404eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:52:22.202890 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be741a52-72e5-4f10-8938-0115e5e404eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:52:22.204345 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be741a52-72e5-4f10-8938-0115e5e404eb service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:52:22.216746 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1427/2822] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:52:22 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:52:24.129795 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f492d-54c5-46f9-91cc-b321b56c4cc1 service nova] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:52:24.147782 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f492d-54c5-46f9-91cc-b321b56c4cc1 service nova] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:52:24.154692 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe65a61-3055-4600-883f-47a6b8abf867 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:52:24.155478 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe65a61-3055-4600-883f-47a6b8abf867 service nova] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:52:24.155886 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe65a61-3055-4600-883f-47a6b8abf867 service nova] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:52:24.156400 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe65a61-3055-4600-883f-47a6b8abf867 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:52:24.158244 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-cbe65a61-3055-4600-883f-47a6b8abf867 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:52:24.173278 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe65a61-3055-4600-883f-47a6b8abf867 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:52:24.175399 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe65a61-3055-4600-883f-47a6b8abf867 service nova] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:52:24.200598 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1396/2823] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:52:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:52:32.210194 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=6 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:52:34.185943 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=6 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:54:59.936355 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be741a52-72e5-4f10-8938-0115e5e404eb service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:54:59.938052 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-be741a52-72e5-4f10-8938-0115e5e404eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:55:00.087101 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be741a52-72e5-4f10-8938-0115e5e404eb service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:55:00.093484 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e17ac75-92da-497d-991b-ca362cf1ea50 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:55:00.094103 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17ac75-92da-497d-991b-ca362cf1ea50 service placement] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:55:00.094377 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17ac75-92da-497d-991b-ca362cf1ea50 service placement] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:55:00.094647 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17ac75-92da-497d-991b-ca362cf1ea50 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:55:00.097774 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-1e17ac75-92da-497d-991b-ca362cf1ea50 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:55:00.110106 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e17ac75-92da-497d-991b-ca362cf1ea50 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:55:00.111727 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e17ac75-92da-497d-991b-ca362cf1ea50 service placement] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:55:00.122355 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1428/2824] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:54:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:55:10.117977 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=63 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:55:17.151734 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe65a61-3055-4600-883f-47a6b8abf867 service nova] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:55:17.153533 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-cbe65a61-3055-4600-883f-47a6b8abf867 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:55:17.233226 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe65a61-3055-4600-883f-47a6b8abf867 service nova] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:55:17.240734 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6acc3b-bd86-48ee-bc4d-8f7af47ac8ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:55:17.241371 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6acc3b-bd86-48ee-bc4d-8f7af47ac8ec service nova] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:55:17.241651 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6acc3b-bd86-48ee-bc4d-8f7af47ac8ec service nova] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:55:17.241924 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6acc3b-bd86-48ee-bc4d-8f7af47ac8ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:55:17.243935 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-6f6acc3b-bd86-48ee-bc4d-8f7af47ac8ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:55:17.260343 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6acc3b-bd86-48ee-bc4d-8f7af47ac8ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:55:17.262076 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6acc3b-bd86-48ee-bc4d-8f7af47ac8ec service nova] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:55:17.273847 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1397/2825] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:55:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:55:27.268822 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=28 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:55:31.135183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1ff7a-1b0f-4a90-8ed3-0454c1972817 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:55:31.135676 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1ff7a-1b0f-4a90-8ed3-0454c1972817 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:55:31.135918 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1ff7a-1b0f-4a90-8ed3-0454c1972817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:55:31.156357 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-a6c1ff7a-1b0f-4a90-8ed3-0454c1972817 None None] MFA Rules not processed for user `02ed9040d575462db4b270a5b57063f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:55:31.157575 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-a6c1ff7a-1b0f-4a90-8ed3-0454c1972817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:55:31.166427 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1429/2826] 10.222.0.60 () {58 vars in 967 bytes} [Sun Jul 31 01:55:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:55:31.210909 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6acc3b-bd86-48ee-bc4d-8f7af47ac8ec service nova] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:55:31.223700 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6acc3b-bd86-48ee-bc4d-8f7af47ac8ec service nova] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:55:31.229517 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e53b54-b4e9-4b06-8c0c-307820635f24 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c8c98c1e2d24de89c7d07753fae02e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:55:31.230132 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e53b54-b4e9-4b06-8c0c-307820635f24 service swift] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:55:31.230407 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e53b54-b4e9-4b06-8c0c-307820635f24 service swift] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:55:31.230673 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e53b54-b4e9-4b06-8c0c-307820635f24 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:55:31.239754 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e53b54-b4e9-4b06-8c0c-307820635f24 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:55:31.241328 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e53b54-b4e9-4b06-8c0c-307820635f24 service swift] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:55:31.249673 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1398/2827] 10.222.0.60 () {60 vars in 1384 bytes} [Sun Jul 31 01:55:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 01:55:31.781216 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ab832-e367-42ec-91b3-d79f805fca5e None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:55:31.781737 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ab832-e367-42ec-91b3-d79f805fca5e None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:55:31.782122 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ab832-e367-42ec-91b3-d79f805fca5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:55:31.812166 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-0d8ab832-e367-42ec-91b3-d79f805fca5e None None] MFA Rules not processed for user `02ed9040d575462db4b270a5b57063f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:55:31.813945 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-0d8ab832-e367-42ec-91b3-d79f805fca5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:55:31.824670 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1430/2828] 10.222.0.60 () {58 vars in 1009 bytes} [Sun Jul 31 01:55:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:55:31.837480 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e53b54-b4e9-4b06-8c0c-307820635f24 service swift] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:55:31.848467 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e53b54-b4e9-4b06-8c0c-307820635f24 service swift] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:55:31.854676 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d70057-051b-46b0-84be-0079852532c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c8c98c1e2d24de89c7d07753fae02e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:55:31.855322 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d70057-051b-46b0-84be-0079852532c5 service swift] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:55:31.855648 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d70057-051b-46b0-84be-0079852532c5 service swift] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:55:31.855919 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d70057-051b-46b0-84be-0079852532c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:55:31.865531 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d70057-051b-46b0-84be-0079852532c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:55:31.867157 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d70057-051b-46b0-84be-0079852532c5 service swift] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:55:31.875457 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1399/2829] 10.222.0.60 () {60 vars in 1384 bytes} [Sun Jul 31 01:55:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 01:55:39.992348 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af5e71-c643-4d5b-abb6-727a434e21da None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:55:39.992905 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af5e71-c643-4d5b-abb6-727a434e21da None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:55:39.992905 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af5e71-c643-4d5b-abb6-727a434e21da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:55:40.012404 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-89af5e71-c643-4d5b-abb6-727a434e21da None None] MFA Rules not processed for user `e3f7dfd1a9a843c8969cf620a191143e`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:55:40.013623 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-89af5e71-c643-4d5b-abb6-727a434e21da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:55:40.021482 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1431/2830] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:55:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:55:40.607868 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d70057-051b-46b0-84be-0079852532c5 service swift] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:55:40.620208 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d70057-051b-46b0-84be-0079852532c5 service swift] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:55:40.625901 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767e55b-6550-4a8e-a007-b2fa97804754 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:55:40.626642 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767e55b-6550-4a8e-a007-b2fa97804754 service placement] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:55:40.626968 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767e55b-6550-4a8e-a007-b2fa97804754 service placement] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:55:40.627241 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767e55b-6550-4a8e-a007-b2fa97804754 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:55:40.629141 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-7767e55b-6550-4a8e-a007-b2fa97804754 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:55:40.641354 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767e55b-6550-4a8e-a007-b2fa97804754 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:55:40.642913 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767e55b-6550-4a8e-a007-b2fa97804754 service placement] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:55:40.653370 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1400/2831] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:55:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:55:41.946451 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b5404-68a9-4ac0-92d8-3637372f9b6c None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:55:41.946955 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b5404-68a9-4ac0-92d8-3637372f9b6c None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:55:41.946955 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b5404-68a9-4ac0-92d8-3637372f9b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:55:41.969207 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-991b5404-68a9-4ac0-92d8-3637372f9b6c None None] MFA Rules not processed for user `02ed9040d575462db4b270a5b57063f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:55:41.970427 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-991b5404-68a9-4ac0-92d8-3637372f9b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:55:41.985474 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1432/2832] 10.222.0.60 () {58 vars in 1009 bytes} [Sun Jul 31 01:55:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:55:41.999502 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767e55b-6550-4a8e-a007-b2fa97804754 service placement] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:55:42.010724 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767e55b-6550-4a8e-a007-b2fa97804754 service placement] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:55:42.016061 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1c40d-b927-4469-8310-6a0756d622a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c8c98c1e2d24de89c7d07753fae02e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:55:42.016617 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1c40d-b927-4469-8310-6a0756d622a8 service swift] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:55:42.016893 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1c40d-b927-4469-8310-6a0756d622a8 service swift] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:55:42.017151 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1c40d-b927-4469-8310-6a0756d622a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:55:42.025262 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf1c40d-b927-4469-8310-6a0756d622a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:55:42.026854 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf1c40d-b927-4469-8310-6a0756d622a8 service swift] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:55:42.035021 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1401/2833] 10.222.0.60 () {60 vars in 1384 bytes} [Sun Jul 31 01:55:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 01:55:51.979236 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=15 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:55:52.031990 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=24 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:56:38.510150 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b5404-68a9-4ac0-92d8-3637372f9b6c None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:56:38.535410 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b5404-68a9-4ac0-92d8-3637372f9b6c None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:56:38.542182 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ac608-70d9-471e-91a7-b97f098b0e56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:56:38.542794 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ac608-70d9-471e-91a7-b97f098b0e56 service nova] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:56:38.543069 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ac608-70d9-471e-91a7-b97f098b0e56 service nova] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:56:38.543349 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ac608-70d9-471e-91a7-b97f098b0e56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:56:38.551662 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ac608-70d9-471e-91a7-b97f098b0e56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:56:38.553299 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ac608-70d9-471e-91a7-b97f098b0e56 service nova] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:56:38.562184 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1433/2834] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:56:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:56:48.558425 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=10 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:57:02.681809 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1c40d-b927-4469-8310-6a0756d622a8 service swift] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:57:02.703230 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1c40d-b927-4469-8310-6a0756d622a8 service swift] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:57:02.707916 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3793e9ae-27d9-4cc8-8488-a39d956699ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:57:02.708538 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793e9ae-27d9-4cc8-8488-a39d956699ac service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:57:02.708809 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793e9ae-27d9-4cc8-8488-a39d956699ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:57:02.709064 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793e9ae-27d9-4cc8-8488-a39d956699ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:57:02.717561 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3793e9ae-27d9-4cc8-8488-a39d956699ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:57:02.719099 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3793e9ae-27d9-4cc8-8488-a39d956699ac service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:57:02.727510 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1402/2835] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:57:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:57:12.724116 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=10 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:57:14.749131 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ac608-70d9-471e-91a7-b97f098b0e56 service nova] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:57:14.760464 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ac608-70d9-471e-91a7-b97f098b0e56 service nova] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:57:14.765082 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a922497-59b7-4b21-af19-d8ab86038586 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:57:14.765688 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a922497-59b7-4b21-af19-d8ab86038586 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:57:14.765990 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a922497-59b7-4b21-af19-d8ab86038586 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:57:14.766282 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a922497-59b7-4b21-af19-d8ab86038586 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:57:14.779235 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a922497-59b7-4b21-af19-d8ab86038586 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:57:14.781675 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a922497-59b7-4b21-af19-d8ab86038586 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:57:14.794282 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1434/2836] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:57:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:57:22.114689 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3793e9ae-27d9-4cc8-8488-a39d956699ac service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:57:22.116872 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-3793e9ae-27d9-4cc8-8488-a39d956699ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:57:22.203202 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3793e9ae-27d9-4cc8-8488-a39d956699ac service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:57:22.207408 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d485a7-fc14-4793-af3e-dfc3591e6f1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1943ab629b6411d81327a845b77c8c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:57:22.208150 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d485a7-fc14-4793-af3e-dfc3591e6f1b service cinder] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:57:22.208429 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d485a7-fc14-4793-af3e-dfc3591e6f1b service cinder] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:57:22.208719 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d485a7-fc14-4793-af3e-dfc3591e6f1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:57:22.220330 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d485a7-fc14-4793-af3e-dfc3591e6f1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:57:22.221866 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d485a7-fc14-4793-af3e-dfc3591e6f1b service cinder] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:57:22.233543 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1403/2837] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:57:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:57:24.788602 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=6 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:57:29.229668 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71165106-b32b-41da-9169-a491caa02c47 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:57:29.230233 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71165106-b32b-41da-9169-a491caa02c47 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:57:29.230233 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71165106-b32b-41da-9169-a491caa02c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:57:29.254574 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-71165106-b32b-41da-9169-a491caa02c47 None None] MFA Rules not processed for user `02ed9040d575462db4b270a5b57063f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:57:29.255762 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-71165106-b32b-41da-9169-a491caa02c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:57:29.264894 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1435/2838] 10.222.0.60 () {58 vars in 967 bytes} [Sun Jul 31 01:57:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:57:29.311991 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d485a7-fc14-4793-af3e-dfc3591e6f1b service cinder] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:57:29.324049 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d485a7-fc14-4793-af3e-dfc3591e6f1b service cinder] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:57:29.330180 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64c52a-0e4a-424b-915e-3428d174bdbe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c8c98c1e2d24de89c7d07753fae02e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:57:29.330794 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64c52a-0e4a-424b-915e-3428d174bdbe service swift] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:57:29.331068 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64c52a-0e4a-424b-915e-3428d174bdbe service swift] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:57:29.331338 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64c52a-0e4a-424b-915e-3428d174bdbe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:57:29.340130 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd64c52a-0e4a-424b-915e-3428d174bdbe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:57:29.341734 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd64c52a-0e4a-424b-915e-3428d174bdbe service swift] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:57:29.350770 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1404/2839] 10.222.0.60 () {60 vars in 1384 bytes} [Sun Jul 31 01:57:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 01:57:29.740303 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71165106-b32b-41da-9169-a491caa02c47 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:57:29.750008 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71165106-b32b-41da-9169-a491caa02c47 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:57:29.754052 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2748f1-9915-4507-8fbc-108dda533083 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:57:29.754770 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2748f1-9915-4507-8fbc-108dda533083 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:57:29.755063 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2748f1-9915-4507-8fbc-108dda533083 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:57:29.755328 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2748f1-9915-4507-8fbc-108dda533083 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:57:29.816019 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2748f1-9915-4507-8fbc-108dda533083 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:57:29.817508 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2748f1-9915-4507-8fbc-108dda533083 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:57:29.826977 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1436/2840] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:57:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:57:33.051899 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64c52a-0e4a-424b-915e-3428d174bdbe service swift] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:57:33.054015 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-bd64c52a-0e4a-424b-915e-3428d174bdbe service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:57:33.081017 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64c52a-0e4a-424b-915e-3428d174bdbe service swift] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:57:33.096267 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9bd90-8718-4abe-b49e-0b96f5dd7a0e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:57:33.097130 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9bd90-8718-4abe-b49e-0b96f5dd7a0e service placement] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:57:33.097453 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9bd90-8718-4abe-b49e-0b96f5dd7a0e service placement] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:57:33.097835 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9bd90-8718-4abe-b49e-0b96f5dd7a0e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:57:33.100435 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-e3e9bd90-8718-4abe-b49e-0b96f5dd7a0e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:57:33.123921 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e9bd90-8718-4abe-b49e-0b96f5dd7a0e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:57:33.124755 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e9bd90-8718-4abe-b49e-0b96f5dd7a0e service placement] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:57:33.138656 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1405/2841] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:57:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:57:36.315515 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2748f1-9915-4507-8fbc-108dda533083 service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:57:36.328578 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2748f1-9915-4507-8fbc-108dda533083 service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:57:36.333971 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9e7f2-8c30-4dfd-985d-1d679906d8c6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:57:36.334590 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9e7f2-8c30-4dfd-985d-1d679906d8c6 service placement] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:57:36.334887 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9e7f2-8c30-4dfd-985d-1d679906d8c6 service placement] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:57:36.335161 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9e7f2-8c30-4dfd-985d-1d679906d8c6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:57:36.337005 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-3da9e7f2-8c30-4dfd-985d-1d679906d8c6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:57:36.349928 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da9e7f2-8c30-4dfd-985d-1d679906d8c6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:57:36.351684 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da9e7f2-8c30-4dfd-985d-1d679906d8c6 service placement] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:57:36.365327 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1437/2842] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:57:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:57:36.381509 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9bd90-8718-4abe-b49e-0b96f5dd7a0e service placement] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:57:36.392143 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9bd90-8718-4abe-b49e-0b96f5dd7a0e service placement] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:57:36.397778 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d92334-9f67-4db3-b4ff-78d7a3ae18c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:57:36.398427 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d92334-9f67-4db3-b4ff-78d7a3ae18c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:57:36.398725 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d92334-9f67-4db3-b4ff-78d7a3ae18c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:57:36.398980 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d92334-9f67-4db3-b4ff-78d7a3ae18c1 admin admin] PATH_INFO: `/v3/users/e3f7dfd1a9a843c8969cf620a191143e` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:57:36.400178 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d92334-9f67-4db3-b4ff-78d7a3ae18c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3f7dfd1a9a843c8969cf620a191143e)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:57:36.402069 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d92334-9f67-4db3-b4ff-78d7a3ae18c1 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:57:36.455713 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-33d92334-9f67-4db3-b4ff-78d7a3ae18c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3f7dfd1a9a843c8969cf620a191143e'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:57:36.456360 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-33d92334-9f67-4db3-b4ff-78d7a3ae18c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3f7dfd1a9a843c8969cf620a191143e'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:57:36.468009 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-33d92334-9f67-4db3-b4ff-78d7a3ae18c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3f7dfd1a9a843c8969cf620a191143e'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:57:36.476820 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-33d92334-9f67-4db3-b4ff-78d7a3ae18c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3f7dfd1a9a843c8969cf620a191143e'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:57:36.477860 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-33d92334-9f67-4db3-b4ff-78d7a3ae18c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3f7dfd1a9a843c8969cf620a191143e'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:57:36.497397 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1406/2843] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:57:36 2022] DELETE /identity/v3/users/e3f7dfd1a9a843c8969cf620a191143e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:57:36.682514 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9e7f2-8c30-4dfd-985d-1d679906d8c6 service placement] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:57:36.694903 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9e7f2-8c30-4dfd-985d-1d679906d8c6 service placement] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:57:36.752629 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71279e-8501-486b-9c9c-1036ef507156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:57:36.753272 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71279e-8501-486b-9c9c-1036ef507156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:57:36.753552 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71279e-8501-486b-9c9c-1036ef507156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:57:36.753816 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71279e-8501-486b-9c9c-1036ef507156 admin admin] PATH_INFO: `/v3/projects/80ae8986beb2493fa4ab1c916ca805fd` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:57:36.755104 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e71279e-8501-486b-9c9c-1036ef507156 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80ae8986beb2493fa4ab1c916ca805fd)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:57:36.757055 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e71279e-8501-486b-9c9c-1036ef507156 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:57:36.805877 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-8e71279e-8501-486b-9c9c-1036ef507156 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80ae8986beb2493fa4ab1c916ca805fd', 'request_id': 'req-8e71279e-8501-486b-9c9c-1036ef507156'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:57:36.811457 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-8e71279e-8501-486b-9c9c-1036ef507156 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80ae8986beb2493fa4ab1c916ca805fd', 'request_id': 'req-8e71279e-8501-486b-9c9c-1036ef507156'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:57:36.817636 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-8e71279e-8501-486b-9c9c-1036ef507156 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80ae8986beb2493fa4ab1c916ca805fd', 'request_id': 'req-8e71279e-8501-486b-9c9c-1036ef507156'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:57:36.831761 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-8e71279e-8501-486b-9c9c-1036ef507156 admin admin] The token cache is being invalidate because project 80ae8986beb2493fa4ab1c916ca805fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:57:36.832053 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-8e71279e-8501-486b-9c9c-1036ef507156 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:57:36.832849 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-8e71279e-8501-486b-9c9c-1036ef507156 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:57:36.834395 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1438/2844] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:57:36 2022] DELETE /identity/v3/projects/80ae8986beb2493fa4ab1c916ca805fd => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:57:36.838630 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d92334-9f67-4db3-b4ff-78d7a3ae18c1 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:57:36.840126 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-33d92334-9f67-4db3-b4ff-78d7a3ae18c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:57:36.853490 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d92334-9f67-4db3-b4ff-78d7a3ae18c1 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:57:36.880130 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:57:36.912433 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d7776-b4f1-42fe-a464-db0ce15c3048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:57:36.913080 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d7776-b4f1-42fe-a464-db0ce15c3048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:57:36.913358 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d7776-b4f1-42fe-a464-db0ce15c3048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:57:36.913629 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d7776-b4f1-42fe-a464-db0ce15c3048 admin admin] PATH_INFO: `/v3/users/792626582cb64aa1aad3262b3f4f9990` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:57:36.915004 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d7776-b4f1-42fe-a464-db0ce15c3048 admin admin] RBAC: Authorizing `identity:delete_user(user_id=792626582cb64aa1aad3262b3f4f9990)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:57:36.916997 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d7776-b4f1-42fe-a464-db0ce15c3048 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:57:36.965642 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-3e0d7776-b4f1-42fe-a464-db0ce15c3048 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '792626582cb64aa1aad3262b3f4f9990'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:57:36.966297 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-3e0d7776-b4f1-42fe-a464-db0ce15c3048 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '792626582cb64aa1aad3262b3f4f9990'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:57:36.978095 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-3e0d7776-b4f1-42fe-a464-db0ce15c3048 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '792626582cb64aa1aad3262b3f4f9990'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:57:36.986674 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-3e0d7776-b4f1-42fe-a464-db0ce15c3048 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '792626582cb64aa1aad3262b3f4f9990'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:57:36.987682 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-3e0d7776-b4f1-42fe-a464-db0ce15c3048 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '792626582cb64aa1aad3262b3f4f9990'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:57:37.006216 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1407/2845] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 01:57:36 2022] DELETE /identity/v3/users/792626582cb64aa1aad3262b3f4f9990 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:57:37.191646 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71279e-8501-486b-9c9c-1036ef507156 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:57:37.193245 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-8e71279e-8501-486b-9c9c-1036ef507156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:57:37.202393 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:57:37.206521 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71279e-8501-486b-9c9c-1036ef507156 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:57:37.268975 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87a24f-f0aa-4cff-9193-daec1ea85674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:57:37.269541 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87a24f-f0aa-4cff-9193-daec1ea85674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:57:37.269814 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87a24f-f0aa-4cff-9193-daec1ea85674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:57:37.270096 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87a24f-f0aa-4cff-9193-daec1ea85674 admin admin] PATH_INFO: `/v3/projects/eb84a4c6eb344bd89b0d2effee36dc81` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:57:37.271253 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f87a24f-f0aa-4cff-9193-daec1ea85674 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb84a4c6eb344bd89b0d2effee36dc81)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:57:37.273235 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f87a24f-f0aa-4cff-9193-daec1ea85674 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:57:37.321251 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-5f87a24f-f0aa-4cff-9193-daec1ea85674 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb84a4c6eb344bd89b0d2effee36dc81', 'request_id': 'req-5f87a24f-f0aa-4cff-9193-daec1ea85674'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:57:37.327011 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-5f87a24f-f0aa-4cff-9193-daec1ea85674 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb84a4c6eb344bd89b0d2effee36dc81', 'request_id': 'req-5f87a24f-f0aa-4cff-9193-daec1ea85674'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:57:37.333759 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-5f87a24f-f0aa-4cff-9193-daec1ea85674 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb84a4c6eb344bd89b0d2effee36dc81', 'request_id': 'req-5f87a24f-f0aa-4cff-9193-daec1ea85674'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:57:37.348242 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-5f87a24f-f0aa-4cff-9193-daec1ea85674 admin admin] The token cache is being invalidate because project eb84a4c6eb344bd89b0d2effee36dc81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:57:37.348521 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-5f87a24f-f0aa-4cff-9193-daec1ea85674 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:57:37.349152 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-5f87a24f-f0aa-4cff-9193-daec1ea85674 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:57:37.350669 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1439/2846] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 01:57:37 2022] DELETE /identity/v3/projects/eb84a4c6eb344bd89b0d2effee36dc81 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:57:37.356088 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bcd64-03fb-41a4-8f6d-627a0fe2d367 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:57:37.356369 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bcd64-03fb-41a4-8f6d-627a0fe2d367 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:57:37.356660 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bcd64-03fb-41a4-8f6d-627a0fe2d367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:57:37.378360 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-d86bcd64-03fb-41a4-8f6d-627a0fe2d367 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:57:37.379608 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-d86bcd64-03fb-41a4-8f6d-627a0fe2d367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:57:37.441373 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1408/2847] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:57:37.450406 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162fb63-430d-4ef2-8784-70ff620d18a9 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:57:37.450684 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162fb63-430d-4ef2-8784-70ff620d18a9 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:57:37.450947 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162fb63-430d-4ef2-8784-70ff620d18a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:57:37.471798 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-9162fb63-430d-4ef2-8784-70ff620d18a9 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:57:37.472995 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-9162fb63-430d-4ef2-8784-70ff620d18a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:57:37.482057 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1440/2848] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:57:37.487530 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86bcd64-03fb-41a4-8f6d-627a0fe2d367 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:57:37.498696 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86bcd64-03fb-41a4-8f6d-627a0fe2d367 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:57:37.504638 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f1e5e-449f-4266-9e9b-4666dd4d7a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:57:37.505256 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f1e5e-449f-4266-9e9b-4666dd4d7a33 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:57:37.505529 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f1e5e-449f-4266-9e9b-4666dd4d7a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:57:37.505768 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f1e5e-449f-4266-9e9b-4666dd4d7a33 admin admin] PATH_INFO: `/v3/domains` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:57:37.506517 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f1e5e-449f-4266-9e9b-4666dd4d7a33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:57:37.506815 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f1e5e-449f-4266-9e9b-4666dd4d7a33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:57:37.508513 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f1e5e-449f-4266-9e9b-4666dd4d7a33 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:57:37.521033 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1409/2849] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 01:57:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:57:37.525412 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162fb63-430d-4ef2-8784-70ff620d18a9 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:57:37.535015 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162fb63-430d-4ef2-8784-70ff620d18a9 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:57:37.540205 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779bcb96-5764-4754-88ea-3c7551a7f42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:57:37.540814 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779bcb96-5764-4754-88ea-3c7551a7f42b admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:57:37.541085 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779bcb96-5764-4754-88ea-3c7551a7f42b admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:57:37.541377 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779bcb96-5764-4754-88ea-3c7551a7f42b admin admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:57:37.542005 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779bcb96-5764-4754-88ea-3c7551a7f42b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:57:37.543920 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779bcb96-5764-4754-88ea-3c7551a7f42b admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:57:37.582715 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1441/2850] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:57:37 2022] POST /identity/v3/projects => generated 391 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:57:37.587000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f1e5e-449f-4266-9e9b-4666dd4d7a33 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:57:37.597550 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f1e5e-449f-4266-9e9b-4666dd4d7a33 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:57:37.632513 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:57:37.658241 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87425d43-d818-42ba-a9c0-55c47b2047d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:57:37.658866 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87425d43-d818-42ba-a9c0-55c47b2047d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:57:37.659144 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87425d43-d818-42ba-a9c0-55c47b2047d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:57:37.659417 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87425d43-d818-42ba-a9c0-55c47b2047d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:57:37.660121 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87425d43-d818-42ba-a9c0-55c47b2047d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:57:37.662038 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87425d43-d818-42ba-a9c0-55c47b2047d7 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:57:37.688091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1410/2851] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:57:37 2022] POST /identity/v3/users => generated 296 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:57:37.692497 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779bcb96-5764-4754-88ea-3c7551a7f42b admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:57:37.705449 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779bcb96-5764-4754-88ea-3c7551a7f42b admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:57:37.710810 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b38614-7c29-416f-93d5-469479e1ce45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:57:37.711443 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b38614-7c29-416f-93d5-469479e1ce45 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:57:37.711745 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b38614-7c29-416f-93d5-469479e1ce45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:57:37.712013 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b38614-7c29-416f-93d5-469479e1ce45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:57:37.712706 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b38614-7c29-416f-93d5-469479e1ce45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:57:37.714295 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b38614-7c29-416f-93d5-469479e1ce45 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:57:37.724654 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1442/2852] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:57:37.728915 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87425d43-d818-42ba-a9c0-55c47b2047d7 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:57:37.740160 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87425d43-d818-42ba-a9c0-55c47b2047d7 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:57:37.745800 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2926d6-cb04-4e2d-b770-e8a23790bfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:57:37.746419 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2926d6-cb04-4e2d-b770-e8a23790bfd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:57:37.746694 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2926d6-cb04-4e2d-b770-e8a23790bfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:57:37.746960 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2926d6-cb04-4e2d-b770-e8a23790bfd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:57:37.747693 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2926d6-cb04-4e2d-b770-e8a23790bfd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:57:37.749291 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2926d6-cb04-4e2d-b770-e8a23790bfd1 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:57:37.762222 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1411/2853] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:57:37.768202 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b38614-7c29-416f-93d5-469479e1ce45 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:57:37.784445 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b38614-7c29-416f-93d5-469479e1ce45 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:57:37.790785 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023c047-50e8-4e9c-96ae-0a4f3ff86064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:57:37.791454 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023c047-50e8-4e9c-96ae-0a4f3ff86064 admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:57:37.791762 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023c047-50e8-4e9c-96ae-0a4f3ff86064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:57:37.792036 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023c047-50e8-4e9c-96ae-0a4f3ff86064 admin admin] PATH_INFO: `/v3/projects/7a246a705d884e639f273a22b2d2e689/users/e18a97d6876e48a9a6ceb122e1b1083d/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:57:37.808071 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023c047-50e8-4e9c-96ae-0a4f3ff86064 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a246a705d884e639f273a22b2d2e689, user_id=e18a97d6876e48a9a6ceb122e1b1083d, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:57:37.810775 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023c047-50e8-4e9c-96ae-0a4f3ff86064 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:57:37.825854 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1443/2854] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:57:37 2022] PUT /identity/v3/projects/7a246a705d884e639f273a22b2d2e689/users/e18a97d6876e48a9a6ceb122e1b1083d/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:57:37.836090 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b179d80-4e16-4efd-b561-4de104fe0203 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:57:37.836380 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b179d80-4e16-4efd-b561-4de104fe0203 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:57:37.836654 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b179d80-4e16-4efd-b561-4de104fe0203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:57:37.865131 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-6b179d80-4e16-4efd-b561-4de104fe0203 None None] MFA Rules not processed for user `e18a97d6876e48a9a6ceb122e1b1083d`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:57:37.866347 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-6b179d80-4e16-4efd-b561-4de104fe0203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:57:37.947412 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1412/2855] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:57:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:57:37.954016 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023c047-50e8-4e9c-96ae-0a4f3ff86064 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:57:37.983464 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:57:38.022800 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023c047-50e8-4e9c-96ae-0a4f3ff86064 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:57:38.027762 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42329ea-c3a1-40eb-a0f5-c06e740dff00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:57:38.028372 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42329ea-c3a1-40eb-a0f5-c06e740dff00 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:57:38.028650 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42329ea-c3a1-40eb-a0f5-c06e740dff00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:57:38.028922 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42329ea-c3a1-40eb-a0f5-c06e740dff00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:57:38.029571 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42329ea-c3a1-40eb-a0f5-c06e740dff00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:57:38.031501 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42329ea-c3a1-40eb-a0f5-c06e740dff00 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:57:38.059785 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1444/2856] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 01:57:37 2022] POST /identity/v3/projects => generated 391 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:57:38.063911 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b179d80-4e16-4efd-b561-4de104fe0203 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:57:38.074774 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b179d80-4e16-4efd-b561-4de104fe0203 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:57:38.134273 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ae3aa-4e27-451e-8f8d-fc607993a6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:57:38.134891 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ae3aa-4e27-451e-8f8d-fc607993a6a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:57:38.135149 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ae3aa-4e27-451e-8f8d-fc607993a6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:57:38.135414 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ae3aa-4e27-451e-8f8d-fc607993a6a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:57:38.136091 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0ae3aa-4e27-451e-8f8d-fc607993a6a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:57:38.137991 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0ae3aa-4e27-451e-8f8d-fc607993a6a4 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:57:38.160758 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1413/2857] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 01:57:38 2022] POST /identity/v3/users => generated 302 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:57:38.164834 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42329ea-c3a1-40eb-a0f5-c06e740dff00 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:57:38.175142 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42329ea-c3a1-40eb-a0f5-c06e740dff00 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:57:38.180480 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f0771-bb16-4503-bdce-e71897292dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:57:38.180940 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f0771-bb16-4503-bdce-e71897292dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:57:38.181190 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f0771-bb16-4503-bdce-e71897292dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:57:38.181478 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f0771-bb16-4503-bdce-e71897292dd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:57:38.182161 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764f0771-bb16-4503-bdce-e71897292dd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:57:38.183814 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764f0771-bb16-4503-bdce-e71897292dd4 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:57:38.194336 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1445/2858] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:57:38.198430 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ae3aa-4e27-451e-8f8d-fc607993a6a4 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:57:38.208941 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ae3aa-4e27-451e-8f8d-fc607993a6a4 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:57:38.214698 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee844a-85c9-4784-8a4d-ab61bf161e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:57:38.215394 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee844a-85c9-4784-8a4d-ab61bf161e57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:57:38.215684 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee844a-85c9-4784-8a4d-ab61bf161e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:57:38.215967 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee844a-85c9-4784-8a4d-ab61bf161e57 admin admin] PATH_INFO: `/v3/projects/00036b5a52ec46a89e75e943291b55e1/users/655f62fc64bb4e2c85ea4baedab88674/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:57:38.231166 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ee844a-85c9-4784-8a4d-ab61bf161e57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00036b5a52ec46a89e75e943291b55e1, user_id=655f62fc64bb4e2c85ea4baedab88674, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:57:38.233869 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ee844a-85c9-4784-8a4d-ab61bf161e57 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:57:38.249905 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1414/2859] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:57:38 2022] PUT /identity/v3/projects/00036b5a52ec46a89e75e943291b55e1/users/655f62fc64bb4e2c85ea4baedab88674/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:57:38.254013 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f0771-bb16-4503-bdce-e71897292dd4 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:57:38.264045 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f0771-bb16-4503-bdce-e71897292dd4 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:57:38.323749 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830878b9-1697-4040-83c0-b2ab231db03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:57:38.324458 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830878b9-1697-4040-83c0-b2ab231db03f admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:57:38.324552 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830878b9-1697-4040-83c0-b2ab231db03f admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:57:38.324778 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830878b9-1697-4040-83c0-b2ab231db03f admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:57:38.325471 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830878b9-1697-4040-83c0-b2ab231db03f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:57:38.327052 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830878b9-1697-4040-83c0-b2ab231db03f admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:57:38.337330 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1446/2860] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 01:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:57:38.341626 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee844a-85c9-4784-8a4d-ab61bf161e57 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:57:38.351862 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee844a-85c9-4784-8a4d-ab61bf161e57 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:57:38.357062 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4177a9-a9fb-4370-8ad1-8f973ffb1b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:57:38.357751 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4177a9-a9fb-4370-8ad1-8f973ffb1b8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:57:38.358030 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4177a9-a9fb-4370-8ad1-8f973ffb1b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:57:38.358304 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4177a9-a9fb-4370-8ad1-8f973ffb1b8e admin admin] PATH_INFO: `/v3/projects/00036b5a52ec46a89e75e943291b55e1/users/655f62fc64bb4e2c85ea4baedab88674/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:57:38.360346 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4177a9-a9fb-4370-8ad1-8f973ffb1b8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=00036b5a52ec46a89e75e943291b55e1, user_id=655f62fc64bb4e2c85ea4baedab88674, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:57:38.363520 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4177a9-a9fb-4370-8ad1-8f973ffb1b8e admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:57:38.367319 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:57:38.376711 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1415/2861] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 01:57:38 2022] PUT /identity/v3/projects/00036b5a52ec46a89e75e943291b55e1/users/655f62fc64bb4e2c85ea4baedab88674/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:57:38.386639 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b8eae-d3b3-4b15-9733-543d1913b317 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:57:38.386923 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b8eae-d3b3-4b15-9733-543d1913b317 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:57:38.387192 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b8eae-d3b3-4b15-9733-543d1913b317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:57:38.415998 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-d09b8eae-d3b3-4b15-9733-543d1913b317 None None] MFA Rules not processed for user `655f62fc64bb4e2c85ea4baedab88674`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:57:38.417333 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-d09b8eae-d3b3-4b15-9733-543d1913b317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:57:38.487036 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1447/2862] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:57:38 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:57:38.500747 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4177a9-a9fb-4370-8ad1-8f973ffb1b8e admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:57:38.502784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-bd4177a9-a9fb-4370-8ad1-8f973ffb1b8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:57:38.590775 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4177a9-a9fb-4370-8ad1-8f973ffb1b8e admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:57:38.596850 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d357005c-963f-480f-9ffd-a51446375984 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:57:38.597463 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357005c-963f-480f-9ffd-a51446375984 service nova] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:57:38.597741 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357005c-963f-480f-9ffd-a51446375984 service nova] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:57:38.598011 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357005c-963f-480f-9ffd-a51446375984 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:57:38.667646 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d357005c-963f-480f-9ffd-a51446375984 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:57:38.669259 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d357005c-963f-480f-9ffd-a51446375984 service nova] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:57:38.678371 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1416/2863] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:57:38 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:57:41.806969 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b8eae-d3b3-4b15-9733-543d1913b317 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:57:41.808532 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-d09b8eae-d3b3-4b15-9733-543d1913b317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:57:41.832132 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:57:41.883657 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b8eae-d3b3-4b15-9733-543d1913b317 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:57:41.887798 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc050b0-696f-497b-b976-cbed3fee3a2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:57:41.888420 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc050b0-696f-497b-b976-cbed3fee3a2c service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:57:41.888710 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc050b0-696f-497b-b976-cbed3fee3a2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:57:41.888988 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc050b0-696f-497b-b976-cbed3fee3a2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:57:41.899951 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc050b0-696f-497b-b976-cbed3fee3a2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:57:41.901424 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc050b0-696f-497b-b976-cbed3fee3a2c service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:57:41.912800 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1448/2864] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:57:41 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:57:44.557443 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6dfc26-59ed-4c24-8c4a-d77690c328cb None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:57:44.557964 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6dfc26-59ed-4c24-8c4a-d77690c328cb None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:57:44.558194 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6dfc26-59ed-4c24-8c4a-d77690c328cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:57:44.581405 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-3f6dfc26-59ed-4c24-8c4a-d77690c328cb None None] MFA Rules not processed for user `e18a97d6876e48a9a6ceb122e1b1083d`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:57:44.582486 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-3f6dfc26-59ed-4c24-8c4a-d77690c328cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:57:44.590905 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1417/2865] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:57:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:57:44.950372 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc050b0-696f-497b-b976-cbed3fee3a2c service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:57:44.952423 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-5dc050b0-696f-497b-b976-cbed3fee3a2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:57:44.966994 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc050b0-696f-497b-b976-cbed3fee3a2c service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:57:44.972267 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3effe190-0232-4ef9-b537-408f7f4707ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:57:44.973619 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3effe190-0232-4ef9-b537-408f7f4707ea service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:57:44.974121 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3effe190-0232-4ef9-b537-408f7f4707ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:57:44.974569 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3effe190-0232-4ef9-b537-408f7f4707ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:57:44.976955 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-3effe190-0232-4ef9-b537-408f7f4707ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:57:44.990324 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3effe190-0232-4ef9-b537-408f7f4707ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:57:44.991866 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3effe190-0232-4ef9-b537-408f7f4707ea service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:57:45.005397 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1449/2866] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:57:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:57:52.805253 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6dfc26-59ed-4c24-8c4a-d77690c328cb None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:57:52.806823 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-3f6dfc26-59ed-4c24-8c4a-d77690c328cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:57:52.823858 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6dfc26-59ed-4c24-8c4a-d77690c328cb None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:57:52.829663 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad980c-e8cf-4f21-99c3-b0e09e931e7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:57:52.830288 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad980c-e8cf-4f21-99c3-b0e09e931e7a service nova] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:57:52.830566 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad980c-e8cf-4f21-99c3-b0e09e931e7a service nova] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:57:52.830834 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad980c-e8cf-4f21-99c3-b0e09e931e7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:57:52.832751 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-50ad980c-e8cf-4f21-99c3-b0e09e931e7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:57:52.845346 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad980c-e8cf-4f21-99c3-b0e09e931e7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:57:52.846924 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad980c-e8cf-4f21-99c3-b0e09e931e7a service nova] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:57:52.857788 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1418/2867] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:57:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:57:54.997725 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=29 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:58:02.853620 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=72 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:58:37.047322 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3effe190-0232-4ef9-b537-408f7f4707ea service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:58:37.062321 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3effe190-0232-4ef9-b537-408f7f4707ea service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:58:37.068400 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297163f-e105-4d9c-aca3-3381c4bba481 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:58:37.069134 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297163f-e105-4d9c-aca3-3381c4bba481 service nova] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:58:37.069431 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297163f-e105-4d9c-aca3-3381c4bba481 service nova] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:58:37.069701 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297163f-e105-4d9c-aca3-3381c4bba481 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:58:37.071967 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-2297163f-e105-4d9c-aca3-3381c4bba481 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:58:37.085882 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2297163f-e105-4d9c-aca3-3381c4bba481 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:58:37.087513 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2297163f-e105-4d9c-aca3-3381c4bba481 service nova] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:58:37.099685 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1450/2868] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 01:58:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:58:47.095395 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=6 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:58:49.153224 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e696d74a-a2ff-431d-9873-81c58412c3ea None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:58:49.154662 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e696d74a-a2ff-431d-9873-81c58412c3ea None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:58:49.155114 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e696d74a-a2ff-431d-9873-81c58412c3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:58:49.177939 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-e696d74a-a2ff-431d-9873-81c58412c3ea None None] MFA Rules not processed for user `e18a97d6876e48a9a6ceb122e1b1083d`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:58:49.179372 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-e696d74a-a2ff-431d-9873-81c58412c3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:58:49.187087 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1419/2869] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 01:58:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:58:59.172185 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=3 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:00:04.270621 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297163f-e105-4d9c-aca3-3381c4bba481 service nova] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:00:04.272902 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-2297163f-e105-4d9c-aca3-3381c4bba481 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:00:04.351430 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297163f-e105-4d9c-aca3-3381c4bba481 service nova] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:00:04.356878 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ebfd76-0f11-419e-9c83-baeda313ee42 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:00:04.357501 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebfd76-0f11-419e-9c83-baeda313ee42 service placement] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:00:04.357766 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebfd76-0f11-419e-9c83-baeda313ee42 service placement] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:00:04.358124 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebfd76-0f11-419e-9c83-baeda313ee42 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:00:04.360412 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-83ebfd76-0f11-419e-9c83-baeda313ee42 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:00:04.372281 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ebfd76-0f11-419e-9c83-baeda313ee42 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:00:04.374039 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ebfd76-0f11-419e-9c83-baeda313ee42 service placement] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:00:04.385157 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1451/2870] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:00:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:00:14.380851 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=32 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:00:24.197703 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e696d74a-a2ff-431d-9873-81c58412c3ea None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:00:24.211991 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e696d74a-a2ff-431d-9873-81c58412c3ea None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:00:24.217897 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f8ea1-c1c0-4e76-b549-3a1ccfd3dbcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:00:24.219535 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f8ea1-c1c0-4e76-b549-3a1ccfd3dbcd service nova] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:00:24.219535 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f8ea1-c1c0-4e76-b549-3a1ccfd3dbcd service nova] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:00:24.219535 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f8ea1-c1c0-4e76-b549-3a1ccfd3dbcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:00:24.221220 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-911f8ea1-c1c0-4e76-b549-3a1ccfd3dbcd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:00:24.237067 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911f8ea1-c1c0-4e76-b549-3a1ccfd3dbcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:00:24.238652 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911f8ea1-c1c0-4e76-b549-3a1ccfd3dbcd service nova] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:00:24.250618 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1420/2871] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:00:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:00:34.245989 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=6 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:00:36.685435 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa7bb0-aa8d-458a-96aa-b7a1bf60498f None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:00:36.685919 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa7bb0-aa8d-458a-96aa-b7a1bf60498f None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:00:36.686024 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa7bb0-aa8d-458a-96aa-b7a1bf60498f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:00:36.706289 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-6aaa7bb0-aa8d-458a-96aa-b7a1bf60498f None None] MFA Rules not processed for user `e18a97d6876e48a9a6ceb122e1b1083d`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 02:00:36.707538 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-6aaa7bb0-aa8d-458a-96aa-b7a1bf60498f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:00:36.714589 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1452/2872] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 02:00:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 02:00:46.701386 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:01:18.632233 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2323e3-8d1d-4fb4-b14f-5a0de745009a None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:01:18.633422 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2323e3-8d1d-4fb4-b14f-5a0de745009a None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:01:18.633703 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2323e3-8d1d-4fb4-b14f-5a0de745009a None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:01:18.635331 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1421/2873] 10.222.0.60 () {54 vars in 921 bytes} [Sun Jul 31 02:01:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 02:01:18.641584 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48db95-5316-4c33-aff4-569295fae306 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:01:18.642126 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48db95-5316-4c33-aff4-569295fae306 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:01:18.642256 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48db95-5316-4c33-aff4-569295fae306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:01:18.700344 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-dc48db95-5316-4c33-aff4-569295fae306 None None] MFA Rules not processed for user `81117154f6d1474c805a69c5617c307d`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 02:01:18.701585 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-dc48db95-5316-4c33-aff4-569295fae306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:01:18.708793 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1453/2874] 10.222.0.60 () {58 vars in 1018 bytes} [Sun Jul 31 02:01:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 02:01:18.721412 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2323e3-8d1d-4fb4-b14f-5a0de745009a None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:01:18.733673 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2323e3-8d1d-4fb4-b14f-5a0de745009a None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:01:18.737679 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8409f-f22d-466d-9ada-1d610a396d47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:01:18.738301 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8409f-f22d-466d-9ada-1d610a396d47 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:01:18.738586 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8409f-f22d-466d-9ada-1d610a396d47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:01:18.738849 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8409f-f22d-466d-9ada-1d610a396d47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:01:18.746612 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8409f-f22d-466d-9ada-1d610a396d47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:01:18.748076 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8409f-f22d-466d-9ada-1d610a396d47 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:01:18.757018 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1422/2875] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:01:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:01:19.196450 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac3011-dfc0-46bc-9809-029e634f7be9 None None] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:01:19.196705 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac3011-dfc0-46bc-9809-029e634f7be9 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:01:19.197031 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac3011-dfc0-46bc-9809-029e634f7be9 None None] PATH_INFO: `/` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:01:19.199161 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1454/2876] 10.222.0.60 () {54 vars in 921 bytes} [Sun Jul 31 02:01:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 02:01:19.203937 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb49a6-5d3f-48ac-8e7a-c5db6566d557 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:01:19.204227 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb49a6-5d3f-48ac-8e7a-c5db6566d557 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:01:19.204490 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb49a6-5d3f-48ac-8e7a-c5db6566d557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:01:19.244572 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-adfb49a6-5d3f-48ac-8e7a-c5db6566d557 None None] MFA Rules not processed for user `657a3f73879e4b31b70a1c4f73e80f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 02:01:19.245784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-adfb49a6-5d3f-48ac-8e7a-c5db6566d557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:01:19.254854 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1423/2877] 10.222.0.60 () {58 vars in 1018 bytes} [Sun Jul 31 02:01:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 02:01:19.275880 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac3011-dfc0-46bc-9809-029e634f7be9 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:01:19.291605 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac3011-dfc0-46bc-9809-029e634f7be9 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:01:19.297151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733bf537-b320-4a23-b265-838f43305f43 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:01:19.297762 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bf537-b320-4a23-b265-838f43305f43 service placement] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:01:19.298039 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bf537-b320-4a23-b265-838f43305f43 service placement] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:01:19.298309 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bf537-b320-4a23-b265-838f43305f43 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:01:19.311137 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733bf537-b320-4a23-b265-838f43305f43 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:01:19.312773 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733bf537-b320-4a23-b265-838f43305f43 service placement] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:01:19.323760 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1455/2878] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:01:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:01:19.525214 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb49a6-5d3f-48ac-8e7a-c5db6566d557 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:01:19.534949 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb49a6-5d3f-48ac-8e7a-c5db6566d557 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:01:19.538717 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f218d1c5-4f77-4372-8090-12cbad9ecdaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:01:19.539345 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218d1c5-4f77-4372-8090-12cbad9ecdaf service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:01:19.539650 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218d1c5-4f77-4372-8090-12cbad9ecdaf service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:01:19.539920 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218d1c5-4f77-4372-8090-12cbad9ecdaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:01:19.541691 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-f218d1c5-4f77-4372-8090-12cbad9ecdaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:01:19.555619 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f218d1c5-4f77-4372-8090-12cbad9ecdaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:01:19.557092 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f218d1c5-4f77-4372-8090-12cbad9ecdaf service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:01:19.569522 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1424/2879] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:01:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:01:19.632992 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733bf537-b320-4a23-b265-838f43305f43 service placement] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:01:19.642073 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733bf537-b320-4a23-b265-838f43305f43 service placement] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:01:19.648036 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a46a8-4967-48a4-9e42-6ac596b874dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:01:19.648650 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a46a8-4967-48a4-9e42-6ac596b874dc service placement] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:01:19.648933 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a46a8-4967-48a4-9e42-6ac596b874dc service placement] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:01:19.649198 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a46a8-4967-48a4-9e42-6ac596b874dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:01:19.651164 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-378a46a8-4967-48a4-9e42-6ac596b874dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:01:19.663455 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378a46a8-4967-48a4-9e42-6ac596b874dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:01:19.665086 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378a46a8-4967-48a4-9e42-6ac596b874dc service placement] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:01:19.675169 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1456/2880] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:01:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:01:29.564604 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=21 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:01:29.670895 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=25 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:02:07.785164 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f218d1c5-4f77-4372-8090-12cbad9ecdaf service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:02:07.801503 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f218d1c5-4f77-4372-8090-12cbad9ecdaf service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:02:07.806003 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72bed31-b019-4550-9269-72220970d1a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:02:07.806642 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bed31-b019-4550-9269-72220970d1a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:02:07.806959 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bed31-b019-4550-9269-72220970d1a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:02:07.807198 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bed31-b019-4550-9269-72220970d1a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:02:07.809025 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-a72bed31-b019-4550-9269-72220970d1a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:02:07.820470 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72bed31-b019-4550-9269-72220970d1a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:02:07.822012 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72bed31-b019-4550-9269-72220970d1a0 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:02:07.831547 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1425/2881] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:02:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:02:17.827162 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=6 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:02:20.296301 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6817db-5beb-4c14-a1aa-63117ac0d34f None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:02:20.296780 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6817db-5beb-4c14-a1aa-63117ac0d34f None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:02:20.296900 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6817db-5beb-4c14-a1aa-63117ac0d34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:02:20.322279 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-ae6817db-5beb-4c14-a1aa-63117ac0d34f None None] MFA Rules not processed for user `e18a97d6876e48a9a6ceb122e1b1083d`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 02:02:20.323407 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-ae6817db-5beb-4c14-a1aa-63117ac0d34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:02:20.330771 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1457/2882] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 02:02:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 02:02:20.672914 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72bed31-b019-4550-9269-72220970d1a0 service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:02:20.684039 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72bed31-b019-4550-9269-72220970d1a0 service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:02:20.689403 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b84450-15c2-4d4f-8b4f-0775e9822459 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:02:20.690456 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b84450-15c2-4d4f-8b4f-0775e9822459 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:02:20.690812 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b84450-15c2-4d4f-8b4f-0775e9822459 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:02:20.691149 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b84450-15c2-4d4f-8b4f-0775e9822459 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:02:20.693456 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-03b84450-15c2-4d4f-8b4f-0775e9822459 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:02:20.706690 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b84450-15c2-4d4f-8b4f-0775e9822459 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:02:20.708415 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b84450-15c2-4d4f-8b4f-0775e9822459 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:02:20.719764 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1426/2883] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:02:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:02:21.128182 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6817db-5beb-4c14-a1aa-63117ac0d34f None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:02:21.138886 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6817db-5beb-4c14-a1aa-63117ac0d34f None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:02:21.142487 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6056d4-6076-4e65-8e8f-a3fff15764d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:02:21.143113 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6056d4-6076-4e65-8e8f-a3fff15764d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:02:21.143587 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6056d4-6076-4e65-8e8f-a3fff15764d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:02:21.143856 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6056d4-6076-4e65-8e8f-a3fff15764d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:02:21.145820 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-6d6056d4-6076-4e65-8e8f-a3fff15764d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:02:21.161793 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6056d4-6076-4e65-8e8f-a3fff15764d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:02:21.163235 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6056d4-6076-4e65-8e8f-a3fff15764d2 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:02:21.175832 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1458/2884] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:02:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:02:22.595619 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b84450-15c2-4d4f-8b4f-0775e9822459 service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:02:22.605278 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b84450-15c2-4d4f-8b4f-0775e9822459 service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:02:22.611383 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39873c52-5585-436e-bc9f-ddc781220ab8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:02:22.612079 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39873c52-5585-436e-bc9f-ddc781220ab8 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:02:22.612360 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39873c52-5585-436e-bc9f-ddc781220ab8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:02:22.612633 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39873c52-5585-436e-bc9f-ddc781220ab8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:02:22.614602 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-39873c52-5585-436e-bc9f-ddc781220ab8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:02:22.630820 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39873c52-5585-436e-bc9f-ddc781220ab8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:02:22.632298 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39873c52-5585-436e-bc9f-ddc781220ab8 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:02:22.644594 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1427/2885] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:02:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:02:31.170890 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=9 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:02:32.638976 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=12 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:02:55.533216 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6056d4-6076-4e65-8e8f-a3fff15764d2 service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:02:55.545183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6056d4-6076-4e65-8e8f-a3fff15764d2 service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:02:55.553150 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824bfd0-958f-41ab-b492-b71ac5ddb15e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:02:55.553985 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824bfd0-958f-41ab-b492-b71ac5ddb15e service nova] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:02:55.554261 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824bfd0-958f-41ab-b492-b71ac5ddb15e service nova] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:02:55.554522 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824bfd0-958f-41ab-b492-b71ac5ddb15e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:02:55.564649 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2824bfd0-958f-41ab-b492-b71ac5ddb15e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:02:55.566238 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2824bfd0-958f-41ab-b492-b71ac5ddb15e service nova] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:02:55.576179 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1459/2886] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:02:55 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:03:05.571590 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=6 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:03:57.260441 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39873c52-5585-436e-bc9f-ddc781220ab8 service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:03:57.275043 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39873c52-5585-436e-bc9f-ddc781220ab8 service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:03:57.282764 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7bc8f-52b8-442e-96c6-c586375e94bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:03:57.283426 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7bc8f-52b8-442e-96c6-c586375e94bc service nova] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:03:57.283716 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7bc8f-52b8-442e-96c6-c586375e94bc service nova] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:03:57.284006 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7bc8f-52b8-442e-96c6-c586375e94bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:03:57.294050 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a7bc8f-52b8-442e-96c6-c586375e94bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:03:57.295788 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a7bc8f-52b8-442e-96c6-c586375e94bc service nova] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:03:57.308299 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1428/2887] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:03:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:04:03.843327 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824bfd0-958f-41ab-b492-b71ac5ddb15e service nova] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:04:03.845363 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-2824bfd0-958f-41ab-b492-b71ac5ddb15e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:04:03.860492 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824bfd0-958f-41ab-b492-b71ac5ddb15e service nova] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:04:03.867981 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072db43d-9243-4b5c-86ae-61452cb21459 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:04:03.869267 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072db43d-9243-4b5c-86ae-61452cb21459 service placement] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:04:03.869553 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072db43d-9243-4b5c-86ae-61452cb21459 service placement] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:04:03.869823 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072db43d-9243-4b5c-86ae-61452cb21459 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:04:03.871700 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-072db43d-9243-4b5c-86ae-61452cb21459 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:04:03.884872 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072db43d-9243-4b5c-86ae-61452cb21459 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:04:03.886725 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072db43d-9243-4b5c-86ae-61452cb21459 service placement] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:04:03.900596 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1460/2888] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:04:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:04:07.097307 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7bc8f-52b8-442e-96c6-c586375e94bc service nova] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:04:07.107443 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7bc8f-52b8-442e-96c6-c586375e94bc service nova] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:04:07.112160 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727c17f-bc0a-4201-a637-ebfbdec72b06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:04:07.112974 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727c17f-bc0a-4201-a637-ebfbdec72b06 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:04:07.113342 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727c17f-bc0a-4201-a637-ebfbdec72b06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:04:07.113821 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727c17f-bc0a-4201-a637-ebfbdec72b06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:04:07.123658 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8727c17f-bc0a-4201-a637-ebfbdec72b06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:04:07.125160 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8727c17f-bc0a-4201-a637-ebfbdec72b06 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:04:07.136346 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1429/2889] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:04:07 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:04:10.383696 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40bad9-489b-48e2-b067-7cfc7a0bea3e None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:04:10.384327 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40bad9-489b-48e2-b067-7cfc7a0bea3e None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:04:10.384327 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40bad9-489b-48e2-b067-7cfc7a0bea3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:04:10.404506 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-cf40bad9-489b-48e2-b067-7cfc7a0bea3e None None] MFA Rules not processed for user `e18a97d6876e48a9a6ceb122e1b1083d`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 02:04:10.406697 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-cf40bad9-489b-48e2-b067-7cfc7a0bea3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:04:10.413790 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1461/2890] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 02:04:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 02:04:17.131904 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=12 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:04:18.533811 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727c17f-bc0a-4201-a637-ebfbdec72b06 service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:04:18.548828 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727c17f-bc0a-4201-a637-ebfbdec72b06 service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:04:18.554699 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f8776-5c36-437e-ac45-60b508a23497 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:04:18.555517 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f8776-5c36-437e-ac45-60b508a23497 service nova] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:04:18.555942 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f8776-5c36-437e-ac45-60b508a23497 service nova] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:04:18.556388 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f8776-5c36-437e-ac45-60b508a23497 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:04:18.566294 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f8776-5c36-437e-ac45-60b508a23497 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:04:18.568117 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f8776-5c36-437e-ac45-60b508a23497 service nova] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:04:18.590778 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1430/2891] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:04:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:04:20.398864 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=9 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:04:28.574578 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=6 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:05:04.474472 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf40bad9-489b-48e2-b067-7cfc7a0bea3e None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:05:04.498174 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf40bad9-489b-48e2-b067-7cfc7a0bea3e None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:05:04.503785 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a7817f-92c1-4cfb-a67f-8b4ea7921abd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:05:04.504413 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7817f-92c1-4cfb-a67f-8b4ea7921abd service placement] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:05:04.504691 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7817f-92c1-4cfb-a67f-8b4ea7921abd service placement] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:05:04.504961 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7817f-92c1-4cfb-a67f-8b4ea7921abd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:05:04.514212 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a7817f-92c1-4cfb-a67f-8b4ea7921abd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:05:04.515847 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a7817f-92c1-4cfb-a67f-8b4ea7921abd service placement] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:05:04.525919 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1462/2892] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:05:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:05:08.286215 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f8776-5c36-437e-ac45-60b508a23497 service nova] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:05:08.298493 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f8776-5c36-437e-ac45-60b508a23497 service nova] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:05:08.303654 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb1ce0-ed4f-4a4b-9182-b5dcead9b525 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:05:08.304267 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb1ce0-ed4f-4a4b-9182-b5dcead9b525 service placement] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:05:08.304541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb1ce0-ed4f-4a4b-9182-b5dcead9b525 service placement] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:05:08.304807 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb1ce0-ed4f-4a4b-9182-b5dcead9b525 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:05:08.306750 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-b3bb1ce0-ed4f-4a4b-9182-b5dcead9b525 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:05:08.333743 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb1ce0-ed4f-4a4b-9182-b5dcead9b525 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:05:08.335358 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb1ce0-ed4f-4a4b-9182-b5dcead9b525 service placement] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:05:08.350710 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1431/2893] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:05:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:05:08.570661 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a7817f-92c1-4cfb-a67f-8b4ea7921abd service placement] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:05:08.653655 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a7817f-92c1-4cfb-a67f-8b4ea7921abd service placement] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:05:08.658683 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a710890-9600-44b5-adef-381d6eec05e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:05:08.659334 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a710890-9600-44b5-adef-381d6eec05e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:05:08.659636 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a710890-9600-44b5-adef-381d6eec05e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:05:08.659912 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a710890-9600-44b5-adef-381d6eec05e5 admin admin] PATH_INFO: `/v3/users/e18a97d6876e48a9a6ceb122e1b1083d` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:05:08.661107 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a710890-9600-44b5-adef-381d6eec05e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e18a97d6876e48a9a6ceb122e1b1083d)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:05:08.663058 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a710890-9600-44b5-adef-381d6eec05e5 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:05:08.710959 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-6a710890-9600-44b5-adef-381d6eec05e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e18a97d6876e48a9a6ceb122e1b1083d'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:05:08.717871 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-6a710890-9600-44b5-adef-381d6eec05e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e18a97d6876e48a9a6ceb122e1b1083d'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:05:08.718639 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-6a710890-9600-44b5-adef-381d6eec05e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e18a97d6876e48a9a6ceb122e1b1083d'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:05:08.733035 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-6a710890-9600-44b5-adef-381d6eec05e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e18a97d6876e48a9a6ceb122e1b1083d'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:05:08.734063 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-6a710890-9600-44b5-adef-381d6eec05e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e18a97d6876e48a9a6ceb122e1b1083d'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:05:08.752060 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1463/2894] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 02:05:08 2022] DELETE /identity/v3/users/e18a97d6876e48a9a6ceb122e1b1083d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 02:05:08.756864 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e06e3a-0e83-465b-a07a-3d73e2f69333 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:05:08.757155 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e06e3a-0e83-465b-a07a-3d73e2f69333 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:05:08.757432 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e06e3a-0e83-465b-a07a-3d73e2f69333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:05:08.799669 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-46e06e3a-0e83-465b-a07a-3d73e2f69333 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 02:05:08.801707 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-46e06e3a-0e83-465b-a07a-3d73e2f69333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:05:08.865916 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1432/2895] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 02:05:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 02:05:08.876166 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a710890-9600-44b5-adef-381d6eec05e5 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:05:08.877833 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-6a710890-9600-44b5-adef-381d6eec05e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:05:08.923721 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:05:08.941869 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a710890-9600-44b5-adef-381d6eec05e5 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:05:08.945809 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb474f-de55-4e60-9649-ef13512c9467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:05:08.946435 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb474f-de55-4e60-9649-ef13512c9467 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:05:08.946713 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb474f-de55-4e60-9649-ef13512c9467 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:05:08.946980 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb474f-de55-4e60-9649-ef13512c9467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:05:08.956662 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fb474f-de55-4e60-9649-ef13512c9467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:05:08.958273 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fb474f-de55-4e60-9649-ef13512c9467 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:05:08.970259 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1464/2896] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:05:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:05:09.153252 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e06e3a-0e83-465b-a07a-3d73e2f69333 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:05:09.154738 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-46e06e3a-0e83-465b-a07a-3d73e2f69333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:05:09.167447 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e06e3a-0e83-465b-a07a-3d73e2f69333 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:05:09.173152 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ac1b4-d559-48cd-8aec-562a08784ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:05:09.173879 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ac1b4-d559-48cd-8aec-562a08784ed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:05:09.174097 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ac1b4-d559-48cd-8aec-562a08784ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:05:09.174331 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ac1b4-d559-48cd-8aec-562a08784ed7 admin admin] PATH_INFO: `/v3/projects/7a246a705d884e639f273a22b2d2e689` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:05:09.175564 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ac1b4-d559-48cd-8aec-562a08784ed7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a246a705d884e639f273a22b2d2e689)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:05:09.177488 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ac1b4-d559-48cd-8aec-562a08784ed7 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:05:09.227201 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-532ac1b4-d559-48cd-8aec-562a08784ed7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a246a705d884e639f273a22b2d2e689', 'request_id': 'req-532ac1b4-d559-48cd-8aec-562a08784ed7'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:05:09.233421 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-532ac1b4-d559-48cd-8aec-562a08784ed7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a246a705d884e639f273a22b2d2e689', 'request_id': 'req-532ac1b4-d559-48cd-8aec-562a08784ed7'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:05:09.240209 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-532ac1b4-d559-48cd-8aec-562a08784ed7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a246a705d884e639f273a22b2d2e689', 'request_id': 'req-532ac1b4-d559-48cd-8aec-562a08784ed7'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:05:09.253608 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-532ac1b4-d559-48cd-8aec-562a08784ed7 admin admin] The token cache is being invalidate because project 7a246a705d884e639f273a22b2d2e689 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 02:05:09.253981 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-532ac1b4-d559-48cd-8aec-562a08784ed7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:05:09.254638 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-532ac1b4-d559-48cd-8aec-562a08784ed7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:05:09.256350 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1433/2897] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 02:05:09 2022] DELETE /identity/v3/projects/7a246a705d884e639f273a22b2d2e689 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 02:05:09.260330 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb474f-de55-4e60-9649-ef13512c9467 service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:05:09.270975 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb474f-de55-4e60-9649-ef13512c9467 service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:05:09.330928 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039712f2-773f-4b2b-9c27-83fe9aaf0419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:05:09.331602 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039712f2-773f-4b2b-9c27-83fe9aaf0419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:05:09.331867 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039712f2-773f-4b2b-9c27-83fe9aaf0419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:05:09.332135 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039712f2-773f-4b2b-9c27-83fe9aaf0419 admin admin] PATH_INFO: `/v3/users/655f62fc64bb4e2c85ea4baedab88674` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:05:09.333319 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039712f2-773f-4b2b-9c27-83fe9aaf0419 admin admin] RBAC: Authorizing `identity:delete_user(user_id=655f62fc64bb4e2c85ea4baedab88674)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:05:09.335554 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039712f2-773f-4b2b-9c27-83fe9aaf0419 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:05:09.385801 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-039712f2-773f-4b2b-9c27-83fe9aaf0419 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '655f62fc64bb4e2c85ea4baedab88674'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:05:09.392783 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-039712f2-773f-4b2b-9c27-83fe9aaf0419 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '655f62fc64bb4e2c85ea4baedab88674'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:05:09.393455 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-039712f2-773f-4b2b-9c27-83fe9aaf0419 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '655f62fc64bb4e2c85ea4baedab88674'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:05:09.406030 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-039712f2-773f-4b2b-9c27-83fe9aaf0419 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '655f62fc64bb4e2c85ea4baedab88674'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:05:09.406671 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-039712f2-773f-4b2b-9c27-83fe9aaf0419 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '655f62fc64bb4e2c85ea4baedab88674'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:05:09.421129 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1465/2898] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 02:05:09 2022] DELETE /identity/v3/users/655f62fc64bb4e2c85ea4baedab88674 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 02:05:09.704301 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ac1b4-d559-48cd-8aec-562a08784ed7 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:05:09.705868 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-532ac1b4-d559-48cd-8aec-562a08784ed7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:05:09.719475 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ac1b4-d559-48cd-8aec-562a08784ed7 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:05:09.764179 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:05:09.783242 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb85101a-e093-4b12-9313-1ee38616e1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:05:09.783913 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85101a-e093-4b12-9313-1ee38616e1df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:05:09.784189 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85101a-e093-4b12-9313-1ee38616e1df admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:05:09.784460 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85101a-e093-4b12-9313-1ee38616e1df admin admin] PATH_INFO: `/v3/projects/00036b5a52ec46a89e75e943291b55e1` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:05:09.785674 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb85101a-e093-4b12-9313-1ee38616e1df admin admin] RBAC: Authorizing `identity:delete_project(project_id=00036b5a52ec46a89e75e943291b55e1)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:05:09.787663 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb85101a-e093-4b12-9313-1ee38616e1df admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:05:09.837444 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-cb85101a-e093-4b12-9313-1ee38616e1df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00036b5a52ec46a89e75e943291b55e1', 'request_id': 'req-cb85101a-e093-4b12-9313-1ee38616e1df'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:05:09.843323 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-cb85101a-e093-4b12-9313-1ee38616e1df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00036b5a52ec46a89e75e943291b55e1', 'request_id': 'req-cb85101a-e093-4b12-9313-1ee38616e1df'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:05:09.850041 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-cb85101a-e093-4b12-9313-1ee38616e1df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00036b5a52ec46a89e75e943291b55e1', 'request_id': 'req-cb85101a-e093-4b12-9313-1ee38616e1df'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:05:09.865563 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-cb85101a-e093-4b12-9313-1ee38616e1df admin admin] The token cache is being invalidate because project 00036b5a52ec46a89e75e943291b55e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 02:05:09.865837 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-cb85101a-e093-4b12-9313-1ee38616e1df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:05:09.866475 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-cb85101a-e093-4b12-9313-1ee38616e1df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:05:09.868056 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1434/2899] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 02:05:09 2022] DELETE /identity/v3/projects/00036b5a52ec46a89e75e943291b55e1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 02:05:09.873649 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a10d24-2773-471d-aa38-ea11f7242295 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:05:09.874148 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a10d24-2773-471d-aa38-ea11f7242295 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:05:09.874246 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a10d24-2773-471d-aa38-ea11f7242295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:05:09.914272 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-83a10d24-2773-471d-aa38-ea11f7242295 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 02:05:09.915474 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-83a10d24-2773-471d-aa38-ea11f7242295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:05:09.958670 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:05:09.984452 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1466/2900] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 02:05:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 02:05:09.993327 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d806a6-8a3f-40fe-bef8-e9e703da4809 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:05:09.993615 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d806a6-8a3f-40fe-bef8-e9e703da4809 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:05:09.993873 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d806a6-8a3f-40fe-bef8-e9e703da4809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:05:10.015375 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-22d806a6-8a3f-40fe-bef8-e9e703da4809 None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 02:05:10.016625 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-22d806a6-8a3f-40fe-bef8-e9e703da4809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:05:10.026182 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1435/2901] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 02:05:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 02:05:10.031170 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a10d24-2773-471d-aa38-ea11f7242295 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:05:10.045440 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a10d24-2773-471d-aa38-ea11f7242295 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:05:10.050610 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7281a-4da4-4b1f-a69e-f4ffb23f6076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:05:10.051221 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7281a-4da4-4b1f-a69e-f4ffb23f6076 admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:05:10.051525 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7281a-4da4-4b1f-a69e-f4ffb23f6076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:05:10.051798 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7281a-4da4-4b1f-a69e-f4ffb23f6076 admin admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:05:10.052498 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e7281a-4da4-4b1f-a69e-f4ffb23f6076 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 02:05:10.052803 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e7281a-4da4-4b1f-a69e-f4ffb23f6076 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:05:10.054407 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e7281a-4da4-4b1f-a69e-f4ffb23f6076 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:05:10.066109 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1467/2902] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 02:05:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 02:05:10.070540 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d806a6-8a3f-40fe-bef8-e9e703da4809 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:05:10.080539 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d806a6-8a3f-40fe-bef8-e9e703da4809 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:05:10.086122 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433cebc5-df24-4eee-8696-798480519abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:05:10.086736 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cebc5-df24-4eee-8696-798480519abf admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:05:10.087022 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cebc5-df24-4eee-8696-798480519abf admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:05:10.087290 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cebc5-df24-4eee-8696-798480519abf admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:05:10.087994 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433cebc5-df24-4eee-8696-798480519abf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:05:10.090009 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433cebc5-df24-4eee-8696-798480519abf admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:05:10.121166 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1436/2903] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 02:05:10 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 02:05:10.125440 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7281a-4da4-4b1f-a69e-f4ffb23f6076 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:05:10.136169 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7281a-4da4-4b1f-a69e-f4ffb23f6076 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:05:10.208034 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2535a-fcfe-40d0-9a72-c988aba45056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:05:10.208642 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2535a-fcfe-40d0-9a72-c988aba45056 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:05:10.208974 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2535a-fcfe-40d0-9a72-c988aba45056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:05:10.209232 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2535a-fcfe-40d0-9a72-c988aba45056 admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:05:10.209862 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa2535a-fcfe-40d0-9a72-c988aba45056 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:05:10.211790 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa2535a-fcfe-40d0-9a72-c988aba45056 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:05:10.234745 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1468/2904] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 02:05:10 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 02:05:10.239477 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433cebc5-df24-4eee-8696-798480519abf admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:05:10.250117 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433cebc5-df24-4eee-8696-798480519abf admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:05:10.255052 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211eab3-839c-402b-9c6a-d0ff5e4e6d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:05:10.255720 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211eab3-839c-402b-9c6a-d0ff5e4e6d64 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:05:10.256012 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211eab3-839c-402b-9c6a-d0ff5e4e6d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:05:10.256276 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211eab3-839c-402b-9c6a-d0ff5e4e6d64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:05:10.256998 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211eab3-839c-402b-9c6a-d0ff5e4e6d64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:05:10.258584 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211eab3-839c-402b-9c6a-d0ff5e4e6d64 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:05:10.268991 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1437/2905] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 02:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 02:05:10.273317 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2535a-fcfe-40d0-9a72-c988aba45056 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:05:10.284014 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2535a-fcfe-40d0-9a72-c988aba45056 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:05:10.289627 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af01ab0-8888-49b0-b049-592d50ec616e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:05:10.290225 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af01ab0-8888-49b0-b049-592d50ec616e admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:05:10.290498 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af01ab0-8888-49b0-b049-592d50ec616e admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:05:10.290767 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af01ab0-8888-49b0-b049-592d50ec616e admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:05:10.291449 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af01ab0-8888-49b0-b049-592d50ec616e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:05:10.293092 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af01ab0-8888-49b0-b049-592d50ec616e admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:05:10.305010 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1469/2906] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 02:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 02:05:10.309282 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211eab3-839c-402b-9c6a-d0ff5e4e6d64 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:05:10.319370 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211eab3-839c-402b-9c6a-d0ff5e4e6d64 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:05:10.324655 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f20a185-c091-490e-9b8a-170e7bef9206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:05:10.325295 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20a185-c091-490e-9b8a-170e7bef9206 admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:05:10.325567 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20a185-c091-490e-9b8a-170e7bef9206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:05:10.325835 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20a185-c091-490e-9b8a-170e7bef9206 admin admin] PATH_INFO: `/v3/projects/112cd13518804811a9857f3a5b5bebaa/users/feff0e6c55484f5b9859dcc79d73a21b/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:05:10.341350 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f20a185-c091-490e-9b8a-170e7bef9206 admin admin] RBAC: Authorizing `identity:create_grant(project_id=112cd13518804811a9857f3a5b5bebaa, user_id=feff0e6c55484f5b9859dcc79d73a21b, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:05:10.344015 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f20a185-c091-490e-9b8a-170e7bef9206 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:05:10.361509 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1438/2907] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 02:05:10 2022] PUT /identity/v3/projects/112cd13518804811a9857f3a5b5bebaa/users/feff0e6c55484f5b9859dcc79d73a21b/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 02:05:10.366565 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3442a-6e8c-4235-99b8-ed8987476cbe None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:05:10.366844 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3442a-6e8c-4235-99b8-ed8987476cbe None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:05:10.367156 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3442a-6e8c-4235-99b8-ed8987476cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:05:10.385821 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-c3a3442a-6e8c-4235-99b8-ed8987476cbe None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 02:05:10.387010 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-c3a3442a-6e8c-4235-99b8-ed8987476cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:05:10.446547 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1470/2908] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 02:05:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 02:05:10.456427 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f20a185-c091-490e-9b8a-170e7bef9206 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:05:10.458511 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-6f20a185-c091-490e-9b8a-170e7bef9206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:05:10.522050 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f20a185-c091-490e-9b8a-170e7bef9206 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:05:10.526152 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a4047-64c2-46db-ab2e-a88736220b78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:05:10.526807 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a4047-64c2-46db-ab2e-a88736220b78 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:05:10.527077 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a4047-64c2-46db-ab2e-a88736220b78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:05:10.527342 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a4047-64c2-46db-ab2e-a88736220b78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:05:10.537428 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a4047-64c2-46db-ab2e-a88736220b78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:05:10.538995 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a4047-64c2-46db-ab2e-a88736220b78 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:05:10.548784 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1439/2909] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:05:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:05:14.646739 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324211c1-6a5f-47be-9d1f-c4df07a625b4 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:05:14.647285 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324211c1-6a5f-47be-9d1f-c4df07a625b4 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:05:14.647285 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324211c1-6a5f-47be-9d1f-c4df07a625b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:05:14.677249 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-324211c1-6a5f-47be-9d1f-c4df07a625b4 None None] MFA Rules not processed for user `feff0e6c55484f5b9859dcc79d73a21b`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 02:05:14.678640 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-324211c1-6a5f-47be-9d1f-c4df07a625b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:05:14.723673 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:05:14.748517 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1471/2910] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 02:05:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 02:05:14.753218 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a4047-64c2-46db-ab2e-a88736220b78 service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:05:14.763556 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a4047-64c2-46db-ab2e-a88736220b78 service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:05:14.768507 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138004f1-d7e6-4b14-804e-5d5fcf899882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:05:14.769136 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138004f1-d7e6-4b14-804e-5d5fcf899882 admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:05:14.769464 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138004f1-d7e6-4b14-804e-5d5fcf899882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:05:14.769734 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138004f1-d7e6-4b14-804e-5d5fcf899882 admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:05:14.770392 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138004f1-d7e6-4b14-804e-5d5fcf899882 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:05:14.772391 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138004f1-d7e6-4b14-804e-5d5fcf899882 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:05:14.783524 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:05:14.805204 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1440/2911] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 02:05:14 2022] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 02:05:14.809626 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324211c1-6a5f-47be-9d1f-c4df07a625b4 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:05:14.821009 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324211c1-6a5f-47be-9d1f-c4df07a625b4 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:05:14.880296 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40d729-8c19-41de-9237-e57b9e51d983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:05:14.880926 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40d729-8c19-41de-9237-e57b9e51d983 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:05:14.881201 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40d729-8c19-41de-9237-e57b9e51d983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:05:14.881483 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40d729-8c19-41de-9237-e57b9e51d983 admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:05:14.882156 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40d729-8c19-41de-9237-e57b9e51d983 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:05:14.884130 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40d729-8c19-41de-9237-e57b9e51d983 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:05:14.906668 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1472/2912] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 02:05:14 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 02:05:14.911352 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138004f1-d7e6-4b14-804e-5d5fcf899882 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:05:14.926983 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138004f1-d7e6-4b14-804e-5d5fcf899882 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:05:14.932333 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39850b30-b730-4558-a37a-e7319062b82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:05:14.933033 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39850b30-b730-4558-a37a-e7319062b82e admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:05:14.933280 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39850b30-b730-4558-a37a-e7319062b82e admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:05:14.933565 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39850b30-b730-4558-a37a-e7319062b82e admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:05:14.934273 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39850b30-b730-4558-a37a-e7319062b82e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:05:14.935925 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39850b30-b730-4558-a37a-e7319062b82e admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:05:14.947027 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1441/2913] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 02:05:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 02:05:14.951349 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40d729-8c19-41de-9237-e57b9e51d983 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:05:14.962259 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40d729-8c19-41de-9237-e57b9e51d983 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:05:14.967762 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af078e-b43c-48a1-938f-a40a72108cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:05:14.968484 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af078e-b43c-48a1-938f-a40a72108cc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:05:14.968768 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af078e-b43c-48a1-938f-a40a72108cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:05:14.969028 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af078e-b43c-48a1-938f-a40a72108cc3 admin admin] PATH_INFO: `/v3/projects/d110a5f9082041a68c4187e9699b8e27/users/e8c6468774ee414d83fd60ca528905fd/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:05:14.987698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af078e-b43c-48a1-938f-a40a72108cc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d110a5f9082041a68c4187e9699b8e27, user_id=e8c6468774ee414d83fd60ca528905fd, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:05:14.990509 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af078e-b43c-48a1-938f-a40a72108cc3 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:05:15.008983 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1473/2914] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 02:05:14 2022] PUT /identity/v3/projects/d110a5f9082041a68c4187e9699b8e27/users/e8c6468774ee414d83fd60ca528905fd/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 02:05:15.014152 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39850b30-b730-4558-a37a-e7319062b82e admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:05:15.026341 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39850b30-b730-4558-a37a-e7319062b82e admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:05:15.089695 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec4562-60a8-40e4-8b08-a81d6028642f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:05:15.090541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec4562-60a8-40e4-8b08-a81d6028642f admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:05:15.090747 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec4562-60a8-40e4-8b08-a81d6028642f admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:05:15.091031 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec4562-60a8-40e4-8b08-a81d6028642f admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:05:15.091817 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec4562-60a8-40e4-8b08-a81d6028642f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:05:15.094282 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec4562-60a8-40e4-8b08-a81d6028642f admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:05:15.106295 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1442/2915] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 02:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 02:05:15.111274 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af078e-b43c-48a1-938f-a40a72108cc3 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:05:15.125177 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af078e-b43c-48a1-938f-a40a72108cc3 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:05:15.130538 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed004350-3a62-40cd-9ce9-06343d4cf4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:05:15.131214 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed004350-3a62-40cd-9ce9-06343d4cf4e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:05:15.131500 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed004350-3a62-40cd-9ce9-06343d4cf4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:05:15.131783 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed004350-3a62-40cd-9ce9-06343d4cf4e0 admin admin] PATH_INFO: `/v3/projects/d110a5f9082041a68c4187e9699b8e27/users/e8c6468774ee414d83fd60ca528905fd/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:05:15.133933 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed004350-3a62-40cd-9ce9-06343d4cf4e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d110a5f9082041a68c4187e9699b8e27, user_id=e8c6468774ee414d83fd60ca528905fd, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:05:15.136835 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed004350-3a62-40cd-9ce9-06343d4cf4e0 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:05:15.150814 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1474/2916] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 02:05:15 2022] PUT /identity/v3/projects/d110a5f9082041a68c4187e9699b8e27/users/e8c6468774ee414d83fd60ca528905fd/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 02:05:19.992682 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68d807-9c01-4ca0-8e45-7f85e0f8f826 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:05:19.993240 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68d807-9c01-4ca0-8e45-7f85e0f8f826 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:05:19.993240 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68d807-9c01-4ca0-8e45-7f85e0f8f826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:05:20.035992 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-3c68d807-9c01-4ca0-8e45-7f85e0f8f826 None None] MFA Rules not processed for user `e8c6468774ee414d83fd60ca528905fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 02:05:20.035992 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-3c68d807-9c01-4ca0-8e45-7f85e0f8f826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:05:20.134172 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1443/2917] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 02:05:19 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 02:05:20.150699 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed004350-3a62-40cd-9ce9-06343d4cf4e0 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:05:20.153223 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-ed004350-3a62-40cd-9ce9-06343d4cf4e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:05:20.250176 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:05:20.275705 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed004350-3a62-40cd-9ce9-06343d4cf4e0 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:05:20.282409 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb89b5-c8a9-4297-8392-0e5af40a7dcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:05:20.283021 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb89b5-c8a9-4297-8392-0e5af40a7dcd service nova] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:05:20.283302 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb89b5-c8a9-4297-8392-0e5af40a7dcd service nova] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:05:20.283613 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb89b5-c8a9-4297-8392-0e5af40a7dcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:05:20.343423 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb89b5-c8a9-4297-8392-0e5af40a7dcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:05:20.345080 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb89b5-c8a9-4297-8392-0e5af40a7dcd service nova] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:05:20.355449 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1475/2918] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:05:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:05:21.388392 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1400f13-dd32-4838-a1d8-5a0e17203988 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:05:21.388889 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1400f13-dd32-4838-a1d8-5a0e17203988 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:05:21.389063 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1400f13-dd32-4838-a1d8-5a0e17203988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:05:21.408500 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-d1400f13-dd32-4838-a1d8-5a0e17203988 None None] MFA Rules not processed for user `feff0e6c55484f5b9859dcc79d73a21b`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 02:05:21.409823 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-d1400f13-dd32-4838-a1d8-5a0e17203988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:05:21.421303 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1444/2919] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 02:05:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 02:05:26.709192 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb89b5-c8a9-4297-8392-0e5af40a7dcd service nova] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:05:26.710724 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-67bb89b5-c8a9-4297-8392-0e5af40a7dcd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:05:26.726456 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb89b5-c8a9-4297-8392-0e5af40a7dcd service nova] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:05:26.732953 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac61919-5798-4cf2-b362-52f85f655f40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:05:26.733585 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac61919-5798-4cf2-b362-52f85f655f40 service nova] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:05:26.733884 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac61919-5798-4cf2-b362-52f85f655f40 service nova] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:05:26.734186 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac61919-5798-4cf2-b362-52f85f655f40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:05:26.736450 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-4ac61919-5798-4cf2-b362-52f85f655f40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:05:26.750593 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac61919-5798-4cf2-b362-52f85f655f40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:05:26.752382 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac61919-5798-4cf2-b362-52f85f655f40 service nova] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:05:26.764590 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1476/2920] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:05:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:05:31.402888 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=90,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:05:35.237475 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8ff9f-99b7-4a26-900c-112e698a1789 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:05:35.238168 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8ff9f-99b7-4a26-900c-112e698a1789 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:05:35.238168 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8ff9f-99b7-4a26-900c-112e698a1789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:05:35.267888 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-98b8ff9f-99b7-4a26-900c-112e698a1789 None None] MFA Rules not processed for user `81117154f6d1474c805a69c5617c307d`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 02:05:35.269078 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-98b8ff9f-99b7-4a26-900c-112e698a1789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:05:35.323188 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1445/2921] 10.222.0.60 () {58 vars in 1062 bytes} [Sun Jul 31 02:05:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 02:05:35.329633 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac61919-5798-4cf2-b362-52f85f655f40 service nova] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:05:35.339999 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac61919-5798-4cf2-b362-52f85f655f40 service nova] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:05:35.344511 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1642fe-00e7-4f1d-9bc1-d26cd7b00af7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:05:35.345122 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1642fe-00e7-4f1d-9bc1-d26cd7b00af7 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:05:35.345401 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1642fe-00e7-4f1d-9bc1-d26cd7b00af7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:05:35.345669 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1642fe-00e7-4f1d-9bc1-d26cd7b00af7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:05:35.355618 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1642fe-00e7-4f1d-9bc1-d26cd7b00af7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:05:35.357130 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1642fe-00e7-4f1d-9bc1-d26cd7b00af7 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:05:35.368289 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1477/2922] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:05:35 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:05:45.316718 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=27 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:05:45.363448 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=43 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:07:16.936514 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4749ca-a6d5-404d-b34d-cc76e204e23d None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:07:16.937154 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4749ca-a6d5-404d-b34d-cc76e204e23d None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:07:16.937154 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4749ca-a6d5-404d-b34d-cc76e204e23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:07:16.957168 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-cd4749ca-a6d5-404d-b34d-cc76e204e23d None None] MFA Rules not processed for user `81117154f6d1474c805a69c5617c307d`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 02:07:16.958362 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-cd4749ca-a6d5-404d-b34d-cc76e204e23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:07:16.975026 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1446/2923] 10.222.0.60 () {58 vars in 1062 bytes} [Sun Jul 31 02:07:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 02:07:16.981486 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1642fe-00e7-4f1d-9bc1-d26cd7b00af7 service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:07:17.000869 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1642fe-00e7-4f1d-9bc1-d26cd7b00af7 service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:07:17.005145 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828f886-ccff-4a27-81ae-475fea5d18a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:07:17.005745 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828f886-ccff-4a27-81ae-475fea5d18a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:07:17.006019 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828f886-ccff-4a27-81ae-475fea5d18a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:07:17.006316 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828f886-ccff-4a27-81ae-475fea5d18a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:07:17.008338 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-e828f886-ccff-4a27-81ae-475fea5d18a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:07:17.018144 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e828f886-ccff-4a27-81ae-475fea5d18a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:07:17.019561 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e828f886-ccff-4a27-81ae-475fea5d18a2 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:07:17.027590 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1478/2924] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:07:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:07:26.972303 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=7 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:07:27.024111 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=10 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:07:32.750723 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4749ca-a6d5-404d-b34d-cc76e204e23d None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:07:32.752309 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-cd4749ca-a6d5-404d-b34d-cc76e204e23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:07:32.832570 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4749ca-a6d5-404d-b34d-cc76e204e23d None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:07:32.838190 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4d6f1-a654-4bf3-bd4d-5541fffce7ba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdebcb0a2a7548a09b3e9d3cf085e40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:07:32.839055 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4d6f1-a654-4bf3-bd4d-5541fffce7ba service glance] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:07:32.839348 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4d6f1-a654-4bf3-bd4d-5541fffce7ba service glance] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:07:32.839657 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4d6f1-a654-4bf3-bd4d-5541fffce7ba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:07:32.841660 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-24a4d6f1-a654-4bf3-bd4d-5541fffce7ba service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:07:32.870399 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a4d6f1-a654-4bf3-bd4d-5541fffce7ba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:07:32.872565 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a4d6f1-a654-4bf3-bd4d-5541fffce7ba service glance] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:07:32.896238 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1447/2925] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:07:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:07:33.069592 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828f886-ccff-4a27-81ae-475fea5d18a2 service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:07:33.078919 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828f886-ccff-4a27-81ae-475fea5d18a2 service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:07:33.083606 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3d7f9-b794-4afa-b1e4-1137fea1269c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:07:33.083745 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3d7f9-b794-4afa-b1e4-1137fea1269c service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:07:33.083997 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3d7f9-b794-4afa-b1e4-1137fea1269c service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:07:33.084308 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3d7f9-b794-4afa-b1e4-1137fea1269c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:07:33.086274 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-c5b3d7f9-b794-4afa-b1e4-1137fea1269c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:07:33.100461 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b3d7f9-b794-4afa-b1e4-1137fea1269c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:07:33.101871 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b3d7f9-b794-4afa-b1e4-1137fea1269c service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:07:33.113131 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1479/2926] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:07:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:07:42.893289 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=42 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:07:43.108173 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=6 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:07:46.053971 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47811293-b754-4c14-8242-333e45c3d37b None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:07:46.054487 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47811293-b754-4c14-8242-333e45c3d37b None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:07:46.054487 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47811293-b754-4c14-8242-333e45c3d37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:07:46.108069 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-47811293-b754-4c14-8242-333e45c3d37b None None] MFA Rules not processed for user `02ed9040d575462db4b270a5b57063f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 02:07:46.109326 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-47811293-b754-4c14-8242-333e45c3d37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:07:46.178924 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1448/2927] 10.222.0.60 () {58 vars in 1009 bytes} [Sun Jul 31 02:07:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 02:07:46.227958 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559621c3-46fd-40b7-8c5d-c0aa35ca52bc None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:07:46.228440 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559621c3-46fd-40b7-8c5d-c0aa35ca52bc None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:07:46.228548 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559621c3-46fd-40b7-8c5d-c0aa35ca52bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:07:46.281560 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-559621c3-46fd-40b7-8c5d-c0aa35ca52bc None None] MFA Rules not processed for user `0c8c98c1e2d24de89c7d07753fae02e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 02:07:46.282777 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-559621c3-46fd-40b7-8c5d-c0aa35ca52bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:07:46.355729 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1480/2928] 10.222.0.60 () {58 vars in 1040 bytes} [Sun Jul 31 02:07:46 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 02:07:46.362631 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47811293-b754-4c14-8242-333e45c3d37b None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:07:46.375014 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47811293-b754-4c14-8242-333e45c3d37b None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:07:46.380078 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eab568-235c-4be4-8116-23ef4db3407e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c8c98c1e2d24de89c7d07753fae02e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:07:46.380696 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eab568-235c-4be4-8116-23ef4db3407e service swift] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:07:46.380970 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eab568-235c-4be4-8116-23ef4db3407e service swift] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:07:46.381236 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eab568-235c-4be4-8116-23ef4db3407e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:07:46.389254 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eab568-235c-4be4-8116-23ef4db3407e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:07:46.390867 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eab568-235c-4be4-8116-23ef4db3407e service swift] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:07:46.398908 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1449/2929] 10.222.0.60 () {60 vars in 1384 bytes} [Sun Jul 31 02:07:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 02:07:56.353181 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=44 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:07:56.395789 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=46 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:07:58.225274 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559621c3-46fd-40b7-8c5d-c0aa35ca52bc None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:07:58.234852 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559621c3-46fd-40b7-8c5d-c0aa35ca52bc None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:07:58.240108 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab5990-fe5b-4dcb-af14-692b571a8768 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:07:58.240724 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab5990-fe5b-4dcb-af14-692b571a8768 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:07:58.240998 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab5990-fe5b-4dcb-af14-692b571a8768 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:07:58.241263 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab5990-fe5b-4dcb-af14-692b571a8768 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:07:58.243701 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-78ab5990-fe5b-4dcb-af14-692b571a8768 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:07:58.271584 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab5990-fe5b-4dcb-af14-692b571a8768 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:07:58.273543 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab5990-fe5b-4dcb-af14-692b571a8768 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:07:58.286488 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1481/2930] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:07:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:07:58.408226 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8891b-6bdc-4ef4-96b0-b2983f7fe19a None None] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:07:58.408761 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8891b-6bdc-4ef4-96b0-b2983f7fe19a None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:07:58.408887 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8891b-6bdc-4ef4-96b0-b2983f7fe19a None None] PATH_INFO: `/` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:07:58.410296 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1450/2931] 10.222.0.60 () {54 vars in 921 bytes} [Sun Jul 31 02:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 02:07:58.416228 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ea831-bc1d-4d39-aea3-12bf12e1c41b None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:07:58.416589 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ea831-bc1d-4d39-aea3-12bf12e1c41b None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:07:58.416930 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ea831-bc1d-4d39-aea3-12bf12e1c41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:07:58.474482 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-9d2ea831-bc1d-4d39-aea3-12bf12e1c41b None None] MFA Rules not processed for user `04591cd035ef4961b8b7a93e294eb881`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 02:07:58.476013 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-9d2ea831-bc1d-4d39-aea3-12bf12e1c41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:07:58.487618 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1482/2932] 10.222.0.60 () {58 vars in 1018 bytes} [Sun Jul 31 02:07:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 02:07:58.500115 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8891b-6bdc-4ef4-96b0-b2983f7fe19a None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:07:58.511323 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8891b-6bdc-4ef4-96b0-b2983f7fe19a None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:07:58.514884 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09697f0-7f93-4b3e-b91d-a79822affab1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdebcb0a2a7548a09b3e9d3cf085e40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:07:58.515518 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09697f0-7f93-4b3e-b91d-a79822affab1 service glance] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:07:58.515819 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09697f0-7f93-4b3e-b91d-a79822affab1 service glance] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:07:58.516092 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09697f0-7f93-4b3e-b91d-a79822affab1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:07:58.526527 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09697f0-7f93-4b3e-b91d-a79822affab1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:07:58.528067 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09697f0-7f93-4b3e-b91d-a79822affab1 service glance] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:07:58.539054 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1451/2933] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:07:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:07:58.611813 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ea831-bc1d-4d39-aea3-12bf12e1c41b None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:07:58.621680 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ea831-bc1d-4d39-aea3-12bf12e1c41b None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:07:58.625674 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45519913-cf98-4a4a-8b07-72d3f681e735 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:07:58.626393 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45519913-cf98-4a4a-8b07-72d3f681e735 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:07:58.626664 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45519913-cf98-4a4a-8b07-72d3f681e735 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:07:58.626935 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45519913-cf98-4a4a-8b07-72d3f681e735 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:07:58.628987 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-45519913-cf98-4a4a-8b07-72d3f681e735 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:07:58.640205 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45519913-cf98-4a4a-8b07-72d3f681e735 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:07:58.641645 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45519913-cf98-4a4a-8b07-72d3f681e735 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:07:58.649768 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1483/2934] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:07:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:07:58.731228 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09697f0-7f93-4b3e-b91d-a79822affab1 service glance] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:07:58.743222 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09697f0-7f93-4b3e-b91d-a79822affab1 service glance] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:07:58.750138 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52802bde-1bda-46f0-94ea-ca5856ac987a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:07:58.751058 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52802bde-1bda-46f0-94ea-ca5856ac987a service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:07:58.751413 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52802bde-1bda-46f0-94ea-ca5856ac987a service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:07:58.751734 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52802bde-1bda-46f0-94ea-ca5856ac987a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:07:58.758910 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-52802bde-1bda-46f0-94ea-ca5856ac987a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:07:58.774889 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52802bde-1bda-46f0-94ea-ca5856ac987a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:07:58.776358 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52802bde-1bda-46f0-94ea-ca5856ac987a service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:07:58.788785 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1452/2935] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:07:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:07:58.859506 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac42b71-8438-491a-83d7-b96bb6b56043 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:07:58.859811 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac42b71-8438-491a-83d7-b96bb6b56043 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:07:58.860086 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac42b71-8438-491a-83d7-b96bb6b56043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:07:58.884584 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-6ac42b71-8438-491a-83d7-b96bb6b56043 None None] MFA Rules not processed for user `657a3f73879e4b31b70a1c4f73e80f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 02:07:58.885831 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-6ac42b71-8438-491a-83d7-b96bb6b56043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:07:58.951307 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1484/2936] 10.222.0.60 () {58 vars in 1018 bytes} [Sun Jul 31 02:07:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 02:07:58.963028 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52802bde-1bda-46f0-94ea-ca5856ac987a service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:07:58.964624 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-52802bde-1bda-46f0-94ea-ca5856ac987a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:07:58.980713 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52802bde-1bda-46f0-94ea-ca5856ac987a service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:07:58.987796 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2b9a8-7ecd-4335-a86f-98a62c5ed341 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:07:58.988406 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2b9a8-7ecd-4335-a86f-98a62c5ed341 service placement] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:07:58.988683 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2b9a8-7ecd-4335-a86f-98a62c5ed341 service placement] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:07:58.988945 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2b9a8-7ecd-4335-a86f-98a62c5ed341 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:07:58.998404 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2b9a8-7ecd-4335-a86f-98a62c5ed341 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:07:59.000005 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2b9a8-7ecd-4335-a86f-98a62c5ed341 service placement] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:07:59.009962 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1453/2937] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:07:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:08:00.707880 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bceffd-75f0-40c6-9f42-8a47fa47d3d4 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:08:00.708411 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bceffd-75f0-40c6-9f42-8a47fa47d3d4 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:08:00.708411 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bceffd-75f0-40c6-9f42-8a47fa47d3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:08:00.727971 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-f3bceffd-75f0-40c6-9f42-8a47fa47d3d4 None None] MFA Rules not processed for user `02ed9040d575462db4b270a5b57063f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 02:08:00.729182 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-f3bceffd-75f0-40c6-9f42-8a47fa47d3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:08:00.737452 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1485/2938] 10.222.0.60 () {58 vars in 1009 bytes} [Sun Jul 31 02:08:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 02:08:00.749976 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2b9a8-7ecd-4335-a86f-98a62c5ed341 service placement] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:08:00.761667 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2b9a8-7ecd-4335-a86f-98a62c5ed341 service placement] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:08:00.767150 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b0045-d2ae-48d4-bd38-d0baa329b543 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c8c98c1e2d24de89c7d07753fae02e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:08:00.767790 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b0045-d2ae-48d4-bd38-d0baa329b543 service swift] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:08:00.768070 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b0045-d2ae-48d4-bd38-d0baa329b543 service swift] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:08:00.768342 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b0045-d2ae-48d4-bd38-d0baa329b543 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:08:00.777171 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699b0045-d2ae-48d4-bd38-d0baa329b543 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:08:00.778828 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699b0045-d2ae-48d4-bd38-d0baa329b543 service swift] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:08:00.787074 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1454/2939] 10.222.0.60 () {60 vars in 1384 bytes} [Sun Jul 31 02:08:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 02:08:10.722466 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=63 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:08:10.784013 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=24 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:08:15.182732 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107bab58-910d-4bd3-863b-63c9076c9b75 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:08:15.183253 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107bab58-910d-4bd3-863b-63c9076c9b75 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:08:15.183253 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107bab58-910d-4bd3-863b-63c9076c9b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:08:15.208702 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-107bab58-910d-4bd3-863b-63c9076c9b75 None None] MFA Rules not processed for user `02ed9040d575462db4b270a5b57063f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 02:08:15.209929 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-107bab58-910d-4bd3-863b-63c9076c9b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:08:15.218070 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1486/2940] 10.222.0.60 () {58 vars in 967 bytes} [Sun Jul 31 02:08:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 02:08:15.231284 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b0045-d2ae-48d4-bd38-d0baa329b543 service swift] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:08:15.242436 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b0045-d2ae-48d4-bd38-d0baa329b543 service swift] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:08:15.247888 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d4fe9-8a1d-4568-b088-477704972806 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c8c98c1e2d24de89c7d07753fae02e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:08:15.248501 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d4fe9-8a1d-4568-b088-477704972806 service swift] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:08:15.248799 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d4fe9-8a1d-4568-b088-477704972806 service swift] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:08:15.249077 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d4fe9-8a1d-4568-b088-477704972806 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:08:15.258372 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d4fe9-8a1d-4568-b088-477704972806 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:08:15.259946 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d4fe9-8a1d-4568-b088-477704972806 service swift] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:08:15.268317 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1455/2941] 10.222.0.60 () {60 vars in 1384 bytes} [Sun Jul 31 02:08:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 02:08:25.201072 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:08:25.265109 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=6 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:09:27.190653 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107bab58-910d-4bd3-863b-63c9076c9b75 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:09:27.205510 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107bab58-910d-4bd3-863b-63c9076c9b75 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:09:27.212414 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17c34d-f80c-48db-bcec-d43c2497f744 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:09:27.213134 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17c34d-f80c-48db-bcec-d43c2497f744 service nova] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:09:27.213879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17c34d-f80c-48db-bcec-d43c2497f744 service nova] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:09:27.213879 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17c34d-f80c-48db-bcec-d43c2497f744 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:09:27.215803 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-fb17c34d-f80c-48db-bcec-d43c2497f744 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:09:27.229545 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb17c34d-f80c-48db-bcec-d43c2497f744 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:09:27.231321 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb17c34d-f80c-48db-bcec-d43c2497f744 service nova] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:09:27.243832 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1487/2942] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:09:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:09:31.027711 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a7262-754d-4094-bc78-e245c69d2153 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:09:31.028279 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a7262-754d-4094-bc78-e245c69d2153 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:09:31.028279 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a7262-754d-4094-bc78-e245c69d2153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:09:31.051022 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-fe5a7262-754d-4094-bc78-e245c69d2153 None None] MFA Rules not processed for user `feff0e6c55484f5b9859dcc79d73a21b`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 02:09:31.052979 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-fe5a7262-754d-4094-bc78-e245c69d2153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:09:31.062072 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1456/2943] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 02:09:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 02:09:37.239528 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=6 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:09:41.043423 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=3 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:09:47.694011 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17c34d-f80c-48db-bcec-d43c2497f744 service nova] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:09:47.703696 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17c34d-f80c-48db-bcec-d43c2497f744 service nova] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:09:47.707566 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e377b99-a97f-40aa-97b6-2f4bf9cbf946 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:09:47.708169 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e377b99-a97f-40aa-97b6-2f4bf9cbf946 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:09:47.708445 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e377b99-a97f-40aa-97b6-2f4bf9cbf946 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:09:47.708729 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e377b99-a97f-40aa-97b6-2f4bf9cbf946 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:09:47.710666 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-0e377b99-a97f-40aa-97b6-2f4bf9cbf946 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:09:47.721340 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e377b99-a97f-40aa-97b6-2f4bf9cbf946 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:09:47.722769 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e377b99-a97f-40aa-97b6-2f4bf9cbf946 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:09:47.731331 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1488/2944] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:09:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:09:50.200659 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3404b-9190-4d95-a214-aa9ec69a6e9c None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:09:50.201151 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3404b-9190-4d95-a214-aa9ec69a6e9c None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:09:50.201151 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3404b-9190-4d95-a214-aa9ec69a6e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:09:50.222239 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-9fd3404b-9190-4d95-a214-aa9ec69a6e9c None None] MFA Rules not processed for user `657a3f73879e4b31b70a1c4f73e80f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 02:09:50.223445 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-9fd3404b-9190-4d95-a214-aa9ec69a6e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:09:50.233806 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1457/2945] 10.222.0.60 () {58 vars in 1018 bytes} [Sun Jul 31 02:09:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 02:09:50.245912 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e377b99-a97f-40aa-97b6-2f4bf9cbf946 service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:09:50.247534 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-0e377b99-a97f-40aa-97b6-2f4bf9cbf946 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:09:50.263783 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e377b99-a97f-40aa-97b6-2f4bf9cbf946 service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:09:50.270038 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0f407-5003-4f4d-81b7-1d2629f8b860 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:09:50.270638 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0f407-5003-4f4d-81b7-1d2629f8b860 service placement] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:09:50.270911 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0f407-5003-4f4d-81b7-1d2629f8b860 service placement] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:09:50.271184 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0f407-5003-4f4d-81b7-1d2629f8b860 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:09:50.280686 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe0f407-5003-4f4d-81b7-1d2629f8b860 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:09:50.282354 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe0f407-5003-4f4d-81b7-1d2629f8b860 service placement] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:09:50.292991 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1489/2946] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:09:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:10:00.216822 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=3 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:10:00.288625 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=12 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:10:06.544115 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd3404b-9190-4d95-a214-aa9ec69a6e9c None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:10:06.557109 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd3404b-9190-4d95-a214-aa9ec69a6e9c None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:10:06.563344 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35895b95-c14b-4cbb-9837-c9b6070ded38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:10:06.564005 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35895b95-c14b-4cbb-9837-c9b6070ded38 service nova] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:10:06.564284 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35895b95-c14b-4cbb-9837-c9b6070ded38 service nova] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:10:06.564553 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35895b95-c14b-4cbb-9837-c9b6070ded38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:10:06.566634 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-35895b95-c14b-4cbb-9837-c9b6070ded38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:10:06.579802 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35895b95-c14b-4cbb-9837-c9b6070ded38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:10:06.582006 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35895b95-c14b-4cbb-9837-c9b6070ded38 service nova] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:10:06.593188 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1458/2947] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:10:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:10:16.227061 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0f407-5003-4f4d-81b7-1d2629f8b860 service placement] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:10:16.238382 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0f407-5003-4f4d-81b7-1d2629f8b860 service placement] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:10:16.244948 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839b86c-b65e-4c88-bd70-3648c19c8902 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:10:16.245582 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839b86c-b65e-4c88-bd70-3648c19c8902 service placement] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:10:16.245860 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839b86c-b65e-4c88-bd70-3648c19c8902 service placement] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:10:16.246126 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839b86c-b65e-4c88-bd70-3648c19c8902 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:10:16.248189 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-e839b86c-b65e-4c88-bd70-3648c19c8902 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:10:16.260152 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e839b86c-b65e-4c88-bd70-3648c19c8902 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:10:16.261730 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e839b86c-b65e-4c88-bd70-3648c19c8902 service placement] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:10:16.271747 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1490/2948] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:10:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:10:16.588643 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=6 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:10:26.267665 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=6 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:12:08.360739 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35895b95-c14b-4cbb-9837-c9b6070ded38 service nova] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:12:08.376423 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35895b95-c14b-4cbb-9837-c9b6070ded38 service nova] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:12:08.382681 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e7bafc-6b20-47ee-ab9c-cf57062f2c7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:12:08.383292 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7bafc-6b20-47ee-ab9c-cf57062f2c7b service nova] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:12:08.383653 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7bafc-6b20-47ee-ab9c-cf57062f2c7b service nova] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:12:08.383876 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7bafc-6b20-47ee-ab9c-cf57062f2c7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:12:08.392246 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e7bafc-6b20-47ee-ab9c-cf57062f2c7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:12:08.393830 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e7bafc-6b20-47ee-ab9c-cf57062f2c7b service nova] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:12:08.402933 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1459/2949] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:12:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:12:17.223302 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa263c-fe1a-4804-b709-d14504bf180f None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:12:17.223940 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa263c-fe1a-4804-b709-d14504bf180f None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:12:17.223940 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa263c-fe1a-4804-b709-d14504bf180f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:12:17.275253 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-90aa263c-fe1a-4804-b709-d14504bf180f None None] MFA Rules not processed for user `657a3f73879e4b31b70a1c4f73e80f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 02:12:17.276511 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-90aa263c-fe1a-4804-b709-d14504bf180f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:12:17.285929 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1491/2950] 10.222.0.70 () {58 vars in 1015 bytes} [Sun Jul 31 02:12:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 02:12:17.299090 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e7bafc-6b20-47ee-ab9c-cf57062f2c7b service nova] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:12:17.310881 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e7bafc-6b20-47ee-ab9c-cf57062f2c7b service nova] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:12:17.317545 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b1a01-7871-4fb5-b890-296ff47ec1a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:12:17.318153 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b1a01-7871-4fb5-b890-296ff47ec1a4 service placement] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:12:17.318428 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b1a01-7871-4fb5-b890-296ff47ec1a4 service placement] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:12:17.318692 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b1a01-7871-4fb5-b890-296ff47ec1a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:12:17.328015 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b1a01-7871-4fb5-b890-296ff47ec1a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:12:17.329596 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b1a01-7871-4fb5-b890-296ff47ec1a4 service placement] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:12:17.339579 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1460/2951] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:12:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:12:18.792999 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa263c-fe1a-4804-b709-d14504bf180f None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:12:18.803147 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa263c-fe1a-4804-b709-d14504bf180f None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:12:18.807809 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665f748-942d-44e7-a172-8ff9f48df36a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:12:18.808448 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665f748-942d-44e7-a172-8ff9f48df36a service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:12:18.808866 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665f748-942d-44e7-a172-8ff9f48df36a service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:12:18.809134 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665f748-942d-44e7-a172-8ff9f48df36a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:12:18.817389 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665f748-942d-44e7-a172-8ff9f48df36a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:12:18.818986 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665f748-942d-44e7-a172-8ff9f48df36a service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:12:18.827675 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1492/2952] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:12:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:12:27.335348 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=12 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:12:28.823812 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=19 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:12:32.714827 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b1a01-7871-4fb5-b890-296ff47ec1a4 service placement] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:12:32.725314 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b1a01-7871-4fb5-b890-296ff47ec1a4 service placement] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:12:32.729842 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d05026-8843-46e5-815c-4679a7c57970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:12:32.730447 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d05026-8843-46e5-815c-4679a7c57970 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:12:32.730739 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d05026-8843-46e5-815c-4679a7c57970 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:12:32.730991 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d05026-8843-46e5-815c-4679a7c57970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:12:32.742012 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d05026-8843-46e5-815c-4679a7c57970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:12:32.743423 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d05026-8843-46e5-815c-4679a7c57970 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:12:32.754309 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1461/2953] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:12:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:12:33.955577 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665f748-942d-44e7-a172-8ff9f48df36a service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:12:33.964432 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665f748-942d-44e7-a172-8ff9f48df36a service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:12:33.969759 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c1016-9fc8-48c8-9e60-d37974853b73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:12:33.970634 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c1016-9fc8-48c8-9e60-d37974853b73 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:12:33.971420 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c1016-9fc8-48c8-9e60-d37974853b73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:12:33.972170 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c1016-9fc8-48c8-9e60-d37974853b73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:12:33.988592 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c1016-9fc8-48c8-9e60-d37974853b73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:12:33.990023 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c1016-9fc8-48c8-9e60-d37974853b73 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:12:34.001330 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1493/2954] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:12:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:12:42.749574 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=6 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:12:43.996403 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=6 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:13:55.317242 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd9ccf-56aa-4700-a4d1-e68f419e1f54 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:13:55.318382 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd9ccf-56aa-4700-a4d1-e68f419e1f54 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:13:55.318691 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd9ccf-56aa-4700-a4d1-e68f419e1f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:13:55.340162 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-9cfd9ccf-56aa-4700-a4d1-e68f419e1f54 None None] MFA Rules not processed for user `04591cd035ef4961b8b7a93e294eb881`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 02:13:55.341862 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-9cfd9ccf-56aa-4700-a4d1-e68f419e1f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:13:55.354660 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1462/2955] 10.222.0.60 () {58 vars in 1018 bytes} [Sun Jul 31 02:13:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 02:13:55.376650 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472d445-333f-4d81-b86f-707aaea7ac40 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:13:55.377230 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472d445-333f-4d81-b86f-707aaea7ac40 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:13:55.377230 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472d445-333f-4d81-b86f-707aaea7ac40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:13:55.397941 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-b472d445-333f-4d81-b86f-707aaea7ac40 None None] MFA Rules not processed for user `04591cd035ef4961b8b7a93e294eb881`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 02:13:55.399288 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-b472d445-333f-4d81-b86f-707aaea7ac40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:13:55.410265 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1494/2956] 10.222.0.60 () {58 vars in 1059 bytes} [Sun Jul 31 02:13:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 02:13:55.417971 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd9ccf-56aa-4700-a4d1-e68f419e1f54 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:13:55.430488 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd9ccf-56aa-4700-a4d1-e68f419e1f54 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:13:55.437580 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2a74f-9fa2-41db-8ba1-21a4ed6fc8a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:13:55.438268 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2a74f-9fa2-41db-8ba1-21a4ed6fc8a4 service nova] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:13:55.438622 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2a74f-9fa2-41db-8ba1-21a4ed6fc8a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:13:55.438854 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2a74f-9fa2-41db-8ba1-21a4ed6fc8a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:13:55.449438 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a2a74f-9fa2-41db-8ba1-21a4ed6fc8a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:13:55.461909 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a2a74f-9fa2-41db-8ba1-21a4ed6fc8a4 service nova] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:13:55.477604 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1463/2957] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:13:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:13:55.522070 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba8966-01e5-4dc7-aff1-eba9f2d9054a None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:13:55.522349 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba8966-01e5-4dc7-aff1-eba9f2d9054a None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:13:55.522616 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba8966-01e5-4dc7-aff1-eba9f2d9054a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:13:55.542965 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-afba8966-01e5-4dc7-aff1-eba9f2d9054a None None] MFA Rules not processed for user `04591cd035ef4961b8b7a93e294eb881`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 02:13:55.544126 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-afba8966-01e5-4dc7-aff1-eba9f2d9054a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:13:55.553394 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1495/2958] 10.222.0.60 () {58 vars in 1059 bytes} [Sun Jul 31 02:13:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 02:13:55.559287 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d4f27-98d3-43a5-bed5-3227ce8703f4 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:13:55.559595 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d4f27-98d3-43a5-bed5-3227ce8703f4 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:13:55.559897 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d4f27-98d3-43a5-bed5-3227ce8703f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:13:55.580064 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-f94d4f27-98d3-43a5-bed5-3227ce8703f4 None None] MFA Rules not processed for user `04591cd035ef4961b8b7a93e294eb881`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 02:13:55.581270 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-f94d4f27-98d3-43a5-bed5-3227ce8703f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:13:55.590743 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1464/2959] 10.222.0.60 () {58 vars in 1009 bytes} [Sun Jul 31 02:13:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 02:13:55.601688 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba8966-01e5-4dc7-aff1-eba9f2d9054a None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:13:55.612802 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba8966-01e5-4dc7-aff1-eba9f2d9054a None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:13:55.616548 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d188d0-1f4f-40b7-a4c0-1be5abdd99d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:13:55.617247 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d188d0-1f4f-40b7-a4c0-1be5abdd99d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:13:55.617622 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d188d0-1f4f-40b7-a4c0-1be5abdd99d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:13:55.617893 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d188d0-1f4f-40b7-a4c0-1be5abdd99d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:13:55.628271 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d188d0-1f4f-40b7-a4c0-1be5abdd99d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:13:55.629692 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d188d0-1f4f-40b7-a4c0-1be5abdd99d4 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:13:55.640243 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1496/2960] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:13:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:13:56.574241 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022952e1-b778-4df3-8c60-d513c0f3e484 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:13:56.575374 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022952e1-b778-4df3-8c60-d513c0f3e484 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:13:56.575892 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022952e1-b778-4df3-8c60-d513c0f3e484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:13:56.616024 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-022952e1-b778-4df3-8c60-d513c0f3e484 None None] MFA Rules not processed for user `81117154f6d1474c805a69c5617c307d`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 02:13:56.617145 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-022952e1-b778-4df3-8c60-d513c0f3e484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:13:56.624376 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1465/2961] 10.222.0.70 () {58 vars in 1015 bytes} [Sun Jul 31 02:13:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 02:13:56.734555 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d188d0-1f4f-40b7-a4c0-1be5abdd99d4 service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:13:56.745458 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d188d0-1f4f-40b7-a4c0-1be5abdd99d4 service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:13:56.751264 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125f335-55fd-4467-9875-272fd1a9938f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:13:56.752039 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125f335-55fd-4467-9875-272fd1a9938f service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:13:56.752384 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125f335-55fd-4467-9875-272fd1a9938f service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:13:56.752710 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125f335-55fd-4467-9875-272fd1a9938f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:13:56.762406 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0125f335-55fd-4467-9875-272fd1a9938f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:13:56.764183 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0125f335-55fd-4467-9875-272fd1a9938f service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:13:56.772420 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1497/2962] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:13:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:13:56.821790 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08eb4f7-9aa7-40d2-b308-3d3748af339a None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:13:56.822054 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08eb4f7-9aa7-40d2-b308-3d3748af339a None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:13:56.822329 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08eb4f7-9aa7-40d2-b308-3d3748af339a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:13:56.842939 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-f08eb4f7-9aa7-40d2-b308-3d3748af339a None None] MFA Rules not processed for user `04591cd035ef4961b8b7a93e294eb881`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 02:13:56.844200 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-f08eb4f7-9aa7-40d2-b308-3d3748af339a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:13:56.853680 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1466/2963] 10.222.0.60 () {58 vars in 1009 bytes} [Sun Jul 31 02:13:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 02:13:56.864966 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125f335-55fd-4467-9875-272fd1a9938f service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:13:56.873802 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125f335-55fd-4467-9875-272fd1a9938f service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:13:56.878088 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab93c69-4e07-473c-b46a-a65614af5768 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:13:56.878673 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab93c69-4e07-473c-b46a-a65614af5768 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:13:56.878944 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab93c69-4e07-473c-b46a-a65614af5768 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:13:56.879205 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab93c69-4e07-473c-b46a-a65614af5768 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:13:56.890695 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab93c69-4e07-473c-b46a-a65614af5768 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:13:56.892156 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab93c69-4e07-473c-b46a-a65614af5768 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:13:56.903228 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1498/2964] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:13:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:14:02.738952 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08eb4f7-9aa7-40d2-b308-3d3748af339a None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:14:02.748855 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08eb4f7-9aa7-40d2-b308-3d3748af339a None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:14:02.752752 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87451298-62f6-4bcf-af68-b4b968ca22da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:14:02.753406 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87451298-62f6-4bcf-af68-b4b968ca22da service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:14:02.753680 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87451298-62f6-4bcf-af68-b4b968ca22da service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:14:02.753949 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87451298-62f6-4bcf-af68-b4b968ca22da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:14:02.815332 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87451298-62f6-4bcf-af68-b4b968ca22da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:14:02.816809 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87451298-62f6-4bcf-af68-b4b968ca22da service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:14:02.826766 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1467/2965] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:14:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:14:06.103762 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1a0d0-5978-44c2-86ed-9a0699345c14 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:14:06.104302 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1a0d0-5978-44c2-86ed-9a0699345c14 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:14:06.104302 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1a0d0-5978-44c2-86ed-9a0699345c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:14:06.124811 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-07a1a0d0-5978-44c2-86ed-9a0699345c14 None None] MFA Rules not processed for user `657a3f73879e4b31b70a1c4f73e80f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 02:14:06.126062 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-07a1a0d0-5978-44c2-86ed-9a0699345c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:14:06.136222 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1499/2966] 10.222.0.60 () {58 vars in 1018 bytes} [Sun Jul 31 02:14:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 02:14:06.148434 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87451298-62f6-4bcf-af68-b4b968ca22da service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:14:06.168550 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87451298-62f6-4bcf-af68-b4b968ca22da service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:14:06.174283 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e1ca2-4bce-4813-9528-cba168bdeb50 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:14:06.175273 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e1ca2-4bce-4813-9528-cba168bdeb50 service placement] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:14:06.175593 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e1ca2-4bce-4813-9528-cba168bdeb50 service placement] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:14:06.175872 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e1ca2-4bce-4813-9528-cba168bdeb50 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:14:06.193662 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84e1ca2-4bce-4813-9528-cba168bdeb50 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:14:06.195944 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84e1ca2-4bce-4813-9528-cba168bdeb50 service placement] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:14:06.207665 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1468/2967] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:14:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:14:09.531036 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a1a0d0-5978-44c2-86ed-9a0699345c14 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:14:09.541891 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a1a0d0-5978-44c2-86ed-9a0699345c14 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:14:09.547289 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df2b20-be06-459d-84ef-447fb810acbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:14:09.548023 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df2b20-be06-459d-84ef-447fb810acbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:14:09.548304 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df2b20-be06-459d-84ef-447fb810acbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:14:09.548577 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df2b20-be06-459d-84ef-447fb810acbe admin admin] PATH_INFO: `/v3/users/feff0e6c55484f5b9859dcc79d73a21b` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:14:09.549783 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df2b20-be06-459d-84ef-447fb810acbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=feff0e6c55484f5b9859dcc79d73a21b)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:14:09.551767 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df2b20-be06-459d-84ef-447fb810acbe admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:14:09.604582 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-d8df2b20-be06-459d-84ef-447fb810acbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'feff0e6c55484f5b9859dcc79d73a21b'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:14:09.611648 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-d8df2b20-be06-459d-84ef-447fb810acbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'feff0e6c55484f5b9859dcc79d73a21b'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:14:09.612315 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-d8df2b20-be06-459d-84ef-447fb810acbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'feff0e6c55484f5b9859dcc79d73a21b'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:14:09.624787 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-d8df2b20-be06-459d-84ef-447fb810acbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'feff0e6c55484f5b9859dcc79d73a21b'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:14:09.625456 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-d8df2b20-be06-459d-84ef-447fb810acbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'feff0e6c55484f5b9859dcc79d73a21b'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:14:09.640008 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1500/2968] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 02:14:09 2022] DELETE /identity/v3/users/feff0e6c55484f5b9859dcc79d73a21b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 02:14:09.821635 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e1ca2-4bce-4813-9528-cba168bdeb50 service placement] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:14:09.837587 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e1ca2-4bce-4813-9528-cba168bdeb50 service placement] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:14:09.894430 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf97942-bef7-49aa-b8ec-7a448c8753f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:14:09.895073 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf97942-bef7-49aa-b8ec-7a448c8753f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:14:09.895346 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf97942-bef7-49aa-b8ec-7a448c8753f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:14:09.895645 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf97942-bef7-49aa-b8ec-7a448c8753f5 admin admin] PATH_INFO: `/v3/projects/112cd13518804811a9857f3a5b5bebaa` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:14:09.896785 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf97942-bef7-49aa-b8ec-7a448c8753f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=112cd13518804811a9857f3a5b5bebaa)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:14:09.898689 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf97942-bef7-49aa-b8ec-7a448c8753f5 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:14:09.935274 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:14:09.948831 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-dbf97942-bef7-49aa-b8ec-7a448c8753f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '112cd13518804811a9857f3a5b5bebaa', 'request_id': 'req-dbf97942-bef7-49aa-b8ec-7a448c8753f5'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:14:09.954439 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-dbf97942-bef7-49aa-b8ec-7a448c8753f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '112cd13518804811a9857f3a5b5bebaa', 'request_id': 'req-dbf97942-bef7-49aa-b8ec-7a448c8753f5'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:14:09.960629 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-dbf97942-bef7-49aa-b8ec-7a448c8753f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '112cd13518804811a9857f3a5b5bebaa', 'request_id': 'req-dbf97942-bef7-49aa-b8ec-7a448c8753f5'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:14:09.974336 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-dbf97942-bef7-49aa-b8ec-7a448c8753f5 admin admin] The token cache is being invalidate because project 112cd13518804811a9857f3a5b5bebaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 02:14:09.974626 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-dbf97942-bef7-49aa-b8ec-7a448c8753f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:14:09.975257 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-dbf97942-bef7-49aa-b8ec-7a448c8753f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:14:09.976875 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1469/2969] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 02:14:09 2022] DELETE /identity/v3/projects/112cd13518804811a9857f3a5b5bebaa => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 02:14:09.980988 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df2b20-be06-459d-84ef-447fb810acbe admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:14:09.982420 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-d8df2b20-be06-459d-84ef-447fb810acbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:14:09.995911 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df2b20-be06-459d-84ef-447fb810acbe admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:14:10.053977 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc10d8-cb69-49fd-af5a-1164dd54d464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:14:10.054611 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc10d8-cb69-49fd-af5a-1164dd54d464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:14:10.054883 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc10d8-cb69-49fd-af5a-1164dd54d464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:14:10.055162 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc10d8-cb69-49fd-af5a-1164dd54d464 admin admin] PATH_INFO: `/v3/users/e8c6468774ee414d83fd60ca528905fd` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:14:10.056345 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc10d8-cb69-49fd-af5a-1164dd54d464 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8c6468774ee414d83fd60ca528905fd)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:14:10.058260 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc10d8-cb69-49fd-af5a-1164dd54d464 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:14:10.071730 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:14:10.105412 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-e5bc10d8-cb69-49fd-af5a-1164dd54d464 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8c6468774ee414d83fd60ca528905fd'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:14:10.112455 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-e5bc10d8-cb69-49fd-af5a-1164dd54d464 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8c6468774ee414d83fd60ca528905fd'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:14:10.113095 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-e5bc10d8-cb69-49fd-af5a-1164dd54d464 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8c6468774ee414d83fd60ca528905fd'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:14:10.125142 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-e5bc10d8-cb69-49fd-af5a-1164dd54d464 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8c6468774ee414d83fd60ca528905fd'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:14:10.125760 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-e5bc10d8-cb69-49fd-af5a-1164dd54d464 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8c6468774ee414d83fd60ca528905fd'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:14:10.140548 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1501/2970] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 02:14:09 2022] DELETE /identity/v3/users/e8c6468774ee414d83fd60ca528905fd => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 02:14:10.328085 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf97942-bef7-49aa-b8ec-7a448c8753f5 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:14:10.329683 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-dbf97942-bef7-49aa-b8ec-7a448c8753f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:14:10.342952 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf97942-bef7-49aa-b8ec-7a448c8753f5 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:14:10.406414 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d71317-672e-4b85-b5da-461e76837fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:14:10.407062 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d71317-672e-4b85-b5da-461e76837fba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:14:10.407336 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d71317-672e-4b85-b5da-461e76837fba admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:14:10.407640 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d71317-672e-4b85-b5da-461e76837fba admin admin] PATH_INFO: `/v3/projects/d110a5f9082041a68c4187e9699b8e27` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:14:10.408764 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d71317-672e-4b85-b5da-461e76837fba admin admin] RBAC: Authorizing `identity:delete_project(project_id=d110a5f9082041a68c4187e9699b8e27)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:14:10.410648 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d71317-672e-4b85-b5da-461e76837fba admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:14:10.456285 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-80d71317-672e-4b85-b5da-461e76837fba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd110a5f9082041a68c4187e9699b8e27', 'request_id': 'req-80d71317-672e-4b85-b5da-461e76837fba'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:14:10.461726 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-80d71317-672e-4b85-b5da-461e76837fba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd110a5f9082041a68c4187e9699b8e27', 'request_id': 'req-80d71317-672e-4b85-b5da-461e76837fba'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:14:10.467834 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-80d71317-672e-4b85-b5da-461e76837fba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd110a5f9082041a68c4187e9699b8e27', 'request_id': 'req-80d71317-672e-4b85-b5da-461e76837fba'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:14:10.481119 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-80d71317-672e-4b85-b5da-461e76837fba admin admin] The token cache is being invalidate because project d110a5f9082041a68c4187e9699b8e27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 02:14:10.481388 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-80d71317-672e-4b85-b5da-461e76837fba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:14:10.482000 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-80d71317-672e-4b85-b5da-461e76837fba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:14:10.483553 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1470/2971] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 02:14:10 2022] DELETE /identity/v3/projects/d110a5f9082041a68c4187e9699b8e27 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 02:14:10.489027 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b676869-66f6-41ff-9a68-326e122637fd None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:14:10.489317 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b676869-66f6-41ff-9a68-326e122637fd None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:14:10.489592 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b676869-66f6-41ff-9a68-326e122637fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:14:10.510039 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-2b676869-66f6-41ff-9a68-326e122637fd None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 02:14:10.511182 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-2b676869-66f6-41ff-9a68-326e122637fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:14:10.574323 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1502/2972] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 02:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 02:14:10.582699 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0455612-1ef5-41c3-a891-6f66a186757c None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:14:10.582983 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0455612-1ef5-41c3-a891-6f66a186757c None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:14:10.583244 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0455612-1ef5-41c3-a891-6f66a186757c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:14:10.604527 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-f0455612-1ef5-41c3-a891-6f66a186757c None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 02:14:10.605781 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-f0455612-1ef5-41c3-a891-6f66a186757c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:14:10.615544 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1471/2973] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 02:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 02:14:10.620115 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b676869-66f6-41ff-9a68-326e122637fd None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:14:10.630163 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b676869-66f6-41ff-9a68-326e122637fd None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:14:10.635229 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ef1f1-e362-4705-ab0d-eec2daa6bc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:14:10.635861 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ef1f1-e362-4705-ab0d-eec2daa6bc5b admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:14:10.636150 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ef1f1-e362-4705-ab0d-eec2daa6bc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:14:10.636418 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ef1f1-e362-4705-ab0d-eec2daa6bc5b admin admin] PATH_INFO: `/v3/domains` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:14:10.637118 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515ef1f1-e362-4705-ab0d-eec2daa6bc5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 02:14:10.637418 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515ef1f1-e362-4705-ab0d-eec2daa6bc5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:14:10.639015 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515ef1f1-e362-4705-ab0d-eec2daa6bc5b admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:14:10.651184 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1503/2974] 10.222.0.60 () {58 vars in 1153 bytes} [Sun Jul 31 02:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 02:14:10.655700 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0455612-1ef5-41c3-a891-6f66a186757c None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:14:10.665296 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0455612-1ef5-41c3-a891-6f66a186757c None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:14:10.670601 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263df12-e1b2-474e-8617-949c447b5e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:14:10.671258 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263df12-e1b2-474e-8617-949c447b5e4d admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:14:10.671577 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263df12-e1b2-474e-8617-949c447b5e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:14:10.671849 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263df12-e1b2-474e-8617-949c447b5e4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:14:10.672514 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9263df12-e1b2-474e-8617-949c447b5e4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:14:10.674449 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9263df12-e1b2-474e-8617-949c447b5e4d admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:14:10.714773 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1472/2975] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 02:14:10 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 02:14:10.720680 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ef1f1-e362-4705-ab0d-eec2daa6bc5b admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:14:10.731459 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ef1f1-e362-4705-ab0d-eec2daa6bc5b admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:14:10.790412 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff591f5b-4ca1-403d-9c9c-5ddce7f15c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:14:10.790949 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff591f5b-4ca1-403d-9c9c-5ddce7f15c70 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:14:10.791227 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff591f5b-4ca1-403d-9c9c-5ddce7f15c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:14:10.791505 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff591f5b-4ca1-403d-9c9c-5ddce7f15c70 admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:14:10.792188 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff591f5b-4ca1-403d-9c9c-5ddce7f15c70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:14:10.794166 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff591f5b-4ca1-403d-9c9c-5ddce7f15c70 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:14:10.817081 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1504/2976] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 02:14:10 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 02:14:10.821600 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263df12-e1b2-474e-8617-949c447b5e4d admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:14:10.832353 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263df12-e1b2-474e-8617-949c447b5e4d admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:14:10.837630 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d81718-da9a-4d70-bac8-0959ced5a794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:14:10.838244 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d81718-da9a-4d70-bac8-0959ced5a794 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:14:10.838521 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d81718-da9a-4d70-bac8-0959ced5a794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:14:10.838788 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d81718-da9a-4d70-bac8-0959ced5a794 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:14:10.839514 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d81718-da9a-4d70-bac8-0959ced5a794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:14:10.841166 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d81718-da9a-4d70-bac8-0959ced5a794 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:14:10.846513 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:14:10.855512 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1473/2977] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 02:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 02:14:10.856803 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff591f5b-4ca1-403d-9c9c-5ddce7f15c70 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:14:10.869487 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff591f5b-4ca1-403d-9c9c-5ddce7f15c70 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:14:10.874433 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969a0b0-a7de-4d7b-999f-9e5d32544edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:14:10.875054 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969a0b0-a7de-4d7b-999f-9e5d32544edc admin admin] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:14:10.875336 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969a0b0-a7de-4d7b-999f-9e5d32544edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:14:10.875673 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969a0b0-a7de-4d7b-999f-9e5d32544edc admin admin] PATH_INFO: `/v3/roles` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:14:10.876377 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969a0b0-a7de-4d7b-999f-9e5d32544edc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:14:10.877984 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969a0b0-a7de-4d7b-999f-9e5d32544edc admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:14:10.880086 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:14:10.890801 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1505/2978] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 02:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 02:14:10.894672 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d81718-da9a-4d70-bac8-0959ced5a794 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:14:10.904959 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d81718-da9a-4d70-bac8-0959ced5a794 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:14:10.910418 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555204bf-ca6c-4b39-98cd-0a42eeb2a2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:14:10.911084 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555204bf-ca6c-4b39-98cd-0a42eeb2a2b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:14:10.911360 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555204bf-ca6c-4b39-98cd-0a42eeb2a2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:14:10.911638 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555204bf-ca6c-4b39-98cd-0a42eeb2a2b5 admin admin] PATH_INFO: `/v3/projects/a366cc3df2cd48f6a299e8ac0e489f95/users/7497b7bb2ab346df87641db36627c95b/roles/12a8e2ae2b6b4d699aac9ba2319cf57d` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:14:10.928009 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555204bf-ca6c-4b39-98cd-0a42eeb2a2b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a366cc3df2cd48f6a299e8ac0e489f95, user_id=7497b7bb2ab346df87641db36627c95b, role_id=12a8e2ae2b6b4d699aac9ba2319cf57d)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:14:10.930651 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555204bf-ca6c-4b39-98cd-0a42eeb2a2b5 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:14:10.946694 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1474/2979] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 02:14:10 2022] PUT /identity/v3/projects/a366cc3df2cd48f6a299e8ac0e489f95/users/7497b7bb2ab346df87641db36627c95b/roles/12a8e2ae2b6b4d699aac9ba2319cf57d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 02:14:10.951869 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422e43d-5cd9-4600-876c-64e607ae9a5b None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:14:10.952207 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422e43d-5cd9-4600-876c-64e607ae9a5b None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:14:10.952488 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422e43d-5cd9-4600-876c-64e607ae9a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:14:10.972517 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-3422e43d-5cd9-4600-876c-64e607ae9a5b None None] MFA Rules not processed for user `652828201b9e47a5b54a3c3110e80fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 02:14:10.973733 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-3422e43d-5cd9-4600-876c-64e607ae9a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:14:11.037701 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1506/2980] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 02:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 02:14:11.047859 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555204bf-ca6c-4b39-98cd-0a42eeb2a2b5 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:14:11.049720 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-555204bf-ca6c-4b39-98cd-0a42eeb2a2b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:14:11.113039 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555204bf-ca6c-4b39-98cd-0a42eeb2a2b5 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:14:11.118013 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36a953-ce6a-4dfb-8502-4fb99464c331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:14:11.118642 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36a953-ce6a-4dfb-8502-4fb99464c331 service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:14:11.118918 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36a953-ce6a-4dfb-8502-4fb99464c331 service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:14:11.119185 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36a953-ce6a-4dfb-8502-4fb99464c331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:14:11.128708 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea36a953-ce6a-4dfb-8502-4fb99464c331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:14:11.130126 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea36a953-ce6a-4dfb-8502-4fb99464c331 service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:14:11.139783 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1475/2981] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:14:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:14:15.243763 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc1d86-c248-4d69-8000-b05598368582 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:14:15.244705 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc1d86-c248-4d69-8000-b05598368582 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:14:15.244994 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc1d86-c248-4d69-8000-b05598368582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:14:15.275518 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-8acc1d86-c248-4d69-8000-b05598368582 None None] MFA Rules not processed for user `7497b7bb2ab346df87641db36627c95b`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 02:14:15.276878 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-8acc1d86-c248-4d69-8000-b05598368582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:14:15.346397 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1507/2982] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 02:14:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 02:14:15.350723 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36a953-ce6a-4dfb-8502-4fb99464c331 service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:14:15.362947 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36a953-ce6a-4dfb-8502-4fb99464c331 service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:14:15.372184 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c85a30-d3a3-4b1f-aebb-feb963d396b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:14:15.374400 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c85a30-d3a3-4b1f-aebb-feb963d396b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:14:15.374645 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c85a30-d3a3-4b1f-aebb-feb963d396b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:14:15.375348 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c85a30-d3a3-4b1f-aebb-feb963d396b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:14:15.376017 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c85a30-d3a3-4b1f-aebb-feb963d396b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:14:15.377989 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c85a30-d3a3-4b1f-aebb-feb963d396b2 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:14:15.410028 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1476/2983] 10.222.0.60 () {60 vars in 1153 bytes} [Sun Jul 31 02:14:15 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 02:14:15.414091 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc1d86-c248-4d69-8000-b05598368582 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:14:15.426070 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc1d86-c248-4d69-8000-b05598368582 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:14:15.483036 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee23b7-b9ee-4c18-a718-e8ecf1220ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:14:15.483803 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee23b7-b9ee-4c18-a718-e8ecf1220ba2 admin admin] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:14:15.484428 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee23b7-b9ee-4c18-a718-e8ecf1220ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:14:15.484698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee23b7-b9ee-4c18-a718-e8ecf1220ba2 admin admin] PATH_INFO: `/v3/users` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:14:15.485358 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ee23b7-b9ee-4c18-a718-e8ecf1220ba2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:14:15.488118 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ee23b7-b9ee-4c18-a718-e8ecf1220ba2 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:14:15.514858 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1508/2984] 10.222.0.60 () {60 vars in 1144 bytes} [Sun Jul 31 02:14:15 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 02:14:15.516099 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c85a30-d3a3-4b1f-aebb-feb963d396b2 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:14:15.526549 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c85a30-d3a3-4b1f-aebb-feb963d396b2 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:14:15.531163 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ea717-2236-4093-b107-03cec1a2ddc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:14:15.531811 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ea717-2236-4093-b107-03cec1a2ddc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:14:15.532106 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ea717-2236-4093-b107-03cec1a2ddc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:14:15.532357 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ea717-2236-4093-b107-03cec1a2ddc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:14:15.533055 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ea717-2236-4093-b107-03cec1a2ddc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:14:15.534657 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ea717-2236-4093-b107-03cec1a2ddc2 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:14:15.546470 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1477/2985] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 02:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 02:14:15.550817 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee23b7-b9ee-4c18-a718-e8ecf1220ba2 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:14:15.561994 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee23b7-b9ee-4c18-a718-e8ecf1220ba2 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:14:15.568083 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64428477-8a3d-4309-aa91-282adb00884b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:14:15.568755 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64428477-8a3d-4309-aa91-282adb00884b admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:14:15.569035 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64428477-8a3d-4309-aa91-282adb00884b admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:14:15.569304 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64428477-8a3d-4309-aa91-282adb00884b admin admin] PATH_INFO: `/v3/projects/3ba1ac54f53e46d7b9c37b3f71d3d2fe/users/1f2d1ace6da5410b8a2af85a97377f51/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:14:15.587415 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64428477-8a3d-4309-aa91-282adb00884b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ba1ac54f53e46d7b9c37b3f71d3d2fe, user_id=1f2d1ace6da5410b8a2af85a97377f51, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:14:15.590143 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64428477-8a3d-4309-aa91-282adb00884b admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:14:15.592424 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:14:15.605546 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1509/2986] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 02:14:15 2022] PUT /identity/v3/projects/3ba1ac54f53e46d7b9c37b3f71d3d2fe/users/1f2d1ace6da5410b8a2af85a97377f51/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 02:14:15.609984 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ea717-2236-4093-b107-03cec1a2ddc2 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:14:15.623998 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ea717-2236-4093-b107-03cec1a2ddc2 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:14:15.683640 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0648cb-741f-4f38-8299-742b8ebe3a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:14:15.684387 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0648cb-741f-4f38-8299-742b8ebe3a09 admin admin] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:14:15.684703 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0648cb-741f-4f38-8299-742b8ebe3a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:14:15.684960 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0648cb-741f-4f38-8299-742b8ebe3a09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:14:15.685662 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0648cb-741f-4f38-8299-742b8ebe3a09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:14:15.687459 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0648cb-741f-4f38-8299-742b8ebe3a09 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:14:15.698640 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1478/2987] 10.222.0.60 () {58 vars in 1122 bytes} [Sun Jul 31 02:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 02:14:15.703084 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64428477-8a3d-4309-aa91-282adb00884b admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:14:15.713751 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64428477-8a3d-4309-aa91-282adb00884b admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:14:15.719599 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae0ace-af4a-4cbd-a433-ccc38b3c16e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:14:15.720274 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae0ace-af4a-4cbd-a433-ccc38b3c16e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:14:15.720581 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae0ace-af4a-4cbd-a433-ccc38b3c16e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:14:15.720852 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae0ace-af4a-4cbd-a433-ccc38b3c16e7 admin admin] PATH_INFO: `/v3/projects/3ba1ac54f53e46d7b9c37b3f71d3d2fe/users/1f2d1ace6da5410b8a2af85a97377f51/roles/fef526a7d2e741ce995d107f3ac934ae` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:14:15.723089 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae0ace-af4a-4cbd-a433-ccc38b3c16e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ba1ac54f53e46d7b9c37b3f71d3d2fe, user_id=1f2d1ace6da5410b8a2af85a97377f51, role_id=fef526a7d2e741ce995d107f3ac934ae)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:14:15.725799 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae0ace-af4a-4cbd-a433-ccc38b3c16e7 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:14:15.738873 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1510/2988] 10.222.0.60 () {60 vars in 1483 bytes} [Sun Jul 31 02:14:15 2022] PUT /identity/v3/projects/3ba1ac54f53e46d7b9c37b3f71d3d2fe/users/1f2d1ace6da5410b8a2af85a97377f51/roles/fef526a7d2e741ce995d107f3ac934ae => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 02:14:20.562367 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a221b-a31d-4b8b-8c28-3224c1dfca99 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:14:20.562367 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a221b-a31d-4b8b-8c28-3224c1dfca99 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:14:20.562367 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a221b-a31d-4b8b-8c28-3224c1dfca99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:14:20.597671 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-751a221b-a31d-4b8b-8c28-3224c1dfca99 None None] MFA Rules not processed for user `1f2d1ace6da5410b8a2af85a97377f51`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 02:14:20.598899 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-751a221b-a31d-4b8b-8c28-3224c1dfca99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:14:20.632673 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:14:20.674887 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1479/2989] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 02:14:20 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 02:14:20.690931 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae0ace-af4a-4cbd-a433-ccc38b3c16e7 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:14:20.693655 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-6aae0ace-af4a-4cbd-a433-ccc38b3c16e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:14:20.771255 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae0ace-af4a-4cbd-a433-ccc38b3c16e7 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:14:20.776950 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529548ad-0801-4048-8fb4-aab9ee7de72b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:14:20.777589 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529548ad-0801-4048-8fb4-aab9ee7de72b service nova] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:14:20.777869 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529548ad-0801-4048-8fb4-aab9ee7de72b service nova] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:14:20.778141 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529548ad-0801-4048-8fb4-aab9ee7de72b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:14:20.834681 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529548ad-0801-4048-8fb4-aab9ee7de72b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:14:20.836332 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529548ad-0801-4048-8fb4-aab9ee7de72b service nova] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:14:20.846220 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1511/2990] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:14:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:14:21.911433 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b9673-74fc-4dca-9105-0c89e533618a None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:14:21.912417 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b9673-74fc-4dca-9105-0c89e533618a None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:14:21.912693 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b9673-74fc-4dca-9105-0c89e533618a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:14:21.932701 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-c15b9673-74fc-4dca-9105-0c89e533618a None None] MFA Rules not processed for user `7497b7bb2ab346df87641db36627c95b`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 02:14:21.934070 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-c15b9673-74fc-4dca-9105-0c89e533618a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:14:21.941662 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1480/2991] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 02:14:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 02:14:22.262390 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b814f1-8fe0-493f-853a-ff196a4406e0 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:14:22.263006 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b814f1-8fe0-493f-853a-ff196a4406e0 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:14:22.263006 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b814f1-8fe0-493f-853a-ff196a4406e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:14:22.283521 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-63b814f1-8fe0-493f-853a-ff196a4406e0 None None] MFA Rules not processed for user `81117154f6d1474c805a69c5617c307d`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 02:14:22.284744 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-63b814f1-8fe0-493f-853a-ff196a4406e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:14:22.338207 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1512/2992] 10.222.0.60 () {58 vars in 1009 bytes} [Sun Jul 31 02:14:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 02:14:22.349768 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b9673-74fc-4dca-9105-0c89e533618a None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:14:22.352328 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-c15b9673-74fc-4dca-9105-0c89e533618a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:14:22.366710 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b9673-74fc-4dca-9105-0c89e533618a None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:14:22.372074 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1559b66f-9309-4156-862c-cff6f722296b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:14:22.373130 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559b66f-9309-4156-862c-cff6f722296b service neutron] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:14:22.373806 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559b66f-9309-4156-862c-cff6f722296b service neutron] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:14:22.374440 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559b66f-9309-4156-862c-cff6f722296b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:14:22.384242 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1559b66f-9309-4156-862c-cff6f722296b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:14:22.386017 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1559b66f-9309-4156-862c-cff6f722296b service neutron] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:14:22.396930 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1481/2993] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:14:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:14:29.930627 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbecbd3c-6054-4c25-9a9a-187655314ce7 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:14:29.931690 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbecbd3c-6054-4c25-9a9a-187655314ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:14:29.932144 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbecbd3c-6054-4c25-9a9a-187655314ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:14:29.967972 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-dbecbd3c-6054-4c25-9a9a-187655314ce7 None None] MFA Rules not processed for user `04591cd035ef4961b8b7a93e294eb881`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 02:14:29.969284 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-dbecbd3c-6054-4c25-9a9a-187655314ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:14:29.978890 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1513/2994] 10.222.0.60 () {58 vars in 1018 bytes} [Sun Jul 31 02:14:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 02:14:29.994485 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1559b66f-9309-4156-862c-cff6f722296b service neutron] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:14:30.009427 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1559b66f-9309-4156-862c-cff6f722296b service neutron] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:14:30.015638 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea641148-57c0-4c99-826e-5a40b7f141cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:14:30.016262 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea641148-57c0-4c99-826e-5a40b7f141cb service nova] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:14:30.016540 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea641148-57c0-4c99-826e-5a40b7f141cb service nova] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:14:30.016808 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea641148-57c0-4c99-826e-5a40b7f141cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:14:30.026236 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea641148-57c0-4c99-826e-5a40b7f141cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:14:30.027882 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea641148-57c0-4c99-826e-5a40b7f141cb service nova] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:14:30.038329 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1482/2995] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:14:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:14:32.522775 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbecbd3c-6054-4c25-9a9a-187655314ce7 None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:14:32.533568 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbecbd3c-6054-4c25-9a9a-187655314ce7 None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:14:32.538738 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3f087-cda5-4662-b3a0-43f71ff05d38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81117154f6d1474c805a69c5617c307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:14:32.539443 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3f087-cda5-4662-b3a0-43f71ff05d38 service neutron] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:14:32.539750 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3f087-cda5-4662-b3a0-43f71ff05d38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:14:32.540019 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3f087-cda5-4662-b3a0-43f71ff05d38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:14:32.550080 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3f087-cda5-4662-b3a0-43f71ff05d38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:14:32.551542 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3f087-cda5-4662-b3a0-43f71ff05d38 service neutron] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:14:32.561128 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1514/2996] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:14:32 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:14:34.549195 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdd087-4d9f-4c36-b84d-523f0a61814f None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:14:34.549798 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdd087-4d9f-4c36-b84d-523f0a61814f None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:14:34.549798 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdd087-4d9f-4c36-b84d-523f0a61814f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:14:34.569918 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-21fdd087-4d9f-4c36-b84d-523f0a61814f None None] MFA Rules not processed for user `04591cd035ef4961b8b7a93e294eb881`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 02:14:34.571145 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-21fdd087-4d9f-4c36-b84d-523f0a61814f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:14:34.581375 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1483/2997] 10.222.0.60 () {58 vars in 1018 bytes} [Sun Jul 31 02:14:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 02:14:34.594772 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3f087-cda5-4662-b3a0-43f71ff05d38 service neutron] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:14:34.607982 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3f087-cda5-4662-b3a0-43f71ff05d38 service neutron] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:14:34.614708 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8134c-8991-45bd-88ff-87e61de40661 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04591cd035ef4961b8b7a93e294eb881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:14:34.615330 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8134c-8991-45bd-88ff-87e61de40661 service nova] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:14:34.615641 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8134c-8991-45bd-88ff-87e61de40661 service nova] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:14:34.615913 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8134c-8991-45bd-88ff-87e61de40661 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:14:34.621645 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:14:34.631861 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac8134c-8991-45bd-88ff-87e61de40661 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:14:34.635415 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac8134c-8991-45bd-88ff-87e61de40661 service nova] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:14:34.647909 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1515/2998] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:14:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:14:44.564806 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=33 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:14:44.643201 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=3 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:16:34.280256 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633a08f-87c8-4881-89f2-95b36c388509 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:16:34.280762 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633a08f-87c8-4881-89f2-95b36c388509 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:16:34.280876 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633a08f-87c8-4881-89f2-95b36c388509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:16:34.324934 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-8633a08f-87c8-4881-89f2-95b36c388509 None None] MFA Rules not processed for user `02ed9040d575462db4b270a5b57063f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 02:16:34.326167 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-8633a08f-87c8-4881-89f2-95b36c388509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:16:34.419398 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1484/2999] 10.222.0.60 () {58 vars in 1009 bytes} [Sun Jul 31 02:16:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 02:16:34.468395 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8134c-8991-45bd-88ff-87e61de40661 service nova] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:16:34.470061 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-8ac8134c-8991-45bd-88ff-87e61de40661 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:16:34.574314 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8134c-8991-45bd-88ff-87e61de40661 service nova] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:16:34.579521 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373021f-2b1d-46ee-af44-6d70e840628b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c8c98c1e2d24de89c7d07753fae02e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:16:34.580151 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373021f-2b1d-46ee-af44-6d70e840628b service swift] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:16:34.580428 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373021f-2b1d-46ee-af44-6d70e840628b service swift] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:16:34.580667 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373021f-2b1d-46ee-af44-6d70e840628b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:16:34.589208 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a373021f-2b1d-46ee-af44-6d70e840628b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:16:34.590833 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a373021f-2b1d-46ee-af44-6d70e840628b service swift] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:16:34.599062 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1516/3000] 10.222.0.60 () {60 vars in 1384 bytes} [Sun Jul 31 02:16:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 02:16:43.725028 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed5f52-f929-4493-aaa5-da6925c47cc4 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:16:43.725554 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed5f52-f929-4493-aaa5-da6925c47cc4 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:16:43.725554 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed5f52-f929-4493-aaa5-da6925c47cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:16:43.750715 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-57ed5f52-f929-4493-aaa5-da6925c47cc4 None None] MFA Rules not processed for user `7497b7bb2ab346df87641db36627c95b`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 02:16:43.751955 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-57ed5f52-f929-4493-aaa5-da6925c47cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:16:43.759616 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1485/3001] 10.222.0.60 () {58 vars in 958 bytes} [Sun Jul 31 02:16:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 02:16:44.439692 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36353682-1f23-4576-9649-b5c580360921 None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:16:44.440163 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36353682-1f23-4576-9649-b5c580360921 None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:16:44.443690 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36353682-1f23-4576-9649-b5c580360921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:16:44.475283 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-36353682-1f23-4576-9649-b5c580360921 None None] MFA Rules not processed for user `657a3f73879e4b31b70a1c4f73e80f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 02:16:44.476531 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-36353682-1f23-4576-9649-b5c580360921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:16:44.549250 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1517/3002] 10.222.0.60 () {58 vars in 1058 bytes} [Sun Jul 31 02:16:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 02:16:44.555502 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed5f52-f929-4493-aaa5-da6925c47cc4 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:16:44.568284 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed5f52-f929-4493-aaa5-da6925c47cc4 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:16:44.574372 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570db1eb-01b6-48c5-813f-1ed5831dfff6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:16:44.574987 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570db1eb-01b6-48c5-813f-1ed5831dfff6 service placement] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:16:44.575259 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570db1eb-01b6-48c5-813f-1ed5831dfff6 service placement] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:16:44.575547 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570db1eb-01b6-48c5-813f-1ed5831dfff6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:16:44.577385 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-570db1eb-01b6-48c5-813f-1ed5831dfff6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:16:44.588645 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570db1eb-01b6-48c5-813f-1ed5831dfff6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:16:44.590212 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570db1eb-01b6-48c5-813f-1ed5831dfff6 service placement] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:16:44.599921 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1486/3003] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:16:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:16:45.845576 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913fe33-f695-4ba2-b21e-dc939720707e None None] REQUEST_METHOD: `POST` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:16:45.846120 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913fe33-f695-4ba2-b21e-dc939720707e None None] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:16:45.846230 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913fe33-f695-4ba2-b21e-dc939720707e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:16:45.866142 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.auth.core [None req-6913fe33-f695-4ba2-b21e-dc939720707e None None] MFA Rules not processed for user `02ed9040d575462db4b270a5b57063f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 02:16:45.867344 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-6913fe33-f695-4ba2-b21e-dc939720707e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:16:45.874709 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1518/3004] 10.222.0.60 () {58 vars in 1009 bytes} [Sun Jul 31 02:16:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 02:16:45.887321 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570db1eb-01b6-48c5-813f-1ed5831dfff6 service placement] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:16:45.899141 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570db1eb-01b6-48c5-813f-1ed5831dfff6 service placement] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:16:45.904496 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c11ca-caba-4801-a93b-ad193a02eb9d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c8c98c1e2d24de89c7d07753fae02e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:16:45.905107 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c11ca-caba-4801-a93b-ad193a02eb9d service swift] REQUEST_METHOD: `GET` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:16:45.905385 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c11ca-caba-4801-a93b-ad193a02eb9d service swift] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:16:45.905654 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c11ca-caba-4801-a93b-ad193a02eb9d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:16:45.914314 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c11ca-caba-4801-a93b-ad193a02eb9d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:16:45.916070 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c11ca-caba-4801-a93b-ad193a02eb9d service swift] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:16:45.925015 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1487/3005] 10.222.0.60 () {60 vars in 1384 bytes} [Sun Jul 31 02:16:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 31 02:16:55.861235 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=87 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:16:55.921456 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=57 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:17:23.193783 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6913fe33-f695-4ba2-b21e-dc939720707e None None] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:17:23.207378 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6913fe33-f695-4ba2-b21e-dc939720707e None None] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:17:23.213960 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc7237-9152-4cf1-af38-135c141c0772 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:17:23.214580 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc7237-9152-4cf1-af38-135c141c0772 service placement] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:17:23.214860 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc7237-9152-4cf1-af38-135c141c0772 service placement] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:17:23.215130 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc7237-9152-4cf1-af38-135c141c0772 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:17:23.217048 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-bafc7237-9152-4cf1-af38-135c141c0772 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:17:23.229582 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc7237-9152-4cf1-af38-135c141c0772 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:17:23.231225 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc7237-9152-4cf1-af38-135c141c0772 service placement] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:17:23.242078 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1519/3006] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:17:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:17:33.237774 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=6 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:18:33.552437 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca671f-edbb-43f7-b902-0c3112ee2179 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:18:33.553145 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca671f-edbb-43f7-b902-0c3112ee2179 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:18:33.553316 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca671f-edbb-43f7-b902-0c3112ee2179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:18:33.611900 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-d4ca671f-edbb-43f7-b902-0c3112ee2179 None None] MFA Rules not processed for user `02ed9040d575462db4b270a5b57063f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 02:18:33.613173 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-d4ca671f-edbb-43f7-b902-0c3112ee2179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:18:33.636629 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1488/3007] 10.222.0.60 () {58 vars in 1009 bytes} [Sun Jul 31 02:18:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 02:18:33.679863 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc7237-9152-4cf1-af38-135c141c0772 service placement] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:18:33.700347 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc7237-9152-4cf1-af38-135c141c0772 service placement] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:18:33.705634 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e0fdf-ec11-4776-9f75-8fd41e7f7b74 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c8c98c1e2d24de89c7d07753fae02e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:18:33.706259 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e0fdf-ec11-4776-9f75-8fd41e7f7b74 service swift] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:18:33.706518 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e0fdf-ec11-4776-9f75-8fd41e7f7b74 service swift] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:18:33.706823 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e0fdf-ec11-4776-9f75-8fd41e7f7b74 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:18:33.714903 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e0fdf-ec11-4776-9f75-8fd41e7f7b74 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:18:33.716503 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e0fdf-ec11-4776-9f75-8fd41e7f7b74 service swift] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:18:33.724712 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1520/3008] 10.222.0.60 () {60 vars in 1384 bytes} [Sun Jul 31 02:18:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 02:18:42.905014 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3283825-6d87-4d38-af0e-ae5737867f34 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:18:42.905541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3283825-6d87-4d38-af0e-ae5737867f34 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:18:42.905541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3283825-6d87-4d38-af0e-ae5737867f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:18:42.926768 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-b3283825-6d87-4d38-af0e-ae5737867f34 None None] MFA Rules not processed for user `02ed9040d575462db4b270a5b57063f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 02:18:42.928002 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-b3283825-6d87-4d38-af0e-ae5737867f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:18:42.936929 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1489/3009] 10.222.0.60 () {58 vars in 967 bytes} [Sun Jul 31 02:18:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 02:18:42.950698 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e0fdf-ec11-4776-9f75-8fd41e7f7b74 service swift] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:18:42.961782 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e0fdf-ec11-4776-9f75-8fd41e7f7b74 service swift] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:18:42.968166 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f00aa-17ef-4af2-a561-6021d9ceb578 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c8c98c1e2d24de89c7d07753fae02e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:18:42.968771 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f00aa-17ef-4af2-a561-6021d9ceb578 service swift] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:18:42.969047 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f00aa-17ef-4af2-a561-6021d9ceb578 service swift] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:18:42.969317 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f00aa-17ef-4af2-a561-6021d9ceb578 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:18:42.977924 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062f00aa-17ef-4af2-a561-6021d9ceb578 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:18:42.979576 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062f00aa-17ef-4af2-a561-6021d9ceb578 service swift] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:18:42.988107 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1521/3010] 10.222.0.60 () {60 vars in 1384 bytes} [Sun Jul 31 02:18:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 02:18:47.237200 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fa5a5-db0e-42b0-ad39-924e1974d5a1 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:18:47.237652 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fa5a5-db0e-42b0-ad39-924e1974d5a1 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:18:47.237759 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fa5a5-db0e-42b0-ad39-924e1974d5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:18:47.257919 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-765fa5a5-db0e-42b0-ad39-924e1974d5a1 None None] MFA Rules not processed for user `02ed9040d575462db4b270a5b57063f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 02:18:47.259151 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-765fa5a5-db0e-42b0-ad39-924e1974d5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:18:47.267288 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1490/3011] 10.222.0.60 () {58 vars in 967 bytes} [Sun Jul 31 02:18:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 02:18:47.280040 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f00aa-17ef-4af2-a561-6021d9ceb578 service swift] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:18:47.290925 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f00aa-17ef-4af2-a561-6021d9ceb578 service swift] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:18:47.296259 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db173ee-c4f2-4c0e-aa9f-e8dbbc777a22 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c8c98c1e2d24de89c7d07753fae02e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:18:47.296890 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db173ee-c4f2-4c0e-aa9f-e8dbbc777a22 service swift] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:18:47.297167 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db173ee-c4f2-4c0e-aa9f-e8dbbc777a22 service swift] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:18:47.297436 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db173ee-c4f2-4c0e-aa9f-e8dbbc777a22 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:18:47.305579 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db173ee-c4f2-4c0e-aa9f-e8dbbc777a22 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:18:47.307180 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db173ee-c4f2-4c0e-aa9f-e8dbbc777a22 service swift] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:18:47.315418 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1522/3012] 10.222.0.60 () {60 vars in 1384 bytes} [Sun Jul 31 02:18:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 02:18:57.252308 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=27 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:18:57.312216 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=22 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:18:58.770344 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41ee2f-35d6-4709-9dee-46c7b9728853 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:18:58.770813 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41ee2f-35d6-4709-9dee-46c7b9728853 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:18:58.770912 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41ee2f-35d6-4709-9dee-46c7b9728853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:18:58.792197 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-6b41ee2f-35d6-4709-9dee-46c7b9728853 None None] MFA Rules not processed for user `657a3f73879e4b31b70a1c4f73e80f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 02:18:58.793418 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-6b41ee2f-35d6-4709-9dee-46c7b9728853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:18:58.805718 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1491/3013] 10.222.0.60 () {58 vars in 1018 bytes} [Sun Jul 31 02:18:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 02:18:58.830574 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db173ee-c4f2-4c0e-aa9f-e8dbbc777a22 service swift] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:18:58.843882 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db173ee-c4f2-4c0e-aa9f-e8dbbc777a22 service swift] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:18:58.845741 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41ee2f-35d6-4709-9dee-46c7b9728853 None None] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:18:58.849619 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5b959-147d-4031-b086-eeabc35a4132 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:18:58.850875 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5b959-147d-4031-b086-eeabc35a4132 service placement] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:18:58.851154 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5b959-147d-4031-b086-eeabc35a4132 service placement] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:18:58.851441 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5b959-147d-4031-b086-eeabc35a4132 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:18:58.865215 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea5b959-147d-4031-b086-eeabc35a4132 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:18:58.866867 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea5b959-147d-4031-b086-eeabc35a4132 service placement] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:18:58.880887 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1523/3014] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:18:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:18:58.934038 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41ee2f-35d6-4709-9dee-46c7b9728853 None None] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:18:58.938588 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15cfdf-1741-4268-b493-28135447afb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:18:58.939236 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15cfdf-1741-4268-b493-28135447afb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:18:58.939547 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15cfdf-1741-4268-b493-28135447afb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:18:58.939829 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15cfdf-1741-4268-b493-28135447afb0 admin admin] PATH_INFO: `/v3/users/7497b7bb2ab346df87641db36627c95b` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:18:58.941002 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15cfdf-1741-4268-b493-28135447afb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7497b7bb2ab346df87641db36627c95b)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:18:58.943064 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15cfdf-1741-4268-b493-28135447afb0 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:18:58.992888 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-cd15cfdf-1741-4268-b493-28135447afb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7497b7bb2ab346df87641db36627c95b'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:18:58.993549 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-cd15cfdf-1741-4268-b493-28135447afb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7497b7bb2ab346df87641db36627c95b'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:18:59.005789 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-cd15cfdf-1741-4268-b493-28135447afb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7497b7bb2ab346df87641db36627c95b'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:18:59.015756 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-cd15cfdf-1741-4268-b493-28135447afb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7497b7bb2ab346df87641db36627c95b'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:18:59.016541 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-cd15cfdf-1741-4268-b493-28135447afb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7497b7bb2ab346df87641db36627c95b'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:18:59.028692 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1492/3015] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 02:18:58 2022] DELETE /identity/v3/users/7497b7bb2ab346df87641db36627c95b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 02:18:59.229120 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5b959-147d-4031-b086-eeabc35a4132 service placement] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:18:59.240592 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5b959-147d-4031-b086-eeabc35a4132 service placement] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:18:59.299900 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5a992c-8088-4d61-b033-294da175d652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:18:59.300546 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a992c-8088-4d61-b033-294da175d652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:18:59.300822 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a992c-8088-4d61-b033-294da175d652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:18:59.301122 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a992c-8088-4d61-b033-294da175d652 admin admin] PATH_INFO: `/v3/projects/a366cc3df2cd48f6a299e8ac0e489f95` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:18:59.302329 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5a992c-8088-4d61-b033-294da175d652 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a366cc3df2cd48f6a299e8ac0e489f95)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:18:59.304267 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5a992c-8088-4d61-b033-294da175d652 admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:18:59.352853 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-da5a992c-8088-4d61-b033-294da175d652 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a366cc3df2cd48f6a299e8ac0e489f95', 'request_id': 'req-da5a992c-8088-4d61-b033-294da175d652'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:18:59.359418 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-da5a992c-8088-4d61-b033-294da175d652 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a366cc3df2cd48f6a299e8ac0e489f95', 'request_id': 'req-da5a992c-8088-4d61-b033-294da175d652'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:18:59.366740 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-da5a992c-8088-4d61-b033-294da175d652 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a366cc3df2cd48f6a299e8ac0e489f95', 'request_id': 'req-da5a992c-8088-4d61-b033-294da175d652'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:18:59.393609 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-da5a992c-8088-4d61-b033-294da175d652 admin admin] The token cache is being invalidate because project a366cc3df2cd48f6a299e8ac0e489f95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 02:18:59.393895 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-da5a992c-8088-4d61-b033-294da175d652 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:18:59.394541 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-da5a992c-8088-4d61-b033-294da175d652 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:18:59.396112 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1524/3016] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 02:18:59 2022] DELETE /identity/v3/projects/a366cc3df2cd48f6a299e8ac0e489f95 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 02:18:59.400280 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15cfdf-1741-4268-b493-28135447afb0 admin admin] Authenticating user token {{(pid=80703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:18:59.401837 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-cd15cfdf-1741-4268-b493-28135447afb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:18:59.417656 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15cfdf-1741-4268-b493-28135447afb0 admin admin] Validating token access rules against request {{(pid=80703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:18:59.474961 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:18:59.482848 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f163b-f086-4fe8-a343-db5d40a85e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:18:59.483869 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f163b-f086-4fe8-a343-db5d40a85e39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:18:59.484227 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f163b-f086-4fe8-a343-db5d40a85e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:18:59.484461 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f163b-f086-4fe8-a343-db5d40a85e39 admin admin] PATH_INFO: `/v3/users/1f2d1ace6da5410b8a2af85a97377f51` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:18:59.485786 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1f163b-f086-4fe8-a343-db5d40a85e39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f2d1ace6da5410b8a2af85a97377f51)` {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:18:59.488255 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1f163b-f086-4fe8-a343-db5d40a85e39 admin admin] RBAC: Authorization granted {{(pid=80703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:18:59.538933 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-fb1f163b-f086-4fe8-a343-db5d40a85e39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f2d1ace6da5410b8a2af85a97377f51'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:18:59.539669 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-fb1f163b-f086-4fe8-a343-db5d40a85e39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f2d1ace6da5410b8a2af85a97377f51'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:18:59.552219 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-fb1f163b-f086-4fe8-a343-db5d40a85e39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f2d1ace6da5410b8a2af85a97377f51'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:18:59.561192 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-fb1f163b-f086-4fe8-a343-db5d40a85e39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f2d1ace6da5410b8a2af85a97377f51'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:18:59.561809 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.notifications [None req-fb1f163b-f086-4fe8-a343-db5d40a85e39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f2d1ace6da5410b8a2af85a97377f51'} {{(pid=80703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:18:59.574459 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1493/3017] 10.222.0.60 () {58 vars in 1224 bytes} [Sun Jul 31 02:18:59 2022] DELETE /identity/v3/users/1f2d1ace6da5410b8a2af85a97377f51 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 02:18:59.755365 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5a992c-8088-4d61-b033-294da175d652 admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:18:59.757122 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-da5a992c-8088-4d61-b033-294da175d652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:18:59.770226 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5a992c-8088-4d61-b033-294da175d652 admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:18:59.828489 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf567e7-2089-4bb1-a919-a6a28e129a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '652828201b9e47a5b54a3c3110e80fd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b95aba7aab1442a9b3944b9e1f7019a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:18:59.829155 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf567e7-2089-4bb1-a919-a6a28e129a5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:18:59.829430 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf567e7-2089-4bb1-a919-a6a28e129a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:18:59.829697 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf567e7-2089-4bb1-a919-a6a28e129a5b admin admin] PATH_INFO: `/v3/projects/3ba1ac54f53e46d7b9c37b3f71d3d2fe` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:18:59.830847 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf567e7-2089-4bb1-a919-a6a28e129a5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ba1ac54f53e46d7b9c37b3f71d3d2fe)` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:18:59.832772 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf567e7-2089-4bb1-a919-a6a28e129a5b admin admin] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:18:59.841525 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:18:59.887745 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-abf567e7-2089-4bb1-a919-a6a28e129a5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ba1ac54f53e46d7b9c37b3f71d3d2fe', 'request_id': 'req-abf567e7-2089-4bb1-a919-a6a28e129a5b'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:18:59.893495 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-abf567e7-2089-4bb1-a919-a6a28e129a5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ba1ac54f53e46d7b9c37b3f71d3d2fe', 'request_id': 'req-abf567e7-2089-4bb1-a919-a6a28e129a5b'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:18:59.899856 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-abf567e7-2089-4bb1-a919-a6a28e129a5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ba1ac54f53e46d7b9c37b3f71d3d2fe', 'request_id': 'req-abf567e7-2089-4bb1-a919-a6a28e129a5b'} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:18:59.915425 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-abf567e7-2089-4bb1-a919-a6a28e129a5b admin admin] The token cache is being invalidate because project 3ba1ac54f53e46d7b9c37b3f71d3d2fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 02:18:59.915760 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-abf567e7-2089-4bb1-a919-a6a28e129a5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:18:59.916388 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.notifications [None req-abf567e7-2089-4bb1-a919-a6a28e129a5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 02:18:59.917885 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1525/3018] 10.222.0.60 () {58 vars in 1233 bytes} [Sun Jul 31 02:18:59 2022] DELETE /identity/v3/projects/3ba1ac54f53e46d7b9c37b3f71d3d2fe => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 02:19:09.571239 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=28,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:19:09.912432 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:22:28.150946 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc659ae-de36-4f6e-9931-0e1acdbe1691 None None] REQUEST_METHOD: `POST` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:22:28.151450 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc659ae-de36-4f6e-9931-0e1acdbe1691 None None] SCRIPT_NAME: `/identity` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:22:28.151450 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc659ae-de36-4f6e-9931-0e1acdbe1691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:22:28.201221 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.auth.core [None req-dbc659ae-de36-4f6e-9931-0e1acdbe1691 None None] MFA Rules not processed for user `657a3f73879e4b31b70a1c4f73e80f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 02:22:28.202422 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG keystone.common.fernet_utils [None req-dbc659ae-de36-4f6e-9931-0e1acdbe1691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:22:28.274047 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: [pid: 80703|app: 0|req: 1494/3019] 10.222.0.60 () {58 vars in 1058 bytes} [Sun Jul 31 02:22:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 02:22:28.280464 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf567e7-2089-4bb1-a919-a6a28e129a5b admin admin] Authenticating user token {{(pid=80702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 02:22:28.292032 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf567e7-2089-4bb1-a919-a6a28e129a5b admin admin] Validating token access rules against request {{(pid=80702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 02:22:28.297446 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbbce58-8b79-41b9-9f1a-0dd175b8091f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657a3f73879e4b31b70a1c4f73e80f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b931b81a237949aa845891d4bb5aa1c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 02:22:28.298052 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbce58-8b79-41b9-9f1a-0dd175b8091f service placement] REQUEST_METHOD: `GET` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 02:22:28.298323 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbce58-8b79-41b9-9f1a-0dd175b8091f service placement] SCRIPT_NAME: `/identity` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 02:22:28.298590 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbce58-8b79-41b9-9f1a-0dd175b8091f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 02:22:28.300421 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.fernet_utils [None req-5cbbce58-8b79-41b9-9f1a-0dd175b8091f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 02:22:28.311414 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbbce58-8b79-41b9-9f1a-0dd175b8091f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 02:22:28.313007 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbbce58-8b79-41b9-9f1a-0dd175b8091f service placement] RBAC: Authorization granted {{(pid=80702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 02:22:28.322806 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: [pid: 80702|app: 0|req: 1526/3020] 10.222.0.60 () {60 vars in 1365 bytes} [Sun Jul 31 02:22:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 02:22:38.265243 dv-neutron-master-2-hyperv devstack@keystone.service[80703]: DEBUG dbcounter [-] [80703] Writing DB stats keystone:SELECT=39 {{(pid=80703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:22:38.318674 dv-neutron-master-2-hyperv devstack@keystone.service[80702]: DEBUG dbcounter [-] [80702] Writing DB stats keystone:SELECT=6 {{(pid=80702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}